Software Testing Experience
Wednesday, April 9, 2008
CMM
KPA SUMMARY
Level 2: | Level 4: |
| |
| |
Level 3: | Level 5: |
| |
| |
|
|
| |
|
Span of the KPA's:
Managerial | Technical | |
Project-level | All Level-2 KPAs Integrated Software Management Intergroup Coordination | Software Product Engineering Peer Reviews Software Quality Management Quantitative Process Management |
Organization-wide | Organization Process Focus Organization Process Definition Training Program Process Change Management | Defect Prevention Technology Change Management |
REQUIREMENTS MANAGEMENT
PURPOSE: To establish a common understanding between the customer and the software project of the customer's requirements to be addressed by the software project.
WHAT IT INVOLVES:
- Establishing and maintaining an agreement with the customer on the software project.
GOALS:
- Customer requirements are controlled to form a baseline for technical and management use.
- Software plans, products and activities are kept consistent with the user requirements
COMMITMENT TO PERFORM:
- The project follows a written organizational policy to manage the user requirements.
ABILITY TO PERFORM:
- Software requirements are documented.
- Adequate resources and funding are provided to manage the requirements.
- Members of the project and related groups are trained to perform their RM activities.
ACTIVITIES PERFORMED:
- The project reviews the requirements before they are incorporated.
- The project uses the requirements as the basis for software plans, work products and activities. (Pre-requisite for other KPAs - SPP and SPT)
- Changes to requirements are reviewed and incorporated into the software project.
MEASUREMENT AND ANALYSIS:
- Measurements are made and used to determine the status of the RM activities.
VERIFYING IMPLEMENTATION:
- RM Activities are reviewed with senior management on periodic basis.
- RM activities are reviewed with the PM on both periodic and event-driven bases.
PURPOSE: To establish reasonable plans to perform execute and managing the project.
WHAT IT INVOLVES:
- Developing estimates for the work to be performed;
- Establishing the necessary commitments;
- Defining the plan to perform work.
GOALS:
- Software estimates are documented for use in planning and tracking the project.
- Software project activities and commitments are planned and documented.
- Affected groups and individuals agree to their commitments related to the project.
COMMITMENT TO PERFORM:
- A project manager (PM) is designated to negotiate the commitments and make development plan.
- The project follows a written organizational policy for SPP.
ABILITY TO PERFORM:
- A documented and approved work statement exists for the software project.
- Responsibilities for making development plan are assigned.
- Adequate resources and funding are provided for SPP.
- Those involved in SPP are trained in s/w estimating & planning procedures.
ACTIVITIES PERFORMED:
- The s/w project team participates on the project proposal team.
- Project team participates with other affected groups in the overall project planning.
- Project commitments to external parties are reviewed with the senior management.
- SDLC with pre-defined stages of manageable size is defined.
- A development plan is made according to a documented procedure.
- The project plan is documented.
- Software work products (SWPs) for controlling the project are identified.
- Size estimates of the SWPs are derived according to a documented procedure.
- Effort, cost estimates and schedule, are derived according to a documented procedure.
- Critical computer resources are estimated according to a documented procedure.
- Project risks are identified, evaluated and documented.
- Plans for project facilities and support tools are prepared.
- Software planning data are recorded.
MEASUREMENT AND ANALYSIS
- Status of software planning activities
VERIFYING IMPLEMENTATION
- Activities are reviewed with senior management on periodic basis.
- Activities are reviewed with project manager both on periodic and event-driven bases.
- SQAG reviews/audits the planning activities and work products and reports the results.
PURPOSE: To provide visibility into the project to enable management of take actions when performance deviates significantly from plans.
WHAT IT INVOLVES:
- Tracking and reviewing the achievements and results against estimates and plans;
- Adjusting the plans based on actual achievements and results.
GOALS:
- Results and performances are tracked against plans.
- Corrective actions are taken and managed to closure.
- Affected groups and individuals agree to changes to project commitments.
COMMITMENT TO PERFORM:
- A PM is designated to be responsible for project's software activities and results.
- The project follows a written organizational policy for managing the project.
ABILITY TO PERFORM:
- A software project plan is documented and approved. (Output of the earlier KPA – SPP)
- PM assigns responsibility for software work products (SWP) and activities.
- Adequate resources and funding are provided for tracking the project.
- S/w managers are trained in managing technical and personnel aspects of the project.
- Team Leaders receive orientation in the technical aspects of the project.
ACTIVITIES PERFORMED:
- The project activities are tracked and status is communicated using the development plan.
- Project development plan is revised according to a documented procedure.
- Project commitments to external parties are reviewed with the senior management.
- Changes to project commitments are communicated to project and affected groups.
- Size of SWPs and their changes are tracked and corrective actions are taken.
- Costs and efforts are tracked and corrective actions are taken.
- Critical computer resources are tracked and corrective actions are taken.
- Schedules are tracked and corrective actions are taken.
- Technical activities are tracked and corrective actions are taken.
- Project risks are tracked.
- Measurement data and re-planning data are recorded.
- Periodic internal reviews are held to track progress, plans, performance and issues.
- Achievements and results are reviewed at milestones according to a documented procedure.
MEASUREMENT AND ANALYSIS
- Status of software tracking and oversight activities
VERIFYING IMPLEMENTATION
- Activities are reviewed with senior management on periodic basis.
- Activities are reviewed with project manager both on periodic and event-driven bases.
- SQAG reviews/audits the project tracking activities and SWPs and reports the results.
PURPOSE: To provide management with visibility into the process that is being used and products being built.
WHAT IT INVOLVES:
- Reviewing and auditing the software products and activities to verify that they comply with the applicable procedures and standards;
- Providing project and other managers with the review/audit results.
GOALS:
- SQA activities are planed.
- Adherence of products and activities to the applicable standards, procedures and requirements is verified objectively.
- Affected groups are informed of SQA results
- Noncompliance issues that cannot be resolved within the project, are escalated to SM.
COMMITMENT TO PERFORM:
- The project follows a written organizational policy for implementing the SQA activities.
ABILITY TO PERFORM:
- An SQAG exists (for coordinating and implementing SQA activities).
- Adequate resources and funding are provided for SQA activities.
- SQAG members are trained to perform SQA activities.
- Project members receive orientation on SQAG's role, responsibility, authority and value.
ACTIVITIES PERFORMED:
- SQAP is prepared for the project.
- SQAG activities are performed in accordance with SQAP.
- SQAG participates in the preparation & review of the development plan, standards and procedures.
- SQAG reviews the project activities to verify compliance.
- SQAG audits designated SWPs to verify compliance.
- SQAG periodically reports the results to the project team.
- Deviations in the products and activities are documented and handled according to a documented procedure.
- If appropriate, SQAG periodically reviews its activities and findings with customer's SQAG.
MEASUREMENT AND ANALYSIS
- Cost and schedule of SQA activities.
VERIFYING IMPLEMENTATION
- SQA activities are reviewed with senior management on periodic basis.
- SQA activities are reviewed with project manager both on periodic and event-driven bases.
PURPOSE: To establish and maintain integrity of the products throughout the project's SDLC.
WHAT IT INVOLVES:
- Identifying the software configuration (selected SWPs and their description) at given points of time;
- Systematically controlling changes to the configuration;
- Maintaining the integrity and traceability throughout the SDLC.
GOALS:
- SCM activities are planed.
- Selected SWPs are identified, controlled and available.
- Changes to SWPs are controlled.
- Affected groups and individuals are informed the status and contents of baselines.
COMMITMENT TO PERFORM:
- The project follows a written organizational policy for implementing the SCM activities.
ABILITY TO PERFORM:
- An SCCB with authority for managing the project's baselines exists or is established.
- An SCMG with responsibility for coordinating and implementing the project SCM, exists.
- Adequate resources and funding are provided for SCM activities.
- SCMG members are trained in the (objectives, procedures and methods for) SCM activities.
- Project members are trained to perform their SCM activities.
ACTIVITIES PERFORMED:
- SCMP is prepared for each project according to a documented procedure.
- SCM activities are performed using a documented and approved SCMP.
- A CM Library system is established as a repository for the s/w baselines.
- SWPs to be placed under CM are identified.
- Change requests and problem reports for all configuration items are initiated, reviewed, approved (or rejected) and tracked according to a documented procedure.
- Changes to baselines are controlled according to a documented procedure.
- Baseline library products are created and their release is controlled according to a documented procedure. (Difference between 7 and 8?)
- CI status is recorded according to a documented procedure.
- SCM activities and baseline contents are communicated to the affected groups.
- Baseline audits are conducted according documented procedure.
MEASUREMENT AND ANALYSIS
- Status of SCM activities
VERIFYING IMPLEMENTATION
- SCM activities are reviewed with senior management on periodic basis.
- SCM activities are reviewed with project manager both on periodic and event-driven bases.
- SCMG periodically audits the software baselines to verify that they conform to the documentation that defines them.
- SQAG reviews/audits the activities and work products of SCM and reports the results.
LEVEL-3 KEY PROCESS AREAS AND KEY PRACTICES
ORGANIZATION PROCESS FOCUS
PURPOSE: To establish the organizational responsibility for software process activities that improve the organization's overall software process capability.
WHAT IT INVOLVES:
- Developing and maintaining an understanding of software processes (of the organization and the projects);
- Coordinating the activities to assess, develop, maintain and improve these processes.
GOALS:
- S/W process development and improvement activities are coordinated across organization.
- Strengths and weaknesses of the s/w processes are identified relative to a process standard.
- Organization-level process development and improvement activities are planned.
COMMITMENT TO PERFORM:
- The organization follows a written organizational policy for coordinating software process development and improvement (SPDI) activities across the organization.
- Senior management sponsors and oversees the SPDI activities.
ABILITY TO PERFORM:
- A group (SEPG) responsible for organization's software process activities exists.
- Adequate resources and funding are provided for organization's software process activities.
- SEPG members receive required training to perform these activities.
- Project and support group members receive orientation of organization's s/w process activities and their role in these activities.
ACTIVITIES PERFORMED:
- S/W process is assessed periodically and action plans are develop to address the assessment findings. (Assessments are typically conducted every 1.5 to 3 years)
- Organization development and maintains a plan for SDPI activities.
- At the organization level, the activities for developing and improving their s/w processes are coordinated.
- At the organization level, the use of the organization's software process database is coordinated.
- New processes, methods and tools in limited use in the organization, are monitored, evaluated and transferred to other parts.
- Training for the organization's and project's s/w processes is coordinated across the organization.
- Groups involved in implementing the s/w processes are informed of the SPDI activities.
MEASUREMENT AND ANALYSIS
- Status of organization's process development and improvement activities
VERIFYING IMPLEMENTATION
- SPDI activities are reviewed with senior management on periodic basis.
PURPOSE: To develop and maintain a usable set of s/w process assets that improve process performance and provide a basis for cumulative, long term benefits to the organization.
WHAT IT INVOLVES:
- Developing and maintaining the organization's standard software process, along with process assets (e.g., s/w lifecycles, process tailoring guidelines, OSSP database etc.)
GOALS:
- OSSP is developed and maintained.
- Information related to the use of OSSP by the projects, is collected, reviewed and made available.
COMMITMENT TO PERFORM:
- The organization follows a written organizational policy for developing and maintaining OSSP and related process assets.
ABILITY TO PERFORM:
- Adequate resources and funding are provided for developing and maintaining the organization's standard software process (OSSP) and related process assets.
- Those who develop and maintain OSSP receive required training to perform these activities.
ACTIVITIES PERFORMED:
- OSSP is developed and maintained according to a documented procedure.
- OSSP is documented according to established standards.
- Description of approved life cycles are documented and maintained.
- Project's tailoring guidelines of OSSP are developed and maintained.
- Organization's software process database is established and maintained.
- Library of software process-related documents is established and maintained.
MEASUREMENT AND ANALYSIS
- Status of organization's process definition activities
VERIFYING IMPLEMENTATION
- SQAG reviews/audits the activities and work products for developing and maintaining OSSP and related process assets and reports the results.
TRAINING PROGRAM
PURPOSE: To develop the skills and knowledge of individuals so they can perform their roles effectively.
WHAT IT INVOLVES:
- Identifying the training needed by the organization, projects and individuals
- Developing or procuring training to address the identified needs.
GOALS:
- Training activities are planned.
- Training needs for software management and technical roles is provided.
- Individuals in the project and related groups receive necessary training to perform their roles.
COMMITMENTS TO PERFORM:
- The organization follows a written organizational policy for meeting the training needs.
ABILITY TO PERFORM:
- A training group responsible for fulfilling organization's training needs exists
- Adequate resources and funding are provided for implementing the training program.
- Training group members have necessary skills and knowledge to perform training.
- Software managers receive orientation on the training program.
ACTIVITIES PERFORMED:
- Project develops and maintains a training plan that specifies the training needs.
- Organization training plan is developed and maintained according to documented procedure.
- Organization training is performed according to documented procedure.
- Organization level training courses are developed and maintained as per organization standards.
- Waiver procedure is established and used.
- Training records are maintained.
MEASUREMENT AND ANALYSIS:
- Status of organization's process definition activities
- Quality of the training program.
VERIFYING IMPLEMENTATION:
- Training program activities are reviewed with senior management on periodic basis.
- Training program is independently evaluated on a periodic basis for consistency with and relevance to the organization's needs.
- Training program activities and work products are reviewed and/or audited and results are reported.
SOFTWARE MANAGEMENT
PURPOSE: To integrate the software engg and management activities into a coherent, defined software process that is tailored from the OSSP.
WHAT IT INVOLVES:
- Developing the project defined software process (PDSP)
- Managing the project using this PDSP.
GOALS:
- Project defined software process (PDSP) is a tailored version of OSSP.
- Project is planned and managed according to the PDSP.
COMMITMENT TO PERFORM:
- The project follows a written organizational policy for planning and managing the project using the OSSP.
ABILITY TO PERFORM:
- Adequate resources and funding are provided for implementing the training program.
- Individuals responsible for PDSP receive required training in tailoring the OSSP and using the process assets.
- Software managers receive required training in managing the tech, admin and personnel aspects of projects based on PDSP.
ACTIVITIES PERFORMED:
- PDSP is developed by tailoring the OSSP according to a documented procedure.
- Each PDSP is revised according to a documented procedure.
- Software development plan that describes the use of PDSP is developed and maintained.
- The project is managed to PDSP.
- The organization's software process database is used for software planning and estimating.
- Size of work products and their changes, is managed according to documented procedure.
- Project's software effort and costs are managed according to documented procedure.
- Critical computer resources are managed according to documented procedure.
- Critical dependencies and critical paths of the schedule are managed according to documented procedure.
- Project's software risks are identified, assessed, documented and managed according to documented procedure.
- Periodic project reviews are performed to determine actions to bring project performance in line with the needs of business, customer and end-user.
MEASUREMENT AND ANALYSIS:
- Effectiveness of the ISM activities.
VERIFYING IMPLEMENTATION:
- Activities are reviewed with senior management on periodic basis.
- Activities are reviewed with project manager both on periodic and event-driven bases.
- SQAG reviews/audits the activities and work products and reports the results.
SOFTWARE PRODUCT ENGINEERING
PURPOSE: To consistently perform a well-defined engineering process that integrates all s/w engineering activities to produce correct, consistent software products effectively and efficiently.
WHAT IT INVOLVES:
- Performing the engineering tasks to build and maintain the software using the PDSP.
GOALS:
- Software engg. tasks are defined, integrated and consistently performed to produce the s/w.
- Software work products are kept consistent with each other.
COMMITMENT TO PERFORM:
- The project follows a written organizational policy for performing the s/w engg activities.
ABILITY TO PERFORM:
- Adequate resources and funding are provided for performing the s/w engg tasks.
- Project technical staff receives required training to perform their technical assignments.
- Project technical staff receives orientation in related software engineering disciplines.
- PM and software managers receive orientation in technical aspects of the project.
ACTIVITIES PERFORMED:
- Appropriate software engg. methods and tools are integrated into the PDSP (project's defined software process).
- Software requirements are developed, maintained, documented and verified by systematically analyzing the customer requirements according to the PDSP.
- Software design is developed, maintained, documented and verified according to the PDSP, to accommodate the software requirements to form the framework for coding.
- Software code is developed, maintained, documented and verified according to the PDSP to implement the software requirements and design.
- Software testing is performed according to the PDSP.
- Integration testing is planned and performed according to the PDSP.
- System and acceptance testing of the software are planned and performed to demonstrate that the software satisfied the requirements.
- The documentation that will be used to operate and maintain the software is developed and maintained according to the PDSP.
- Defect data from peer reviews and testing are collected and analyzed according to PDSP.
- Consistency is maintained across software work products (s/w plans, process descriptions, user requirements, software requirements, design, code, test plans and test procedures).
MEASUREMENT AND ANALYSIS:
- Functionality and quality of software products
- Status of software product engineering activities
VERIFYING IMPLEMENTATION:
- Activities are reviewed with senior management on periodic basis.
- Activities are reviewed with project manager both on periodic and event-driven bases.
- SQAG reviews/audits the activities and work products and reports the results.
INTERGROUP COORDINATION
PURPOSE: To establish a means for the project to participate actively with the other technical groups so the project is better able to satisfy the customer's needs effectively and efficiently.
WHAT IT INVOLVES:
- Project's participation with other technical groups to address system-level requirements, objectives and issues
GOALS:
- The customer's requirements are agreed to by all the affected groups.
- Commitments between the technical groups are agreed by the affected groups.
- The technical groups identify, track and resolve intergroup issues.
COMMITMENT TO PERFORM:
- The project follows a written organizational policy for establishing interdisciplinary technical teams.
ABILITY TO PERFORM:
- Adequate resources and funding are provided for performing the s/w engg tasks.
- The support tools used by the different technical groups are compatible to enable effective communication and coordination.
- All managers receive required training in teamwork.
- All task leaders in each technical group receive orientation in the processes, methods and standards used by the other technical groups.
- Technical staff receives orientation in teamwork.
ACTIVITIES PERFORMED:
- The project and other technical groups participate with the customer and users to establish the requirements.
- Project representatives work with the other technical groups to monitor and coordinate technical activities and resolve technical issues.
- A documented plan is used to communicate intergroup commitments and to coordinate and track the work performed.
- Critical dependencies between the technical groups are identified and tracked according to a documented procedure.
- Items provided as inputs by other technical groups are reviewed by representatives of the receiving groups to endure that the items meet their needs.
- Intergroup issues not resolvable by the individual project representatives are handled according to a documented procedure.
- Project's technical representatives conduct periodic technical reviews and interchanges.
MEASUREMENT AND ANALYSIS:
- Status of the Intergroup coordination activities
VERIFYING IMPLEMENTATION:
- Activities are reviewed with senior management on periodic basis.
- Activities are reviewed with project manager both on periodic and event-driven bases.
- SQAG reviews/audits the activities and work products and reports the results.
PEER REVIEWS
PURPOSE: To remove defects from the work products early and efficiently and to develop a better understanding of the work products and of defects that might be prevented..
WHAT IT INVOLVES:
- A methodical examination of the work products by the producer's peers to identify defects and areas where changes are needed.
GOALS:
- Peer reviews are planned.
- Defects from the work products are identified and removed.
COMMITMENT TO PERFORM:
- The project follows a written organizational policy for performing peer reviews.
ABILITY TO PERFORM:
- Adequate resources and funding are provided for performing peer reviews on each work product to be reviewed.
- PR leaders receive required training on how to lead peer reviews.
- Reviewers in peer reviews, receive required training in the objectives, principles and methods of peer reviews.
ACTIVITIES PERFORMED:
- PRs are planned and the plans are documented.
- PRs are performed according to a documented procedure.
- Data on the conduct and results of PRs are recorded.
MEASUREMENT AND ANALYSIS:
- Status of peer review activities
VERIFYING IMPLEMENTATION:
- Activities are reviewed with senior management on periodic basis.
- Activities are reviewed with project manager both on periodic and event-driven bases.
- SQAG reviews/audits the activities and work products and reports the results.
Labels: Quality Assurance
0 Comments:
Post a Comment
<< Home