+ All Categories
Home > Documents > Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area...

Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area...

Date post: 02-Jan-2016
Category:
Upload: shawn-russell
View: 215 times
Download: 0 times
Share this document with a friend
14
assured communications Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group Understanding the CMMI ® Validation Process Area Gary Natwick & Jim Cocci Harris Corporation Melbourne, Florida
Transcript
Page 1: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 117-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

Understanding the CMMI® Validation Process Area

Gary Natwick & Jim Cocci

Harris Corporation

Melbourne, Florida

Page 2: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 217-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

Application Domain

Government Communications Systems Division· $1.1 B in Sales · 6,200 Employees · ISO 9001 · SEI CMM® Level 4

Integrated Information Communication Systems Data Handling and

Control Systems

Image Processing

Meteorological Processing Systems

Range Systems

Air Traffic Control Systems

Transportation Communications Systems

Computer-Controlled, Highly Distributed Communications and Control Systems to Support Air Traffic Management

High-Reliability Satellite Communications Systems to Support Air Traffic Management

GPS Applications for ATM—Automatic Dependent Surveillance

Aerospace & Ground Communication Systems

Advanced Avionics

Airborne Communications

Satellite Antennas

Satellite Electronics

C4I Systems

Communications Systems (SATCOM and Terrestrial)

Intelligence Systems

Information Warfare and Network/Internet Security

Commercial Systems and Products

Page 3: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 317-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

CMMI®-SE/SW (Staged Representation)

Organizational Innovation and DeploymentCausal Analysis and Resolution5 Optimizing

4 Quantitatively Managed

3 Defined

2 Managed

ContinuousProcess Improvement

QuantitativeManagement

ProcessStandardization

BasicProjectManagement

Organizational Process PerformanceQuantitative Project Management

Requirements DevelopmentTechnical SolutionProduct IntegrationVerificationValidationOrganizational Process FocusOrganizational Process DefinitionOrganizational Training Integrated Project ManagementRisk ManagementDecision Analysis and Resolution

Requirements Management Project PlanningProject Monitoring and ControlSupplier Agreement ManagementMeasurement and AnalysisProcess and Product Quality AssuranceConfiguration Management

QualityProductivity

RiskRework1 Initial

Process AreasMaturity Level Focus

Page 4: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 417-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

So… what is validation?

• Don’t we just worry about that when the system is delivered?

• Isn’t that the customer’s problem?• How is this related to verification ?• When should I care about this ?• Who performs these activities, and when ?• When do we plan for these activities ? • What parts of development are affected ?• What if you don’t do both Validation & Verification ?

Page 5: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 517-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

Per The Requirements

As Systems Specified It

As Engineering Designed It

If You Don’t Do Both …

Verification and Validation

Page 6: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 617-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

As the Factory Built It

As Integration Installed It

What the Customer Wanted

You Can Meet the Spec, But …

Verification and Validation

Page 7: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 717-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

Verification Validation

Do we meet the requirements? Do we understand the customer needs?

Do we understand how it is supposed to perform?

Do we understand what it is supposed to do?

Do we comply with interfaces and standards?

Do we understand the system context?

Did we build the product correctly ? Did we build the correct product?

There are Differences

Page 8: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 817-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

There are Similarities

Verification and Validation processes – Use similar techniques– Both apply across the product lifecycle– Can be applied concurrently– Differences are in emphasis and intent

CMMI Verification PA CMMI Validation PASP1.1 Select Work Products for

VerificationSP1.1 Select Products for Validation

SP1.2 Establish the Verification Environment

SP1.2 Establish the Validation Environment

SP1.3 Establish Verification Procedures and Criteria

SP1.3 Establish Validation Procedures and Criteria

SP3.1 Perform Verification SP2.1 Perform Validation

SP3.2 Analyze Verification Results and Identify Corrective Action

SP2.2 Analyze Validation Results

Page 9: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 917-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

Scope of Validation

• What is subject to validation?– The organization defines the list of products to be validated from

across the lifecycle• Products• Product Components• Intermediate Work Products and Processes

– Selected on the basis of which are best predictors of how well the product component will satisfy user needs

• Example products for validation:– Operational Scenarios (Requirements Development PA)– Requirements (Requirements Development PA)– Designs (Technical Solution PA)– Integration procedures (Product Integration PA)– Validation environment & procedures (Validation PA)– Deliverable products (Product Integration PA)– Support documentation (Technical Solution PA)

Page 10: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 1017-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

System Analysis

Systems Engineering

• Functional Reqts• Performance Reqts• Driving Requirements

• CONOPS• External Interfaces• Operational Interfaces

• Architecture

. . .

. . .

. . .

Requirements Mgmt

. . .System Architecting• Evaluation Criteria• Concepts/Elements• Refined Definition• Validation

Validation - Key to Architecting

Page 11: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 1117-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

Level N

Development

Level N+1

Development• • • • • •

As we allocate requirements and design to the next level, we validate with stakeholders by ensuring a mutual understanding of the allocation.

Requirements AllocationDesign Refinement

Development Progress

Requirements UnderstandingDesign InterpretationDevelopment Context

Validation - Each step of the process

Page 12: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 1217-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

Phase Validation VerificationBusiness Acquisition Understanding

CONOPS

Requirements

Preliminary Architecture Performance

System Requirements

Requirements Testability

System Design Architecture Configuration

Architecture Performance

Preliminary Design Functional Design CI Allocations

Detailed Design Physical Design CI Performance

Fabrication, Code, Integration

Documentation Subsystem Level Performance

Verification System Configuration System Level Performance

Production System Configuration Repeatable Performance

Field Support System Lifecycle Sustained Performance

Validation - Throughout the Lifecycle

Page 13: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 1317-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

Without Validation as part of the process, you will waste:• Time• Energy• Money• Resources

… and still not get it right.

Verification without Validation

Page 14: Gary Natwick & Jim Cocci - 1 17-20 November 2003 Understanding the CMMI ® Validation Process Area CMMI ® Technology Conference & User Group 2003 assured.

assured communications Gary Natwick & Jim Cocci - 1417-20 November 2003

Understanding the CMMI® Validation Process AreaCMMI® Technology Conference & User Group 2003

Gary [email protected]

Jim [email protected]

Harris CorporationGovernment Communications Systems DivisionP.O. Box 37Melbourne, Florida 32902-0037http://www.harris.com/

Contact Information

® Capability Maturity Model, CMM, and CMMI are registered by Carnegie Mellon University with the U.S. Patent and Trademark Office.


Recommended