1 Approved for Public Release, PAO #675-12,

24 August 2012 M395 APMI Accelerated Precision Mortar Initiative

PGK Precision Guidance Kit

Volcano Anti-Tank Mine 120mm Tank Ammunition

XM7 Spider Anti-Personnel Force Protection

120mm Tank Ammunition

ISAAS Individual Semi-Automatic

Airburst System

15th Annual Systems Engineering Conference Hyatt Regency Mission Bay San Diego, California 22-25 October 2012

System Requirements Traceability and System Verification Rigor and Planning

Approved for Public Release, PA 675-12, dated 24 August 2012

ISAAS Individual Semi-Automatic Airburst System

Joel Feigum Chief Engineer ATK Advanced Weapons

2 Approved for Public Release, PAO #675-12,

24 August 2012

Agenda

Problem Statement

Program Summary

Process

Implementation Details

Conclusions

3 Approved for Public Release, PAO #675-12,

24 August 2012

Problem Statement

Program Summary

Process

Implementation Details

Conclusions

4 Approved for Public Release, PAO #675-12,

24 August, 2012

Problem Statement (The Perfect Storm)

• Aggressive schedules

• Limited funding

• Increased requirement complexity

• Performance, Environment and Testing

• Increased rigor in testing

• Increased testing complexity

• Multiple requirements 1 Test

• Multiple test 1 requirement

• Multifaceted program

• TD FOA-1

• TD EMD

• EMD FOA-2

Milestone C Decision

5 Approved for Public Release, PAO #675-12,

24 August 2012

Problem Statement

Program Summary

Process

Implementation Details

Conclusions

6 Approved for Public Release, PAO #675-12,

24 August 2012

Armor Piercing**

ISAAS System

TA/FC

Weapon

* Current Development

** Future Development

25mm Low

Velocity Ammo

High Explosive Air Bursting*

Training*

Non-lethal (Airburst)**

Door Breaching**

Non-Lethal (Blunt)**

Battery

7 Approved for Public Release, PAO #675-12,

24 August 2012

ISAAS Con-Ops

8 Approved for Public Release, PAO #675-12,

24 August 2012

Program Schedule

300 Series Ammo Test 400 Series System Test

500 Series Ammo Test 600 Series System Test

9 Approved for Public Release, PAO #675-12,

24 August 2012

”

ISAAS is in Theater

Forward Operational Assessment (FOA) running in parallel with EMD program

10 Approved for Public Release, PAO #675-12,

24 August 2012

Problem Statement

Program Summary

Process

Implementation Details

Conclusions

11 Approved for Public Release, PAO #675-12,

24 August, 2012

Structured Requirements

Ammunition Software

Requirements Spec

28080041

Ammunition Software Design

Description

28082950

Supporting Documents

· MIL-A-2550

· MIL-P-9024

· MIL-F-13926

· MIL-PRF-71226 (AR)

· DOD-STD-100

· MIL-STD-129

· MIL-STD-130

· MIL-STD-171

· MIL-STD-331

· OMS/MP

· MIL-STD-461

· EMIL-STD-464C

· MIL-STD-709

· MIL-STD-794

· MIL-STD-810G

· MIL-STD-889

· MIL-STD-1168

· MIL-STD-1316

· MIL-STD-1472

· MIL-STD-1474D

· MIL-STD-2105

· FED-STD-595

· STANAG 4439

· MIL-HDBK-759, Notice 2

· MIL-HDBK-454A

· ITOP 4-2-602

· TOP 1-2-511

· TOP 3-2-045

Customer Requirement Documents

System Requirement Documents

Capability Development

Document (CDD)

Rev. 2.8

26 Oct 2010

CARDS #02092

Approved

29 January 2011

System Performance

Specification (SPS)

28077271

TA/FC Performance

Specification

28082807

Weapon Performance

Specification

28083265

Ammunition Performance

Specification

28083290

TA/FC / Weapon M-ICD

28082615

Weapon / Ammo M-ICD

28083592

TA/FC / Battery M-ICD

28077025

System Electrical ICD

28083249

User Interface ICD

28083250

Messaging IRS

28083356

Battery Performance

Specification

28084210

TA/FC Software Requirements

Spec

32419

TA/FC Software Design

Description

32420

12 Approved for Public Release, PAO #675-12,

24 August, 2012

Requirement Decomposition

KPP / KSA System

Req’s

TA/FC

Req’s

Weapon

Req’s

Ammo

Req’s

KPP 1 - System Effectiveness 17 29 5 16

KPP 2 – Operational Availability 2 7 6 1

KSA 1 – Target Acquisition 2 4 0 0

KSA 2 - Reliability 3 3 2 1

KSA 3 – Degraded Operation 3 1 2 0

KSA 4 – Dispersion 1 0 2 2

KSA 5 – Engagement Time 10 27 6 14

KSA 6 – Zero Retention/Repeatability 3 3 4 0

• Understanding user requirements decomposition key to verification planning

• Focused test planning

• Customer/User focus

13 Approved for Public Release, PAO #675-12,

24 August, 2012

Early Test Planning is Critical

• Process demonstrates the key activities required to verify requirements

• Requirements management tool used to tie the testing and requirements

• Test planning driven by SE tools and team

• Early involvement of the customer and government test facilities

• Harvest data from FOA activities

Customer

Requirements

Document

Conduct Voice of

the Customer

(VOC)

System Spec / ICD

Development

Conduct System

SRR/SFR

Develop Initial

Test Plans

Subsystem Spec /

ICD Development

Identify Test

Objectives and

TRD’s

Review

Preliminary RVM

Preliminary Design Conduct PDR

Test

Performance /

RVM Review

System

Requirements

Verification

Assessment

Customer

QualificationPRR / SVRConduct CDR

Update Contractor

Qual Test

Objectives and

TRD’s

Develop Detailed

Test Plans

Contractor Prove

out TestingMilestone C

Design Evaluation

Testing

Contractor

Qualification

Testing

14 Approved for Public Release, PAO #675-12,

24 August 2012

Problem Statement

Program Summary

Process

Implementation Details

Conclusions

15 Approved for Public Release, PAO #675-12,

24 August 2012

SE Tools Supports

Test objectives linked to tests

Requirements linked to test objectives and configuration item

16 Approved for Public Release, PAO #675-12,

24 August 2012

Verification Identification

• Early identification of the “how to” during the verification process is critical to

ensuring program success

• Test planning

• Test objectives

• Success criteria

17 Approved for Public Release, PAO #675-12,

24 August 2012

User Focused Verification Event Summary

CDD Requirement Test

30

0

Test

31

0

Test

33

0

Test

35

0

Test

37

0

Test

40

0

Test

40

5

Test

41

0

Test

41

2

Test

42

0

Test

42

2

Test

42

3

Test

42

4

Test

42

5

Ch

emic

al A

nal

ysis

Cle

anin

g D

em

on

stra

tio

n

Dra

win

g In

spec

tio

n

EMQ

RB

Re

sult

s

Go

vern

me

nt

Are

na

Test

ing

Hu

man

En

gin

eeri

ng

An

alys

is

Logi

stic

s A

nal

ysis

Logi

stic

s In

spec

tio

n

Mai

nte

nan

ce A

nal

ysis

Nu

cle

ar E

ven

t A

nal

ysis

Op

erat

ion

al A

vaila

bili

ty A

nal

ysis

Ph

ysic

al I

nsp

ecti

on

Pro

bab

ility

of

Inca

pac

itat

ion

An

alys

is

Re

cogn

itio

n A

nal

ysis

Re

liab

ility

An

alys

is

Tact

ical

Tra

nsp

ort

atio

n S

ho

ck A

nal

ysis

Tran

spo

rtat

ion

An

alys

is

KPP-1 X X X X X X X X

KPP-2 X X X X X

KSA-2 X

KSA-3 X X X

KSA-4 X X X X

KSA-5 X X X X

KSA-6 X X

APA-1 X

APA-2 X

APA-3 X

APA-4 X

APA-5 X

APA-6 X X

APA-7 X X X X X

APA-8 X X

APA-9 X X

APA-10 X

APA-11 X X

APA-12 X X X X

APA-13 X X X X X X X

APA-14

APA-15 X X X

APA-16 X X X

APA-17 X

APA-18 X

APA-19 X

18 Approved for Public Release, PAO #675-12,

24 August 2012

Test Planning

19 Approved for Public Release, PAO #675-12,

24 August 2012

Sample SE Tool Output

20 Approved for Public Release, PAO #675-12,

24 August 2012

Problem Statement

Program Summary

Process

Implementation Details

Conclusions

21 Approved for Public Release, PAO #675-12,

24 August 2012

Manage / Identify V&V Issues

• SE tool utilized to monitor V&V process and issues

• V&V updated immediately upon test completion

• Review results as appropriate

22 Approved for Public Release, PAO #675-12,

24 August 2012

Verification Metrics

• Constant monitoring of verification activities against plans is critical to

ensuring success

23 Approved for Public Release, PAO #675-12,

24 August 2012

Planned vs. Actual Objectives

0

50

100

150

200

250

300

350

400

450

Nu

mb

er

of

Ob

ject

ive

s

Verification Events Sorted by Scheduled Completion Date

Planned (Cumulative)

Actual (Cumulative)

Actual Passed (Cumulative)

Gap due to analysis efforts

and endurance testing

24 Approved for Public Release, PAO #675-12,

24 August 2012

Conclusions

• Emphasis of System Engineering discipline throughout program life cycle

• Early collaboration and involvement of the test engineering

• System Engineering involvement in test planning and execution

• Early and constant monitoring of requirement V&V

• Metrics identification and tracking

• SE Tool usage is critical to tying it all together.

25 Approved for Public Release, PAO #675-12,

24 August 2012

Acknowledgements

Special thanks to PM-IW:

• Rob Greenfield – SE LEAD

• Andy Cline – Product Director

Test support:

• Peter Ollis – ATC Test Lead

• Don Kukowski – ATK Test Lead

26 Approved for Public Release, PAO #675-12,

24 August 2012

Contact information:

• Name: Joel Feigum

• Phone Number: 763-744-5127

• Company: ATK Advanced Weapons

Abstract ID Number: 14764