Date post: | 06-Jan-2018 |
Category: |
Documents |
Upload: | harvey-barnett |
View: | 217 times |
Download: | 1 times |
UNCLASSIFIEDUNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203
Developmental Test & Evaluation
Presented to ITEA SymposiumPresented to ITEA Symposium
Edward GreerEdward GreerDirector, Developmental Test & EvaluationDirector, Developmental Test & Evaluation
September 14, 2010September 14, 2010
www.acq.osd.mil/dte/www.acq.osd.mil/dte/
UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203
Minimizing Discovery in IOT&E
DDT&E supports:• Program Offices and DoD T&E community • Test planning and data analysis • Early discovery of deficiencies• Identification and sharing of best practices
Improve DT&E practice thru:• DT Policy & Oversight• Advancing DT&E Capability and Service Competencies
Mission of the Director, Developmental Test & Evaluation (DDT&E)
Improve acquisition outcomes by advancing “state of the practice”
DWSS
MRAP
2
UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203
DT&E Organization
DD, Land and Expeditionary Warfare
Steven Lopes
DD, Air Warfare
George Axiotis
DD, Naval Warfare
Patrick Clancy
DD, Net Centric & Space
Ray Shanahan
DD, Capability Development
Darlene Mosser-Kerner
• Policy / Guidance• Acquisition DT&E Workforce• DAU Content• TEMP DT&E Concept Briefs• Measures and Metrics• Joint T&E• Integrated T&E• DT&E in SEP• Annual Report
DirectorEdward Greer
Principal DeputyChris DiPetto
3
AppointeeSES
Legend:
UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203
Studies on T&E and Acquisition
4
“. . .beginning production before successfully demonstrating that the weapon system will work as intended increases the potential for discovering costly design changes…and usually requires substantial modification costs at a later time.” 2008 GAO Assessments of Selected Weapon Programs
“Approximately 50% of programs completing IOT&E since 2000 have been assessed as not operationally effective and/or suitable.” 2008 DSB Report on Developmental Test and Evaluation
UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203
DT&E Influences Acquisition
Pre-IOT&E:• AOTR showed high risk to IOT&E• Accurately predicted unfavorable results• Added time/expense to retest failures
LPD-17
5
P-8AMilestone C:• ITT engaged early and continuously• Risk of redesign carefully considered• Stable design and predictable performance • Low risk – Program entered LRIP on time
SDB II Milestone B:• Adequacy / affordability of the plan• Design of Experiments analysis• Risk at MS C (Knowledge points) drove agreement with PEO
Leve
l of
DT&
E E
ngag
emen
t C-5 RERP
UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203
DDT&E in DoD: What and When
Test Evaluation Strategy (TES)
Technology Development Strategy (TDS)
Identify emerging T&E capability requirements
Identify T&E resourcesDevelop T&E requirements in RFP
Support AoA technical analysis
Test and Evaluation Master Plan (TEMP)
Acquisition StrategySupport T&E Program Execution
Provide T&E results for OIPT/DAB Reviews
CDD requirements for testability and ability to evaluate
Support TRL EvaluationT&E requirements in RFP
Report of performance measures, metrics and evaluations
Update TEMPSupport T&E Program
ExecutionProvide T&E results for
OIPT/DAB ReviewsSupport PDR/CDR and
all technical reviews CPD requirements for
testability and ability to evaluate
Support TRL EvaluationT&E requirements in
RFPDiscovery and
deficienciesReport of performance
measures, metrics and evaluations
Update TEMPSupport T&E Program Execution
Characterize system capabilities and limitations
Provide T&E results for OIPT/DAB Reviews
AOTR / OTRRSupport training for IOT&E
Report of performance measures, metrics and evaluations
Update TEMP for Follow-on DT&E and OT&E
Verification of corrections for deficiencies
Develop T&E programs to support upgrades, modifications, and increments
Support T&E Program Execution
Report of performance measures, metrics and evaluations
TEMPTEMPTES TEMP
ICD CCD CPD
6
IOT&E
$1 invested here
UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203
DDT&E in DoD: What and When
TEMPTEMPTES TEMP
ICD CCD CPD
7
IOT&E
Saves $100 here $1 invested here
A few DDT&E observations:• Lack of DT&E expertise during program formulation• DT&E program planning and resourcing not adequate• System immaturity at MS C or at OTRR• Inadequate reliability growth programs
UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203
Training MRTFB Utilization by PMs
DAB
T&E Workforce
DAU T&E Curriculum
RTOsDDT&E
Environmental Scan
PlanningExecution
ResultsEnhance TEMPContent
T&E forTechnologiesEmerging
DT&E in Rapid Prototyping
DAES
DoE
AOTR
8
UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203
T&E Associations across the Enterprise
Warfighter
Test Infrastructure
Developmental Testing
Operational Testing
MaterielSolutionAnalysis
Production & Deployment
Operations & Support
Technology Development
Engineering and ManufacturingDevelopment
A B C
Need to Maximize Synergies Across Associations
9
UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203
DT&E Challenges/Initiatives
• Efficient, effective and fully Integrated T&E (CODB)• Reliability, Availability, and Maintainability• Information Assurance• Early and continuous engagement with PMs• Workforce skill mix• Increased use of M&S• Emerging technologies• Distributed testing
10
1943 SNJ-5 “Texan” Trainer
UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203
Back!
T&E Community Advocate!
DDT&E is . . . .
11
UNCLASSIFIEDDISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep 02 2010 – SR case number 10-S-3203 12
Questions?
The right information, to the right decision maker, at the right time, for better decisions
OFFICE OF THE SECRETARY OF DEFENSE
OFFICE OF THE UNDER SECRETARY OF DEFENSE FOR ACQUISITION,
TECHNOLOGY, AND LOGISTICS
DEVELOPMENTAL TEST & EVALUATION
3090 Defense PentagonRoom 3B941
Washington, DC 20301-3090
Email: [email protected]
www.acq.osd.mil/dte