Mr. Chris PaustCTEIP, Deputy Program Manager

Test Resource Management Center26 April 2012

T&E: Keeping Pace with a Fast-Changing World

International Test and Evaluation Association

Over the last decade, the nature of Warfare has changed drastically Asymmetric warfare/non-conventional systems Unmanned and Autonomous Systems Networked Systems of Systems Cyber warfare escalation

Test and Evaluation has been struggling to keep up

Test Resource Management Center Created to ensure DoD T&E doesn’t fall behind

2

A Changing World…

0

2,000,000

4,000,000

6,000,000

8,000,000

10,000,000

12,000,000

RDT&E (Non-MRTFB)DT&EOT&EOperationsCapability Investments

DoD Test: A $10B EnterpriseTypically 1-2% of total system acquisition cost

Source: FY12 BES R-3 and September 2010 MRTFB

5

Test Resource Management CenterOversight of the Enterprise

Oversight of MRTFBBiennial 10-YearStrategic Planning

AdministerT&E Investment Programs

•CTEIP•T&E/S&T•JMETC

Annual T&E Budget CertificationMilitary Departments& Defense Agencies

•DoD Field Activity •Direct Report to USD(AT&L)

SES Director4 Major Roles:

Legend: 24 sitesArmy (9), Navy (6), AF (7), Defense Agency (2)

Steward of the DoD Test Infrastructure Major Range and Test Facility Base (MRTFB)

Keyport

NAWC-WD China Lake

30th Space Wing

NAWC-WD Point Mugu

Air Force Flight Test Center

Yuma Test Center

Nevada Test and Training Range

Utah Test and Training Range

West Desert Test Center

White Sands Test Center

High Energy Laser Systems Test Facility

Electronic Proving Ground

PMRF

U.S Army Kwajalein AtollReagan Test Site

DISA,JITC 46th Test Wing (Includes 46th

Test Group)

Atlantic Undersea Test and Evaluation Center

45th Space Wing

Arnold Engineering Development Center

NAWC-AD Patuxent River

Aberdeen Test Center

DISA,NCR

Cold Regions Test Center

Tropic Regions Test Center, HI & Puerto Rico

6

18,000 sq. mi. of land180,000 sq. mi. of air space( > ½ of all DoD land)

30,000 personnelMilitary, Gov, Contractor

Replacement Value = $25B

7

Risk mitigation needsTechnology shortfalls

Risk mitigation solutions Advanced development

Capabilities

Service Modernization and

Improvement Programs

Acquisition Programs and Advanced Concept

Technology Demonstrations

T&E Multi-Service/Agency

Capabilities

DoD Corporate Distributed

Test Capability

TRMC Joint

Investment Programs

Transition

Requirements

DoD T&EStrategic Plan*

Service T&E Needs and

Solutions Process

Annual T&E Budget

Certification*

Quadrennial Defense ReviewStrategic Planning Guidance

(6.3 Funding) (6.5 Funding)(6.4 Funding)

Department of DefenseTest Investment Strategy

7

Mission: Develop Technologies Required to Test Future Warfighting Capabilities

Established in FY02 Joint DDR&E / DOT&E Initiative Transitioned to TRMC in FY05

6.3 RDT&E Funds Purpose

High Risk / High Payoff R&D for Testing Foster technology transition to major DoD test ranges Risk reduction for test capabilities developments

80 ActiveProjects

Annual Broad Agency Announcements (BAAs) Academia Industry Government Laboratories

Tri-Service working groups Validate requirements Evaluate proposals Facilitate technology transition

Central Oversight – Distributed Execution

High SpeedSystems

13 Active Projects

Eight Test Technology Areas

Directed Energy17 Active Projects

Cyberspace2 Active Projects

Net-Centric Systems7 Active Projects

Electronic Warfare16 Active Projects

Unmanned & Autonomous Systems

3 Active Projects

AdvancedInstrumentation8 Active Projects

Shaping Technology into Tomorrow’s T&E Capabilities

T&E/Science &Technology Program

Spectrum Efficiency

14 Active Projects

Resource Enhancement Project

(REP)

Joint Improvement& Modernization

(JIM)Threat Systems Project

(TSP)

• 3-5 year requirement horizon• EMD of Major Test Capabilities• Must address joint requirements• Services & Agencies budget for

O&M over Life-Cycle of delivered capabilities

• 1-2 year requirement horizon• EMD of target capabilities• Address shortfalls in threat

systems representation• Coordinated with DOT&E

• 1-2 year requirement horizon• EMD of instrumentation

needed to address an emergent requirements

• Must address OT shortfalls• Coordinated with DOT&E

T&E Master Plans (TEMP) References Submarine Launched Countermeasure Emulator CBASS torpedo effectiveness testing against enemy

countermeasure threatsMILSATCOM Atmospheric Scintillation Simulator AEHF survivability and effectiveness testing in realistic

atmospheric environmentsGround Mounted Seeker Simulation Advanced open-air SAM simulator to support IDECM Block IV

effectiveness testing

Initiated DEPSECDEF – 9 November 1988 Established in FY91 by Congress 6.4 RDT&E funds Purpose

Have multi-Service utility Be developmental Be non-procurement

Mission: Develop or Improve Major Test Capabilities that have Multi-Service Utility

47 ActiveProjects

9

Central T&E Investment Program

3 Project Portfolios

Joint Mission Environment Test Capability Program

Ft Huachuca: (4) JITC, JTDL, CMIS, JTRS

Charleston (2):IPC, MEF-MEU

Ft Hood (2): CTSF, TTEC

WPAFB: SIMAF

As of 05 Apr 20120

20

40

60

80

FY06 FY07 FY08 FY09 FY10 FY11

JMETC Site Expansion

Sites

Dedicated, trusted connectivity on SDREN (part of the GIG) Encrypted for Secret – System High DISA-registered IP address space Active monitoring of network performance Capable of supporting multiple simultaneous test events

Bethpage: NGC BAMS

Functional Sites: 67New Sites Planned: 10Connection Points to Other Networks: 7

Ft. Greely: CRTC

MHPCCPMRF: Bldg 105

Pax River:(8)ESTEL E2C/D, MCL,

ACETEF, SAIL, ATR,E-2C SIL, UASIL, MFS

JMETC SYSCONEast Agg Rtr.

Aberdeen: ACCN

Langley (2): C-GIIF, TDLITC

JS J8 DDC4: C4AD

Wallops Island: (2) SCSC, SSDS

Dahlgren (2): CEDL,IWSL

Dam Neck: CDSA

Newport News: NGC VASCIC

Norfolk: COMOPTEVFOR

McLean: MITRE NCEL

Bethpage: NGC BCN

Eglin AFB (5):AOC, DTF, GWEF, KHILS, JDAT

Hurlburt Field: C2DAC

Camp Pendleton:MCTSSA

China Lake (3):F/A-18, IBAR,TSPIL

Edwards (2):

Corona: NSWC

Point Loma :SSC-PAC 59140 SSC-PAC HAIPE

Point Mugu (2):ITEC, EA-6B

West Agg Rtr.Rancho Bernardo, NGC BAMS

412th EWG IFASTRidley

Palmdale, NGC BAMS

Redstone (10): SMDCRTC: DTCC, GMANSED: Patriot, THAAD, FAAD, GSIL, JLENS, MUSE, SIV(2) SED-PSEM, AMRDEC

LMCO Global Vision Network, Arlington, VA

Moorestown: CSEDS

Crane: NWSC RDT&E

ArmyAir ForceNavyMarines

JointIndustryAcademia

GTRI

Sites in Hawaii

Site in Alaska

11

The T&E community is in constant battle…• Technology is moving at lightning speed.• Formal Acquisition does not.• Innovations and asymmetrical threats drive us

to be “reactive” to urgent needs.• Warfighters need us to be “proactive”

“Technology Push” vs.“Acquisition Pull”

0

5

10

15

20

25

30

Total DoD S&T Industry-IT R&D Industry-Electronics R&D

2011 Research Investments ($B)

Microsoft – $9B

IBM – $6B

Google – $3B

Motorola – $3B

Cisco – $5B

Intel –$6B

Investors in Tomorrow’s Technology

Rest of Top 10

Rest of Top 10

12

Trends in Software Complexity

13

Trends in Devices & Adoption

14

Trends in Devices & Adoption

15

Your cell phone in 2012 is…

1,000 x more powerful 100,000 x smaller 1,000,000 x cheaper

than 1 MIT computer in 1965

Trends in Power, Size & Cost

16

17

Why is this relevant to us?…

OTH

ER R

AN

GES

Mobile AdaptiveMesh NetworksMobile AdaptiveMesh Networks

OTH

ER R

AN

GES

CEC

C2 CONTROL NETC2 CONTROL NET

Unmanned SystemNetworks

Unmanned SystemNetworks

A Very Complex Test Environment

Range ControlFacility

Range ControlFacility

JointTaskForce

Joint Task Force

TAC NET

C4I ProvidersC4I Providers

Bidirectional Secure Range NetworkBidirectional Secure Range Network

SPEC

TRU

M, L

AN

D, S

EA A

ND

AIR

RES

OU

RC

ESSP

ECTR

UM

, LA

ND

, SEA

AN

D A

IR R

ESO

UR

CES

These technologies are being integrated into weapon systems Ours……and theirs!

These same technologies need to be matured and integrated into our test capabilities

Critical to ensure S&T technologies have solid transition partners CTEIP and Service T&E Investments

19

Ensuring Technology Transition

Spectrum EfficienciesAdvanced aeronautical telemetry at Open Air Test Ranges

Cyberspace & Network Centric SystemsTechnologies and capabilities to emulate, visualize, and assess our abilities to defend cyberspace

Testing in Urban EnvironmentsA robust, realistic environment to test electromagnetic effects, mission effectiveness, and interoperability of systems under test

Safe Test of Large Footprint WeaponsReconfigurable, modular, low power design suitable for high dynamic environments

Accurate TSPI (Time Space Positioning Information)Precision tracking capability for high-dynamic aircraft

Infrared Countermeasure TestingCapability to present IRCM system-under-test with a realistic representation of an incoming missile

20

T&E Investments for the Future

T&E/S&T Technology Areas Directed Energy Test

Net Centric Systems Test

Non-Intrusive Instrumentation

Spectral Efficient Technology

Cyber Space Test Technologies

Electronic Warfare Test

Unmanned Autonomous Systems Test

Advanced Instrumentation Systems Test

Key Investments & Successes•Broadband Telemetry Antenna (L/S/C Bands)

•Linear Power Amplifier (50% efficiency increase)

•Adaptive Orthogonal Frequency Division Multiplexing (AOFDM) Low Cost OFDM Telemetry Transceiver

•Network management tools

•Spectrum “hopping” radio to access unused portions of spectrum

S&T Investments for the Future

21

Spectrum Efficient Testing

Program ExampleTest Capability Driver

Challenge

100,000

10,000

1,000

100

10

Bit

Rat

e (K

bps)

1970 1975 1980 1985 1990 1995 2000 2005 2010

F-14

F-15E

A-10

B-1

F-16

F-18

B-52

B-2

SM I

YF-22YF-23

F-22

JDAM

SRAM II

F-18 E/F

E-2D

VH-71

ESSM

F-35 2v4

AIM-9XSM 6

NASA CEV

F-22 1v2

OBRA 93BBA 97

Future ThreatsDAB, PCS,

300

275

250

225

200Sp

ectr

um (M

Hz)

Historic

Spectrum and Data Rates Trends

• Develop a Range Telemetry capability that: Provides more efficient/effective ways to

use available spectrum. Reduces test and re-test time by fixing

data drop-outs. Enables selective data acquisition during

tests.

• Integrated Network Enhanced Telemetry (iNET) Block 1 ProjectEnhances current 1-way Serial

Streaming Telemetry (SST) systems with a 2-way network capability.Leverages Service and TRMC

initiatives to develop C-band telemetryLeverages T&E/S&T projects

addressing: 1) dynamic frequency assignments, 2) multi-path mitigation, and 3) forward error correction.

Goal• Test iNET Block 1 capability at Edwards Air

Force Base and Patuxent River Naval Air Station by FY13.

• Completed Preliminary Design Review.• Completed prototype hardware performance

testing at the Southwest Research Institute (SwRI) System Integration Laboratory.

Program Status

Net-Centric Warfare Testing Net Enabled Weapons Testing

• Spiral 2 Development Complete JITC accredited for Joint Interoperability Certification test use

• Spiral 3 (Release 1) System Acceptance Testing Completed in November 2010

CND Scenario that linked IO Range and JMETC networks for the first timeJITC interim accreditation for NR-KPP Certification test use

Full (Spiral 3) Operational Capability in 2013

• Joint service test & training exercises are increasing in frequency and complexity

• Testing of Net Enabled Weapons• Interoperability testing of systems of

systems.• Distributed Live, Virtual and Constructive

Testing

• Interoperability Test and Evaluation Capability (InterTEC)

Construct, control, instrument, capture joint C4ISR data Stimulate and analyze an operationally relevant distributed test environment Perform post-event analysis Support interoperability certification

Program Example

Development Status-SuccessesChallenge

Drivers

• Resolve battle space interoperability problems before networked systems are brought to war

Urban Environment Testing

Challenge

Program Example

Goal

Drivers

• Joint Urban Test Capability (JUTC) Project FY2010 New StartAddresses Critical Capability Gap in DoD

Strategic Plan for T&E Resources Leverage results of Urban Environment

Test Capability StudyLeverage S&T investments in advanced

instrumentation

• Develop test capabilities that measure both the effects of Urban Environment (UE) on systems under test (SUT) and SUT interactions in UE Technical performance Operational effectiveness Suitability and survivability

• Develop robust, realistic, technically relevant, urban test environment:Accurate physical, electro-magnetic and population effects Test-Quality Instrumentation and Data Collection

Development Status

• Completed Test Capability Requirements Document (TCRD)• Expected to enter EMD in FY12

Safe Testing of Large Footprint Weapons

Challenge

Program Example

Goals

Drivers

• Longer range (large footprint) of new missiles necessitates the use of flight termination systems for flight safety.

• Limited unused space inside modern missiles requires flight termination systems to be subminiature in size (11 to 16 inch3).

• Subminiature Flight Safety System (SFSS) Leverages completed CTEIP projects:

Joint Advanced Missile Instrumentation (JAMI) provides GPS-based TSPI and real time post flight data processing.Enhanced Flight Termination System

(EFTS) provides new digital and encrypted flight termination link.

• More realistic operational test of long range weapons- eliminate range safety constraints.

• Reconfigurable, modular, low power design suitable for high dynamic environments.

• Completed PDR• IOC expected in FY14

Development Status-Successes

Accurate Time Space Position Information (TSPI)

Challenge

DriversProgram Example

Goal

• Common Range Integrated Instrumentation System (CRIIS) - First real-time, high-precision (sub-meter) TSPI range system.

• Replace ARDS starting in 2014:Fielded for 25 years on 10 MRTFB ranges,

training venues, foreign military end-usersVariants: P5 Combat Training System, others

Development Status- Successes• Successful prototype flight demonstrations • Completed PDR, on-track to CDR

Provide precise “Ground Truth” TSPI for high accuracy future Systems Under Test (SUT)

CRIISGPS ARDS

Infra-Red Countermeasure (IRCM) Test Capability Portfolio

Challenge

Drivers Program Examples

Development Status -SuccessesPresent IRCM system-under-test with a realistic representation of an incoming missile

Not feasible to fire missiles at manned aircraft to test IRCM system effectiveness

• Ground Based Missile SimulatorsJMITS - Joint Mobile IRCM Test System MSALTS- Multi-Spectral Sea and Land

Target Simulator• Airborne Threat Missile Simulator

TAPS - Towed Airborne Plume Simulator• Installed System Environments

JDIGS - Joint Distributed IRCM Ground Test System Missile Signal Processors in the Loop

• Advanced IR Missiles• Advanced IRCM Systems

Ground Based (JMITS)

Missile Simulators

Airborne (TAPS)

• TAPS Flight Testing CompletedIOC in 2010, accredited for use in LAIRCM

NexGen Operational Testing• Completed MSALTS CDR

IOC in 2013• Completed JDIGS Risk Reduction Demonstrations

Verified acceptable end-to-end (distributed test) data throughput and latencyIOC in 2013

• IRCM Test Resource Requirements Study UpdateAddressing urgent HFI testing needs

Closing Thoughts

Technology is moving at a blinding pace…. Most of it will come from industry and will be rapidly

acquired, adapted, and fielded to meet operational needs…. It will certainly push our test resources beyond their

current limits

To ensure the Department’s T&E infrastructure keeps pace We must grow existing capabilities We must invest in new technologies

And ensure we have well-defined/supported transition partners

We can’t do it alone! We must partner with Academia, Industry, and other

stakeholders to meet these challenges28