© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
TRAINING TO
DEFEND
USHA SATISH
SIEGFRIED STREUFERT
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
ELEMENTS OF TERRORISM
FEAR
VIOLENCE
LOSS OF LIFE
LOSS OF PROPERTY
LOSS OF SERVICES
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
HOW DO WE COMBAT
TERRORISM?
REDUCE VULNERABILTY
HEIGHTENED SECURITY
ANTICIPATION
IDENTIFICATION
PREVENTION
ENHANCED ASSESSMENT
ENHANCED TRAINING
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
Terrorism: Dynamics
Characteristics
Fluid
Potentially changing
Requirements
Innovative assessment
Innovative training
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
Assessment and Training
Systems approach
Dynamic
Optimal under VUCAD
Volatility
Uncertainty
Complexity
Ambiguous
Delayed feedback
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
SMS SIMULATIONS:
Assessment and Training
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
What is the product - Concept
A (SimCity type) “test” given to an individual.
Or a “distributed test” given to a team.
Proven measures to evaluate performance on tests.
Qualitative and/or quantitative feedback to
emergency personnel.
Optional: Prescriptive remedies to improve
effectiveness of individual or team.
The tests measure the ability to use initiative , multitask, plan and
strategize. The test has been proven and validated for individuals
ranging from very senior executives to blue collar jobs to head injured
patients with impaired cognition.
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
How good is the product - Pedigree
Developed over 40 years
Over 350 peer reviewed articles in
prestigious journals
Used internationally
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
How good is the product -
Reliability and Validity
Reliability: Proven repeatability and
sensitivity of tests.
Validity: Proven predictability of tests.
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
Who has used the product with us
USAF ONR, ARI, USA Intelligence Community USDS Royal military college, Australia National Institutes of Health German Police Academy Computer Science Corporation Daimler Benz Schering-Plough Warner Lambert Philips Volkswagen
……etc….
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
The Product
Individual or
teamParticipates in computer
simulation with various
possible scenarios with
tasks that a potentially
complex and volatile, have
ambiguity and have
delayed feedback
1243792143286487324683274832648732448343
Yielding quantitative
measurements
Measured by
validated, reliable,
sensitive scoring
mechanisms
Use results to
improve
performance via
training or for
hiring decision
Providing results on over 20
parameters for “decision making”(Parameters include
responsiveness, initiative, emergency
responses, planning, strategy, etc.)
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
SMS: Security & Privacy Requirements:
Protect security and integrity of system
Ensure protection of information (test results) from unauthorized access and within regulatory compliance guidelines.
Underlying system chosen:
Secure Identity Appliance, from SingleSignOn.Net Inc.
Why chosen
Only system of its class to be awarded National Institute of Science and Technology FIPS – 140-1 Level 2 rating.
Provides high assurance (using technology called PKI) but is easy and simple to use (an important requirement for us).
Has been selected by significant customers (e.g. One Health Port (healthcare), Identrus (Banking consortium) and Northrop Grumman (part of bid for Federal eAuthentication project).
Summary:
SMS takes security and privacy seriously and protects itself using state of the art technology (which is still easy to use).
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
Advantages of SMS simulations Simulation based testing provides far more information than static
“questionnaire tests”
Is measuring:
critical thinking + crisis management + flexibility + use of factual knowledge + team interaction + activity level + response speed + task
orientation + contextual responsiveness + initiative + information seeking + information utilization + emergency responses + sustained
planning + use of strategy + response to immediate context + response to broader context + flexibility in thinking + breadth of approach
..all at once,
Using measures that have proven validity, sensitivity and reliability, 350 publications in recognized journals over 35 years.
The tests measure the ability to use initiative , multitask, plan and
strategize. The test has been proven and validated for individuals
ranging from very senior executives to blue collar jobs to head injured
patients with impaired cognition.
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
SMS SIMULATIONS
PROVIDE MULTIPLE COMPETENCY
MEASUREMENT
USED WORLD-WIDE TO ASSESS AND
TRAIN DECISION MAKERS
GENERIC APPLICABILITY TO MULTIPLE
SETTINGS
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
Training :Individual
Individual training in emergency preparedness
Tailored to individual/team requirements
Assessment of strengths and weaknesses
Training will emphasize both prevention and
defense
Especially useful for senior decision makers
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
Training :Teams
Tailored to team requirements
Assessment of strengths and weaknesses
Ability to pinpoint and train specific dynamics of
team interactions that are pivotal to emergency
preparedness
Select team composition for perfect teams
Enhance performance of existing teams
Training will emphasize both prevention and
defense
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
Core training concepts
Are all or most antecedents to a problem being
considered?
Are multiple options being considered toward
problem solving?
Are decisions timely?
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
Core training concepts
Is there integration of thought processes? Are
current events tied to prior antecedents?
Will responses to sudden unanticipated
emergencies be optimal?
Are people seeking and utilizing required
information in an adequate and timely fashion?
Are people able to anticipate and prevent
opponents intended actions?
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
SMS SIMULATIONS MEASUREMENT
GRAPHIC
PROFILE
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
MATRIX OF SUCCESSFUL
PERSON
WELL INTEGRATED
PRESENCE OF MULTIPLE STRATEGIES
INSIGHTS/ANTICIPATING OPPONENT’S
ACTIONS
PRESENCE OF INITIATIVE
PLANS IN GOOD PROPORTION
MULTIPLE DECISIONS
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
MATRIX OF UNSUCCESSFUL
PERFORMANCE
LOW STRATEGY LEVEL
LOW LEVELS OF INITIATIVE
LOW BREADTH OF APPROACH
FEWER PLANS THAT ARE REALIZED
POOR INSIGHT
POOR ANTICIPATION OF OPPONENT’S
ACTIONS
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
MATRIX OF MODERATE
PERFORMANCE
AVERAGE STRATEGY LEVEL
LOW TO MODERATE INITIATIVE
MODERATE BREADTH OF APPROACH
FEWER PLANS THAT ARE REALIZED
TENDENCY TO MERELY RESPOND
LITTLE INSIGHT/ANTICIPATION OF
OPPONENT’S ACTIONS
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
TIME EVENT MATRIX OF
PERSON UNDER STRESS
LEVEL OF
INTEGRATION, PLANNING, STRATE
GY BREAKS DOWN AFTER STRESS
WHILE PERFORMANCE UNDER
NORMAL CONDITIONS IS
AVERAGE, POST STRESS THERE IS
SIGNIFICANT BREAKDOWN IN
PERFORMANCE
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
MATRIX OF PLANNER
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
NORMATIVE PROFILE
MEAN UPPER 5%
MEAN UPPER 50%
MEAN LOWER 5%
MEAN LOWER 50%
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
Training workshop : 3 Days
Three hour assessment
Debrief
Extended training on specific parameters as
required
Repeat assessment
Follow up and continued retraining as
required
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
Improved Crisis Management
Placement issues
Individual placements
Team compositions
Help pick superior, most efficient team
compositions
Systems approach: Train teams with diverse
compositions to perform optimally
© Satish and Streufert, 2004
© SMS simulations, 1997, 2001, 2004
Effective coordination among individuals
Effective coordination among teams
Effective coordination among different
agencies
To anticipate and prevent and to resolve
problems generated by terrorist activities