Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Results from the Operational A-SMGCS Field Trials of the Project
Joern Jakobi – DLRChristoph Meier - DLR
Folie 2 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Content
1. Introduction A-SMGCS
2. Verification Results
3. Validation Results
4. Conclusions to BETA
Hamburg Tower
Folie 3 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
DEFAMM: (1996 - 1999)
ATOPS: (1999 - 2001)
BETA: (2000 - 2002)
Eurocontrol A-SMGCS Project (2002-2006)
EMMA: (2004 - 2008)
Chronology of major A-SMGCS Projects
European Commission, DG TREN
The 5th Framework Programme Competitive and Sustainable Growth
Folie 4 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
The four A-SMGCS main functionsbased on the ICAO A-SMGCS Manual (Doc 9830)
a) surveillance
b) control
c) routing
d) guidance
Source of following definitions: EANPG/46 – WP/22
Folie 5 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
a) surveillance, which provides controllers, pilots and vehicle drivers with situational awareness on the movement area (i.e. a surveillance display showing the position & identification of all aircraft and vehicles);
BETA – ATCO surveillance display
A-SMGCS function „Surveillance“
Folie 6 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
A-SMGCS function „Control“
b) control, providing conflict detection, alerting and resolution on runways (and later the whole movement area)
BETA – crossing lit stop bar alert
Folie 7 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
A-SMGCS function „Routing“
c) routing, through which the most efficient route is designated for each aircraft or vehicle
BETA – Electronic Flight Stripes (EFS) incl. route and time information
Folie 8 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
A-SMGCS function „Guidance“d) guidance, giving pilots and drivers indications enabling them to follow an
designated route
BETA – Onboard Guidance display
Folie 9 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Research Airport Braunschweig
Airport Praha Ruzyne
Hamburg Airport
BETA
All A-SMGCS functions were successfully implemented at three airports
Test Sites
Folie 10 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
BETA - System Architecture
GP&C(VDL4)
Surveillance Data Server
NRN
ARMI
Flight InfoFPL, SSR-Code
Data Base
Mode-SMultilateration
ASDE
ASR
TargetExtractor
Routing/Planning
Guidance
Data Link
Data LinkGP&C
(VDL4)
Control
Flight InfoProcessing
Ground Guidance
Means
Folie 11 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Two Cycle Approach
IterativeApproach
OperationalConcept
Review ofexisting
SMGCS &Concepts
Proof ofPrinciples(incl. Lab.
Tests)
EquipmentDevelop-ment &
Integration
Infra-structure
OperationalTrials
EvaluationagainstConcept
Folie 12 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
BETA Test Campaigns
Technical Field Trials at Research Airport Braunschweig
(Germany)
2x Pilot Cockpit Simulation & Training
2x ATCO Tower Simulation & Training
2x Operational Field Tests at Hamburg Airport (Germany)
2x Operational Field Tests at Airport Prague Ruzyne (Czech)
Folie 13 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Verification Results of BETA
Verification is an evaluation process by which a “product” is confronted with some references (Performance Requirements).
“Are we building the system right?” OCVM, 2004
Folie 14 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Functional Performance ParametersSurveillance Integrity Parameters for SDS•Reported Position Accuracy (RPA)•Reported Velocity Accuracy (RVA)•Target Report Update Rate (TRUR)•Target Report Latency (TRL)Surveillance Reliability Parameters for SDS•Probability of Detection (PD)•Probability of Identification of co-operative targets (PID)…(not tested sufficiently)
Alert Parameters…(verified)
Planning Parameters…(verified)
Guidance Performance Parameters:…(verified)
Folie 15 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Test Tools for Performance Measurements
Evaluated Segments
5548000
5548500
5549000
5549500
5550000
5550500
5551000
5551500
5552000
5552500
444000 444500 445000 445500 446000 446500 447000 447500 448000 448500 449000 449500 450000
AirportSegm. ASegm. BSegm. CSegm. DSegm. ESegm. FSegm. GSegm. HSegm. ISegm. JSegm. KSegm. LSegm. MSegm. N
Folie 16 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Functional Performance Results
Measured ValueSurveillance Integrity Parameters for SDS
ICAO Requirements
Prague Hamburg
Position Accuracy (RPA) ≤ 7.5 m 7,2 m 13 m
Velocity Accuracy (RVA) ≤ 5 m/s 1,4 m/s 3.5 m/s
Update Rate (TRUR) ≤ 1 s 1 s 1 s
Latency (TRL) unspecified 0.2 s 0.4 s
Folie 17 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Validation Results of BETA
H1:The use of BETA (A-SMGCS) will contribute quantitative and qualitative benefits to the current surface traffic management at the aerodrome.
“Are we building the right system?” OCVM, 2004
Folie 18 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Benefit Criteria and Indicators
BETA Benefits
Safety Efficiency Working Conditions
Environmental Impacts
•Situation Awareness•No. of Misunderstandings
•No. of Stops
•Duration of Stops
•No. of R/T com
•Duration R/T com
•Holding time at the
runway entry point
•Usability head down
•Fuel Burn while taxiing
•Workload
•Acceptance
•Overall Usability
Folie 19 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
BETA Operational Field Test Restrictions
Field trials suffered of safety restrictions that were imposed to each of the test runs:
Because of active control with a new uncertified system - test conditions were limited to low/medium traffic amount and good visibility conditions
Only one of three control positions replaced by BETA
Limited amount and duration of trials
Medium-size airports
Less equipped vehicles
Folie 20 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
6,4 6,6 6,6 6,4 6,2 6,7
-5-4-3-2-10123456789
10111213
CEC GEC TEC
BaselineBETA
Post
-Run
SA
RT
Scor
es
highest
lowest
Safety – “Situation Awareness”
ANOVA
BETA: F(1,5) = 0,09 p > .05
POSITION: F(1,5) = 0,01 p > .05
BETA x POS: F(1,5) = 0,37 p > .05
Folie 21 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Safety – “No. of Misunderstandings”
Promising safety indicator but could not be assessed because:
Would need well-trained observers with operational background
Would need a specific measurement tool that consist of a system of appropriate assessment categories (was not available)
Folie 22 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Efficiency – “Number and Duration of Stops”
Very hard to measure with field trials due to permanently changing traffic scenarios
Reliable mean values would have been caused by a sample size of movements of many months in order to be unaffected of different traffic scenarios
With low/medium traffic amount and medium-size airports - nearly no stops per aircraft
Folie 23 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Efficiency – “No. of R/T Communication”
7,7
6,1
9,310,3
8,7 9,3
0
2
4
6
8
10
12
CEC GEC TEC
BaselineBETA
No.
of R
/T p
er a
ircra
ft
CEC*: χ² (1) = 3,91 p < .05
GEC: χ² (1) = 2,30 p > .05
TEC: χ² (1) = 1,18 p > .05
Folie 24 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Efficiency – “Duration of R/T Communication”
33,8
38,4
29,6
35,4
26,731,1
0
10
20
30
40
CEC GEC TEC
BaselineBETA
Sec per a/c
CEC*: χ² (1) = 5,39 p < .05
GEC*: χ² (1) = 50,77 p < .05
TEC*: χ² (1) = 35,64 p < .05
Folie 25 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Efficiency – “Holding Time for each aircraft holding for line-up at the RWY entry point”
Current ATM Procedure do not cope with a Departure Manager service
Very less holdings at all at Prague
DMAN is rather needed at large-size airports (hubs)
Folie 26 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Efficiency – “Working head down only”
Controller were requested to work head down to simulate low visibility conditions to prove if the “surveillance” display is able to replace the outside view
Could not be proved with active control
ATM procedures did not allow
it is questionable to simulate LVC when the real world is not affected
Folie 27 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Working Condition – “Workload”
NA
SA T
LX w
orkl
oad
scor
es
high
low
ANOVA
BETA: F(1,5) = 2,61 p > .05
POSITION*: F(2,10) = 10,68 p < .05
BETA x POS: F(2,10) = 1,85 p > .05
24,330,7
36,9
53,2 53,846,8
0
20
40
60
80
100
120
CEC GEC TEC
BaselineBETA
Folie 28 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Working Conditions – “Usability of BETA System”
3,923,57
3,77
1
2
3
4
5
CEC GEC TEC
BETA
CEC*: t (5) = 3,69 p < .01
GEC*: t (5) = 4,03 p < .01
TEC*: t (5) = 7,50 p < .01
Usa
bilit
y Sc
ale
(SU
S)
high
low
Folie 29 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
High Acceptance of Runway Controllers
Coverage and Identification of RWY very well, TWY and Apron must be improved
Co-operative Sensors (e.g. MODE-S) are mandatory to get “identifaction”
Transponder Procedure needed
Manual Labelling should be severely avoided
Heading information is needed
Seamless surveillance from airspace to aerodrome surface traffic
BETA Conclusions
Surveillance Function
BETA Surveillance Display
Folie 30 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
High Acceptance for alerts for RWY incursion, designated protected areas, and crossing of lit stop bars
Two stages alerts were appreciated
Many nuisance alerts due to lacking surveillance
Alerting algorithm require further tuning (preferred in Simulation)
“Route deviation alerts” requirethat cleared routes are known
Handover of EFS accepted
BETA Conclusions
Control function
BETA Surveillance Display
Folie 31 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Most novel but also less matured function
Not yet accepted by Controllers
Standard Routes and DMAN were too inflexible yet
Current Procedures must be changed to cope with automatic routing / planning
BETA Conclusions
Routing / Planning
BETA Electronic Flight Strip Display
Folie 32 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
Airport Moving Map with ownship position and cleared route was highly accepted by Pilots
Ready for stepwise implementation
Can be displayed on the NAV display after touch down
Adequate and common data link is needed
Safety critical clearances by mixed mode (DL + R/T)
Guidance
BETA Conclusions
Folie 33 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
BETA Conclusions
Human Machine Interface
2 displays, one for surveillance information, one for EFS
A proper HMI is essential for all main A-SMGCS Functions
Silent Handover of EFS was accepted
Handling of EFS required too much effort
Proper interfaces to local Fight Plan Data
BETA Controller Working Position
Folie 34 > Results of Operational A-SMGCS Field Trials of the Project BETA > Joern Jakobi6th USA/EUROPE ATM 2005 R&D Seminar, Baltimore, June-27-30, 2005
More Information:
documents are public:documents are public: www.dlr.de/BETA
Successor ProjectSuccessor Project www.dlr.de/EMMA hashas
been launched in 2004been launched in 2004
BETA
Research Airport Braunschweig