1 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

TEM & NOSS

The EUROCONTROL Perspective

Alexander Skoniezki

Head of Business DivisionHuman Factors Management

EUROCONTROL Directorate ATM Strategies

2 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

TEM & NOSS in the international & EUROCONTROL context

The safety thinking behind the EUROCONTROL approach

NOSS trials in Europe

This presentation will describe

3 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

TEM & NOSS - an ICAO initiative

ICAO Safety & HF Circular on ‘TEM - Threat and Error

Management‘ - end of 2005

ICAO – TEM/NOSS Symposium on 9/10 November

EUROCONTROL IANS, Luxembourg

ICAO NOSS Concept document - end of 2005

ICAO NOSS Implementation Manual - end of 2006

based on NOSS trials

4 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

TEM & NOSS – the EUROCONTROL contribution

EUROCONTROL - member of ICAO NOSS SG contributing to:

TEM Circular, √

NOSS Concept Document √

Definition of the Operating Characteristics √

NOSS Implementation Manual (in preparation)

EUROCONTROL internal:

NOSS R&D project of the EATM Human Factors Domain to

further develop & validate the tool and verify its added value

NOSS as a potential SMS tool for ESAAR 3

5 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

NOSS as a potential tool for safety surveys

6 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

TEM & NOSS – the EUROCONTROL context

EUROCONTROL’s Safety Objective:

Further improve safety whilst accommodating air traffic

growth

Further implement safety regulations and strengthen their

enforcement

Further develop safety management and monitor safety

indicators

7 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

1014 15 16

25 25

36 37 38 40

47 49 50 50 50 5153 55 55 56 57 58 59

60 62 63 63

71 71 72 74 74 7577

91 91 94

ANSPs SMS implementation maturity scores

Around 20 ANSPs slightly above or below 50%

TEM & NOSS – the EUROCONTROL context

8 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

NOSS is a tool for the collection of safety data during normal ATC operations.

What’s the safety thinking behind NOSS

Progress in safety will increasingly rely on an understanding of what we are doing well and how this can help us improve.

Why is it needed?

NOSS, the potential benefits:• NOSS as a potential proactive safety management tool providing contemporary data to inform safety management systems• NOSS application allows the ability to learn and build on what we are doing well

9 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

Safe systems cannot rely on traditional methods of analysis If you think your system is truly safe it almost certainly is not The absence of incidents & accidents does not mean you are

safe Even the safest systems will inevitably drift to a less safe

state Technology and innovation constantly change the

interactions among components of the ATM system Safety system audit for normal operations may likely be a

requirement in Europe NOSS as a potential method to comply with ESARR 3

Safety drivers for NOSS approach at EUROCONTROL

10 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

NOSS is about the everyday operation

Normal people

Normal work

Normal environments

NOSS potentially provides additional valuableinformation that we need to improve safe systems

11 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

NOSS trials:

- require an interdisciplinary approach- require a ‘champion’ in the organisation- use observers who best understand the nature of the

operation and its demands = ATCOs with ... an in depth understanding of the views of the observed

persons in the operational context technical knowledge of practice in that setting knowledge of SMS and human factors relevant to such

contexts trained in NOSS observation and recording methods

NOSS trials; the philosophy and approach

12 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

NOSS trials in Europe – tools and conditions

Draft NOSS Manual for European trials Refinement of data cleaning & analysis method NOSS training module for educating NOSS

observers (ATCOs) NOSS recording forms to conduct observations NOSS trials build on experience of preceding trials 2-4 ANSPs volunteer for NOSS trials in ACC/APP,

TWR environment Stakeholder consultation, Agency expert

involvement (e.g. safety, regulation, etc.)

Prototype material based on collective experience in the NOSS SG

13 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

Title Description Q3 2005

Q4 2005

Q1 2006

Q2 2006

Q3 2006

Q4 2006

Kick of meetingProject definition and scheduling agreed

ICAO TEM/NOSS Symposium

Draft NOSS Manual and supporting data collection documentation

NOSS trails (TWR, ACC)

NOSS (ICAO) liaison

Prototype NOSS manual and supporting documentation

EUROCONTROL NOSS R&D Project -Timeline

14 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

Publish briefing paper for all personnel explaining NOSS plus letter of support from senior management

Training for 4-6 observers, provided by EUROCONTROL

1 or 2 observers per observation session 1-2 days data cleaning Feedback of results to ANSPs - data de-identified

Estimated effort for ANSPs in trials

15 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

Benefits and added value of NOSS for SMS NOSS applications in different operational settings Information on cross cultural aspects of NOSS Identification of environmental/contextual conditions that

contribute to threats, errors and undesired state in the absence of reportable occurrences

Identification of technical and non technical system performances that contribute to the successful management of threats, errors and undesired states

Some issues the trials will examine

16 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

Relationship between NOSS data and errors and system generated technical data

Do NOSS observers agree on the threats, errors and undesired states identified, how similar are their data?

Do observed persons agree with observers on the threats, errors and undesired states identified?

How best to report on and integrate NOSS data into SMS?

Do NOSS observations provide additional valuable data that are not already collected otherwise?

Some issues the trials will examine

17 First ICAO Global Symposium on TEM and NOSS First ICAO Global Symposium on TEM and NOSS Luxembourg 9 - 10 November 2005 Luxembourg 9 - 10 November 2005

EUROCONTROL supports ICAO’s NOSS developments by contributing to NOSS SG

EUROCONTROL uses ICAO TEM/NOSS results and guidance material for European NOSS trials

EUROCONTROL NOSS activities are fully aligned with international developments and complementary to ICAO

EUROCONTROL takes a careful approach on NOSS, considering European SMS maturity levels, cultural diversities and cost-benefit ratios

Closing remarks