+ All Categories
Home > Documents > EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental...

EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental...

Date post: 07-Sep-2019
Category:
Upload: others
View: 3 times
Download: 0 times
Share this document with a friend
78
EUROPEAN ORGANISATION FOR THE SAFETY OF AIR NAVIGATION EUROCONTROL EXPERIMENTAL CENTRE OBJECTIVE EVALUATION OF PHYSIOLOGICAL BEHAVIOUR AND WORKLOAD OF CONTROLLERS EEC Report No. 339 Project HUM-7-E2 Issued: August 1999 The information contained in this document is the property of the EUROCONTROL Agency and no part should be reproduced in any form without the Agency’s permission. The views expressed herein do not necessarily reflect the official views or policy of the Agency. EUROCONTROL
Transcript
Page 1: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

EUROPEAN ORGANISATIONFOR THE SAFETY OF AIR NAVIGATION

EUROCONTROL EXPERIMENTAL CENTRE

OBJECTIVE EVALUATION OF PHYSIOLOGICALBEHAVIOUR AND WORKLOAD

OF CONTROLLERS

EEC Report No. 339

Project HUM-7-E2

Issued: August 1999

The information contained in this document is the property of the EUROCONTROL Agency and no part should bereproduced in any form without the Agency’s permission.

The views expressed herein do not necessarily reflect the official views or policy of the Agency.

EUROCONTROL

Page 2: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload
Page 3: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

REPORT DOCUMENTATION PAGE

Reference:EEC Report No. 339

Security Classification:Unclassified

Originator:EEC - IND

(INDependent Research)

Originator (Corporate Author) Name/Location:EUROCONTROL Experimental CentreBP1591222 Brétigny-sur-Orge CEDEXFRANCETelephone : +33(0) 1 69 88 75 00

Sponsor: Sponsor (Contract Authority) Name/Location:EUROCONTROL AgencyRue de la Fusée, 96B -1130 BRUXELLESTelephone : +32 (0)2 729 90 11

TITLE:OBJECTIVE EVALUATION OF PHYSIOLOGICAL BEHAVIOUR AND WORKLOAD

OF CONTROLLERS

Authors

P. Cabon, B. Farbos, S. Bourgeois-Bougrine,

R. Mollard,LAA, Université RenéDescartes - Paris V

Date

08/99Pages

xii + 64Figures

24Tables

3Annexes

1References

11

EATCHIP TaskSpecification

-

Project

HUM-7-E2

Task No. Sponsor Period

1999

Distribution Statement:(a) Controlled by: Head of IND(b) Special Limitations: None(c) Copy to NTIS: YES

Descriptors (keywords):ATC, RT Simulation, learning, fatigue, sleepiness, stress, workload, EEG, ERP, Sleep, Salivary Cortisol.

Abstract:

The MILAN 99 real-time Simulation, carried out at The EUROCONTROL Experimental Centre (EEC) inJanuary/February 1999 was concerned with the reorganisation of the Milan Terminal Management Area(TMA), in view of the opening of the new Malpenza Airport. Sleep logs, workload assessment and fatigueevaluation questionnaires were employed, with Event Related Potential for mental fatigue assessmentand salivary cortisol for workload and stress assessment on selected working positions.

Psychophysiological observations suggested that time of day and day within the week significantlyaffected fatigue and workload measures, so that subjective measures taken on, for example, Mondaymorning and the last day of the simulation may be distorted. Controllers’ experience in the specificworking positions should also be taken into account. Observations also suggested that adaptationcontinues well into the measured phase of such a simulation, and should be controlled or balanced injudging the conclusions.

Page 4: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

This document has been collated by mechanical means. Should there be missing pages, please report to:

EUROCONTROL Experimental CentrePublications Office

B.P. 1591222 - BRETIGNY-SUR-ORGE CEDEX

France

Page 5: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

v

SUMMARY

OBJECTIVE EVALUATION OF PHYSIOLOGICAL BEHAVIOUR AND WORKLOAD

OF CONTROLLERS

By

P. Cabon, B. Farbos, S. Bourgeois-Bougrine, R. Mollard,LAA, Université René Descartes - Paris V

The MILAN 99 real-time Simulation, carried out at The EUROCONTROL ExperimentalCentre (EEC) in January/February 1999, was concerned with the reorganisation of the MilanTerminal Management Area (TMA), in view of the opening of the new Malpenza Airport. EEChas carried out studies of psychophysiological methods in small-scale simulation, and ofcontrollers’ adaptation to altered interfaces in real-time Simulation (SweDen 98). In MILAN99 these methods were applied to an organisational simulation.

Sleep logs, workload assessment and fatigue evaluation questionnaires were employed, withEvent Related Potential for mental fatigue assessment and salivary cortisol for workload andstress assessment on selected working positions.

Psychophysiological observations suggested that time of day and day within the weeksignificantly affected fatigue and workload measures, so that subjective measures taken on,for example, Monday morning and the last day of the simulation may be distorted.Controllers’ ‘real-life’ experience in the specific working positions affects their responsesmeasurably, and should also be taken into account. Observations also suggested thatadaptation continues well into the measured phase of even an organisational simulation, andshould be controlled or balanced in judging the conclusions.

It is clear that psycho-physiological measures, chosen to fit the aims of an operationalsimulation, can contribute significantly to the assessment of alternative organisations, bothdirectly, and indirectly by warning of extraneous fatigue and learning effects, which maydistort subjective conclusions.

Page 6: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

vi

Intentionally Left Blank

Page 7: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

vii

TABLE OF CONTENTS

ABBREVIATIONS.............................................................................................................................................IX

FOREWORD.......................................................................................................................................................XI

ACKNOWLEDGEMENTS.............................................................................................................................. XII

1 - INTRODUCTION AND OBJECTIVES - ................................................................................................. 1

2 - METHOD - .................................................................................................................................................. 3

2.1 - SAMPLE -..................................................................................................................................................... 32.2 - PROCEDURE AND PROTOCOL - ..................................................................................................................... 62.3 - DATA COLLECTED - ..................................................................................................................................... 72.4 - SUBJECTIVE MEASURES - ............................................................................................................................. 7

2.4.1 - Sleep -................................................................................................................................................. 72.4.2 - Workload -.......................................................................................................................................... 82.4.3 - Fatigue - ............................................................................................................................................. 8

2.5 - OBJECTIVE MEASURES -............................................................................................................................... 92.5.1 - Stress -................................................................................................................................................ 92.5.2 - Mental fatigue through the Event Related Potential (ERP) - ............................................................ 9

2.6 - OTHER DATA - ........................................................................................................................................... 142.7 - DATA COLLECTION SCHEDULE -................................................................................................................ 14

3 - RESULTS -................................................................................................................................................. 17

3.1 - SLEEP QUANTITY AND QUALITY - ............................................................................................................... 173.2 - TRAFFIC VOLUME EFFECT - ........................................................................................................................ 20

3.2.1 - Perceived workload - ....................................................................................................................... 203.2.2 - Fatigue - ........................................................................................................................................... 203.2.3 - Objective evaluation of mental fatigue by the ERP -....................................................................... 213.2.4 - Stress -.............................................................................................................................................. 243.2.5 - Controllers orders to pilots - ........................................................................................................... 24

3.3 - ORGANISATION EFFECT - ........................................................................................................................... 273.3.1 - Perceived Workload -....................................................................................................................... 273.3.2 - Self-rating of fatigue -...................................................................................................................... 273.3.3 - Objective evaluation of mental fatigue by the ERP’S - ................................................................... 313.3.4 - Stress -.............................................................................................................................................. 313.3.5 - Controllers orders to pilots - ........................................................................................................... 32

3.4 - EFFECTS OF EXPERIENCE ON THE POSITION - .............................................................................................. 363.4.1 - Fatigue - ........................................................................................................................................... 363.4.2 - Perceived workload - ....................................................................................................................... 363.4.3 - Stress -.............................................................................................................................................. 363.4.4 - Controllers orders to pilots - ........................................................................................................... 383.4.5 Approach versus En-route sectors ..................................................................................................... 38

4 - DISCUSSION - .......................................................................................................................................... 45

5 - CONCLUSION - PROSPECTS -............................................................................................................. 51

6 - REFERENCES - ........................................................................................................................................ 53

Page 8: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

viii

TRADUCTION EN LANGUE FRANÇAISE................................................................................................... 55

SOMMAIRE........................................................................................................................................................ 55

AVANT-PROPOS - ............................................................................................................................................ 56

INTRODUCTION - OBJECTIFS -................................................................................................................... 57

CONCLUSIONS - RECOMMANDATIONS -................................................................................................. 58

A N N E X ............................................................................................................................................................ 59

Page 9: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

ix

ABBREVIATIONS

ANOVA ANALYSIS OF VARIANCE

ATC AIR TRAFFIC CONTROL

AU ARBITRARY UNIT

EEC EUROCONTROL EXPERIMENTAL CENTRE

EEG ELECTRO-ENCEPHALOGRAM

EOG ELECTRO-OCULOGRAM

EUROCONTROL EUROPEAN ORGANISATION FOR THE SAFETY OF AIR NAVIGATION

IANS INSTITUTE OF AIR NAVIGATION SERVICES

ISA INSTANTANEOUS STRESS ASSESSMENT

NASA NATIONAL AVIATION AND SPACE AGENCY

NASA-TLX NASA TASK LOAD INDEX

RT Simulation REAL-TIME SIMULATION

SA SALIVARY CORTISOL

TMA TERMINAL MANOEUVRING AREA

TRACON TERMINAL RADAR APPROACH CONTROL (SIMULATOR)

UACC MAASTRICHT UPPER AIRSPACE CONTROL CENTRE

Page 10: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

x

Intentionally Left Blank

Page 11: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

xi

FOREWORD

One of the main purposes of the establishment of Independent Research Fellows at theEurocontrol Experimental Centre is the search for and introduction of advanced methodsfor research in Air traffic control.

The need for more ‘objective’ measures of the effects of Air Traffic Control on controllershas long been apparent, and various studies have been undertaken at EEC on potentialmethods of measuring these effects (EEC Reports 64, 164, 183, 219, 226, 228, 323 and334).

The Laboratoire d’Anthropologie Appliquée of the Université de Paris V (Université RenéDescartes), under the direction of Professor Alex Coblentz, has carried out a series ofstudies of fatigue, sleep disorders and associated strain among airline pilots (Cabon etasl 1996), car drivers (Cointot et al, 1997) and Air Traffic controllers (Mollard et al, 1996)among others.

In accordance with our policy of maintaining awareness of developments, we becameaware that the development of EEG studies (in particular the technique of CorticalEvoked Potential) and of salivary cortisol analysis were potentially useful measures.

We therefore commissioned the Laboratoire d’Anthropologie Appliquée, as a leadingpractitioner of these techniques, to undertake a feasibility study of the use of thesetechniques at the EEC. This study was reported in EEC Report No. 323, and a furtherstudy was reported in EEC Note No. 16/98.

Selected methods were then transferred to a real-time simulation (Sweden-Denmark) asreported in EEC Report No. 334. This simulation involved the evaluation of an unfamiliarhuman-computer interface.

The real-time simulation MILAN 99 concerned the evaluation of changes in sectorisationin the Milan TMA, using a close approximation to the existing system. The opportunitywas taken to apply psychophysiological methods in an ‘organisational’ as opposed to a‘research’ simulation. This report describes the application of these methods.

On behalf of the Director EEC, the experimenters of the Laboratoire d’AnthropologieAppliquée and ourselves, the Project Officers wish to thank the controllers and the EECstaff involved in the running of the MILAN 99 simulation, who co-operated so actively inthis research.

Francoise CalooHugh David

EEC Project Officers

Page 12: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

xii

ACKNOWLEDGEMENTS

The LAA would like to express their gratitude to the Eurocontrol team in charge

of the real time simulation, especially to Yann KERMARQUER, Adrian GIZDAVU and

Peter SLINGERLAND.

These evaluations could not have been undertaken without the active

cooperation of Italian Controllers involved in this study. The help of Pietro PAGLIA was

greatly appreciated.

Finally, the authors would like to thank the EEC project officers

Françoise CALOO and Hugh DAVID for their practical help in the organisation of this

study.

* * * *

Page 13: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

A N T H R O P O L O G I E A P P L I Q U E E

45, rue des Saints-Pères 75270 PARIS Cedex 06Téléphone : 01 42 86 20 37- 01 42 86 20 41 -Télécopie : 01 42 61 53 80

E.mail : [email protected]

OBJECTIVE EVALUATION OF PHYSIOLOGICAL BEHAVIOUR

AND WORKLOAD OF CONTROLLERS

* * * *

REAL-TIME SIMULATION MILAN 99

* * * *

Doc AA 398/99 MARCH 1999

Page 14: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload
Page 15: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

1

1 - INTRODUCTION AND OBJECTIVES -

This document reports the results of the objective evaluations of the

psychophysiological state of Controllers during the Real-Time simulation Milan 99,

conducted at Eurocontrol Experimental Centre (EEC). The data were collected with the

aim in view to support some operational choices in terms of sectorisation and

organisation of the Milan Traffic Management Area (TMA) in the context of the opening

of the new Malpenza airport. After the Sweden-Denmark simulation, Milan 99 is the

second opportunity of a transposition into a real-time simulation of physiological

measures which were validated into previous basic works conducted on simple

simulation1 using the TRACON Pro software (Cabon et al, 1997, 1999 ; David et al,

1998 ; Farbos et al, 1998, 1999). However while the purpose of the Sweden-Denmark

was to evaluate the impact of a new interface2 (Cabon et al, 1998), the objectives of

the present simulation deal with the comparison of various airspace organisations in

their ability to cope with the increasing volume of traffic foreseen in this area.

Therefore, the method used was adapted to the specific objectives of this simulation.

Three main aspects were assessed into this simulation regarding the different

organisations tested :

- fatigue,

- workload,

- stress.

Considering the future implementation of a new airspace organisation, these

three topics appear to be particularly relevant from an operational point of view as they

can impair performance and safety. Therefore, they add some validity to the

operational choices made along this Real-Time Simulation (RTS).

1 EEC report Nb 323 and EEC note 16/98.2 EEC report Nb 334.

Page 16: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

2

Intentionally Left Blank

Page 17: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

3

2 - METHOD -

2.1 - Sample -

The sample involved 19 Italian Controllers male and female aged from 26 to 46

years. The whole sample can be divided into three sub-groups : En-Route Radar

Controllers (n = 7), Approach Radar Controllers (n = 6) and En-Route Planner

Controllers (n = 6). The table 1 gives the main characteristics of these 3 sub-groups

regarding age, gender and experience. A statistical analysis on these factors revealed

that female Controllers have significantly less experience on the position (9.6 months)

than males (40.7 months, p<.05) and that females were significantly younger (28.6

years) than males (35.2 years, p<.05).

ATC Age Gender

n = 6 < 30 years n = 4 Females n = 2 Males

n = 9 > 30 and < 40 n = 1 Female n = 8 Males

n = 4 > 40 n = 4 Males

Total = 19

ATC Qualification Experience of controllers on the

position (in months)

7 En Route Radar 38

6 Approach Sector 40

6 En Route Planner 10

Total = 19

Table 1.

Description of the sample

Page 18: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

4

WEEK 1 Start Stop ORG /EXERCICES

TRAFFICCODE

Start Stop ORG /EXERCICES

TRAFFICCODE

Programmed RealisedMON.25 JAN 0900 1015 General briefing 0900 1015 General briefing

1030 1200 Org.A/ex.A: 1T99A 1100 1215 Org.A/ex.A: 1T99A1315 1445 Org.A/ex.B: 2T99A 1330 1445 Org.A/ex.B: 2T99A1500 1630 Org.A/ex.C: 3T99A 1515 1630 Org.A/ex.C: 3T99A1645 1730 Debriefing 1615 1730 Debriefing

TUE.26 JAN 0900 1030 Org.B/ex.A: 1T99B 0915 1030 Org.B./ex.A: 1T99B+1045 1215 Org.B./ex.B: 2T99B 1100 1215 Org.B./ex.B: 2T99B+1330 1500 Org.B/ex.C: 3T99B 1330 1445 Org.B./ex.C: 3T99B+1515 1600 Debriefing 1500 1630 Debriefing

WED.27 JAN 0900 1030 Org.C/ex.A: 1T99C 1030 1145 Org.C/ex.A: 1T99C+1100 1230 Org.C/ex.B: 2T99C 1300 1415 Org.C/ex.B: 2T99C+1345 1515 Org.C/ex.C: 3T99C 1430 1545 Org.C/ex.C: 3T99C+1545 1700 Debriefing 1600 1645 Debriefing

THU.28 JAN 0900 1030 Org.D/ex.A: 1T99D 0915 1030 Org.A/ex.A: 1T99A+1100 1230 Org.D/ex.B: 2T99D 1130 1245 Org.A/ex.B: 2T99A+1345 1515 Org.D/ex.C: 3T99D 1430 1545 Org.A/ex.C: 3T99A+1545 1700 Debriefing 1600 1700 Debriefing

FRI.29 JAN 0845 1015 ex.A: spare1045 1215 General dbfng week 1

Program week 21000 1200 General dbfng week 1

Program week 21330 1630 Visit LFPG/PO approach 1300 1630 Visit LFPG/PO approach

Table 2.1. Description of organisations performed during the first week.

WEEK 2 Start Stop ORG /EXERCICES

TRAFFICCODE

Start Stop ORG /EXERCICES

TRAFFICCODE

Programmed RealisedMON.1 FEB 0900 1015 Valid. synthesis week 1 1000 1030 Presentation physio.data

1030 1200 Org.A/ex.A: 1T02A 1030 1145 Org.A/ex.A: 1T02A1315 1445 Org.A/ex.B: 2T02A 1330 1445 Org.A/ex.B: 2T02A1500 1630 Org.A/ex.C: 3T02A 1445 1600 Org.A/ex.C: 3T02A1645 1730 Debriefing 1615 1645 Debriefing

TUE.2 FEB 0900 1030 Org.B/ex.A: 1T02B 1045 1200 Org.B./ex.A: 1T02B1100 1230 Org.B./ex.B: 2T02B 1315 1430 Org.B./ex.B: 2T02B1345 1515 Org.B/ex.C: 3T02B 1500 1615 Org.B./ex.C: 3T02B1545 1700 Debriefing 1630 1700 Debriefing

WED.3 FEB 0900 1030 Org.C/ex.A: 1T02C 0900 1000 Briefing1100 1230 Org.C/ex.B: 2T02C 1000 1115 Org.C/ex.A: 1T02C1345 1515 Org.C/ex.C: 3T02C 1200 1315 Org.C/ex.B: 2T02C1545 1700 Debriefing 1415 1530 Org.C/ex.C: 3T02C

1600 1645 Debriefing

THU.4 FEB 0900 1030 Org.E/ex.A: 1T02E 0900 0945 Briefing1100 1230 Org.E/ex.B: 2T02E 0945 1100 Org.E/ex.A: 1T02E1500 1630 Org.E/ex.C: 3T02E 1115 1230 Org.E/ex.B: 2T02E1645 1730 Debriefing 1430 1545 Org.E/ex.C: 3T02E

1615 1700 Debriefing

FRI.5 FEB 0845 1015 Org.?/ex.A: spare 0945 1100 Org.E/ex.A: 1T02E1045 1215 General dbfng week 2 1115 1200 Dbfng / Program week 31330 1630 Visit Paris ACC 1330 1630 Visit Paris ACC

Table 2.2. Description of organisations performed during the second week.

Page 19: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

5

WEEK 3 Start Stop ORG /EXERCICES

TRAFFICCODE

Start Stop ORG /EXERCICES

TRAFFICCODE

Programmed RealisedMON.8 FEB 0900 1015 Valid.synthesis week 2 0900 1015 Debriefing physiolo. data

1030 1200 Org.E/ex.A: 3T05E 1030 1145 Org.E/ex.A: 3T05E1515 1445 Org.E/ex.B: 1T05E 1300 1415 Org.E/ex.B: 1T05E1500 1630 Org.E/ex.C: 2T05E 1430 1545 Org.E/ex.C: 2T05E1645 1730 Debriefing Debriefing

TUE.9 FEB 0900 1030 Org.E2/ex.A: 3T05E 2 0900 1100 Filling questionnaires1100 1230 Org.E2/ex.B: 1T05E 2 1115 1230 Org.F/ex.A: 3T05E1345 1515 Org.E2/ex.C: 2T05E 2 1345 1500 Org.E/ex.B: 1T05E1545 1700 Debriefing 1515 1630 Org.E/ex.C: 2T05E

1630 1700 Debriefing

WED.10 FEB 0900 1030 Org.E3/ex.A: 3T05E 3 0915 1030 Org.E/ex.A: 3T05E1100 1230 Org.E3/ex.B: 1T05E 3 1100 1215 Org.F/ex.B: 1T05E1345 1515 Org.E3/ex.C: 2T05E 3 1200 1400 Social lunch1545 1700 Debriefing 1415 1530 Org.F/ex.C: 2T05E

1545 1630 Debriefing

THU.11 FEB 0845 1015 Org.E4/ex.A: 2T05E 4 0945 1100 Org.FW/ex.A 1T05E+wind

1045 1215 Org.E4/ex.B: 1T05E 4 1145 1300 Org.EW/ex.B 1T05E+wind

1230 1300 Debriefing 1345 1445 Filling questionnaires1400 1530 Visit of IFPU (or else) 1545 1630 Visit of IFPU

FRI.12 FEB 1000 1200 General debriefing 1015 1230 General debriefing

Table 2.3. Description of organisations performed during the third week.

Page 20: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

6

2.2 - Procedure and protocol -

This simulation took place at EEC at Brétigny from the 25th January to the 12th

February 1999. Each week, the following traffic levels were successively simulated :

- week 1 : traffic level observed in Milan airspace in 1999 (T99),

- week 2 : traffic level foreseen for the year 20021 (T02),

- week 3 : traffic level foreseen for the year 20051, (T05).

Initially, it was planned to evaluate four organisations during this RTS (one per

day). However, based on the evaluations performed in the first week it was decided

that if some differences would already appeared between the four organisations at

least one organisation could be rejected. The foreseen and actual program of the

simulation are presented in the table 2.

During the first week (T99) due to a technical problem, the organisation A of the

first day was not considered as realistic regarding to the traffic volume. Therefore it was

decided to adjust the traffic volume and to replay it on the day 4 in place of the

organisation D.

The second week (T02), on the basis of the previous exercises and of the

preliminary data processing, a new organisation (E) has been designed by the

Controllers and the EEC team. As this new organisation was expected to be better than

D, it was decided to replace D by E. At the end of the week 2 it was confirmed that the

organisation E was the one to keep and it was decided to reject organisation A, B and

C.

The third week (T05) the basic organisation E was played the Monday. From

Tuesday, organisation E and a new organisation F were played alternatively.

Organisation F was another variant of organisation B in which different procedures

were applied.

1 Brussels data base.

Page 21: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

7

Therefore the data analysis presented in this report aims to investigate

the following comparisons regarding the workload, the stress and the fatigue of

Controllers :

- comparison of the organisations A, B and C during the first week (T99),

- comparison of these organisations with the organisation E during the second

week (T02),

- comparison of the different versions of the organisation E end F simulated during

the third week (T05).

2.3 - Data collected -

Three kinds of data were collected during the real time simulation :

- subjective measures : sleep log, workload assessment and fatigue evaluation,

- objective measures : Event Related Potential (mental fatigue assessment) and

salivary cortisol (workload and stress assessment).

The interest and the relevance of these subjective and objective measures had

already been demonstrated in the previous studies (Cabon et al, 1997, 1998) and

during the Sweden-Denmark RTS (Cabon et al, 1998 ; Farbos et al, 1999).

2.4 - Subjective measures -

2.4.1 - Sleep -

Sleep quantity and quality were assessed from one week before the RTS to the

4 days following the simulation covering the three weeks of the simulation. This

evaluation was done using a daily sleep log (cf Annex). Each day, the Controllers were

asked to fill out the sleep log, by indicating their bedtime, rising time and awakening

periods during sleep and to evaluate their fatigue and sleepiness before and after their

sleep.

Page 22: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

8

2.4.2 - Workload -

Workload was assessed by the NASA-Task Load Index (TLX) which includes six

dimensions that the controllers rated on visual analogue scales : mental demand,

physical demand, effort, temporal demand, self-assessment of performance and

frustration level. For each of these scales a score was obtained. A global workload

score is also derived from the comparison of each pair of scales (cf Annex). A further

scale regarding the task difficulty was added. During all the days of the RTS, the

NASA-TLX was filled at the end of each session by all the controllers working (en-

route, approach and feed sectors).

2.4.3 - Fatigue -

2.4.3.1 - Visual analogue scales of fatigue and sleepiness (cf Annex ) -

In order to provide some information about the effect of the simulation on fatigue,

each controller rated his fatigue and sleepiness before and after each simulation.

These evaluations were done through two visual analogue scales by marking a cross

on a 100 mm horizontal line separating two opposite adjectives : tired-fresh (fatigue

scale) and sleepy-alert (sleepiness scale). A score was obtained by measuring the

distance between the cross and the positive adjective (fresh-alert) the minimum (0)

corresponding to fresh and alert, the maximum (100) to tired and sleepy.

2.4.3.2 - Manifestations of fatigue (cf Annex) -

In addition to the visual analogue scales of fatigue and sleepiness, a set of four

groups of symptoms related to fatigue was presented : mental, sensorial, physical and

mood manifestations. For each one of these groups, controllers rated their feelings

from None to Very much, before and after each simulation. For each symptom, a score

ranging from 0 (None) to 4 (Very much) is derived.

Page 23: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

9

2.5 - Objective measures -

2.5.1 - Stress -

Numerous studies have shown that the endocrine system of the corticosteroids

is a sensitive marker of workload and stress (Zeier et al, 1996 ; Fibiger et al, 1986).

The use of an unfamiliar device or the modification of the work environment can

produce stress, especially in the early stages. The stress may be caused by an

increase of the workload level related to the inexperience of the operator with the

situation or an unfamiliar increase of traffic level.

Moreover, cortisol level is known to be affected by two main factors :

a circadian factor (time of the day) and stress. During a normal sleep-wake rhythm, and

in absence of any stress factors, cortisol is only produced during the night with a peak

in the early morning. Its production decreases during the day with a minimum in the

afternoon. However, when a stress factor is occurring, its level tends to increase, even

during the daytime period.

2.5.2 - Mental fatigue through the Event Related Potential (ERP) -

The ERP is an objective and accurate method of evaluation of the physiological

state of an operator, especially of its ability to process an information. The ERP is

based on the following procedure. About 150 tones are auditory presented to the

controllers by means of a headphone. They are required to detect and to mentally

count high frequency tones (1500 Hz) and to ignore low frequency tones (1000 Hz).

The distribution of high and low tones are respectively 1/3 (about 50) and 2/3 (about

100). The data processing consists in computing the average wave of the 1-second

epoch of EEG which follows the expected tones. The mean wave allows to distinguish

two kinds of potentials : the early or exogenous components and the late or

endogenous components (figure 1). Exogenous components are directly related to the

stimulus. They are dependent on the physical features of the stimulus (e.g. pitch,

duration, intensity,…) as well as on the state of the human operator. They are rather

fixed in latency and amplitude and for healthy subjects they always appear as a

response to the stimulation.

Page 24: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

10

On the contrary, endogenous stimulus may be induced by the stimulus or even in

the absence of a stimulus. They are related to psychological process and, as such,

depend on task demands and the instructions given to the subject. The ERP the most

studied is the P300, i.e. the positive wave occurring about 300 ms after the stimulation.

The amplitude of this wave reflects the cognitive attentional demands to task-relevant

stimuli. Numerous studies have demonstrated that a P300 is elicited only if the subject

actively processes or attends to a stimuli. On the contrary, the P300 is not elicited if the

stimulus is ignored (Duncan-Johnson and Donchin, 1977). Because of these

characteristics, the P300 has been frequently used in laboratory as an index of

workload for a particular task. In this case, the ERP is collected in a dual task

procedure, i.e. the subjects are required to detect the tone simultaneously to his main

task. From a theoretical point of view, this procedure refers to the resource theory of

workload (Navon and Gopher, 1979) based on the assumption that the performance

decrement in a dual-task can be attributed to the decrease of one or more of a set of

finite resources. Thus, if two tasks are completed concurrently, one of the tasks will

require a majority of the resources, leaving an insufficient supply for the performance of

the other task. Increases in the cognitive difficulty of the primary task result in a

decrease in the amplitude of the P300.

The ERP procedure was used during the preliminary study on TRACON

to assess the effect of different traffic level on mental fatigue (Cabon et al, 1997 ; David

et al, 1998) (figure 2).

Page 25: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

11

III

IIIIV V

VI

No

Po

Na

Pa

Nb

P1

N1

P2

N2

P3

- 5 µ V

+ 5 µ V

StimulusOnset

10 100 1000

Brain stem

Endogenous componentsor Event Related Potential

Mid-latency

Time (ms)

Long-latency

Exogenous components

Figure 1.The auditory exogenous (solid line) and endogenous (dotted line)components in response to a "click" (adapted from Landolt, 1987).

Page 26: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

12

-0.3

-0.2

-0.1

0.0

0.1

0.2

0.3

0.4

-100 0 100 200 300 400 500 600 700 800 900 1000

Time (ms)

before during after

P300

FEASIBILITY STUDY ON TRACON (1997)

Event Related Potential (ERP) - low traffic control session -

-0.3

-0.2

-0.1

0.0

0.1

0.2

0.3

0.4

0.5

-100 0 100 200 300 400 500 600 700 800 900 1000

Time (ms)

before during after

P300

FEASIBILITY STUDY ON TRACON (1997)

Event Related Potential (ERP) - high traffic control session -

Figure 2.

Event Related Potential before, during and after a low and

a high traffic control session (EEC report Nb 323).

Page 27: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

13

Photo 1. Electrodes location on an Approach Controller for the recording of the Event Related Potentials

Photo 2. Numeric polygraph and microcomputer for the recording and processing of the Event Related Potentials

Page 28: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

14

For the recording of the ERP, 3 derivations were used : FzP3, CzP3 and PzP3

according to 10-20 standard (Jasper, 1958) (figure 3 and photo 1). The P3 electrode

was used as a reference and the P4 electrode as the ground.

The EEG recording was carried out using a numeric 20-channel polygraph

(Discovery, Vickers Medical). For ERP as well as for subsequent processing, a

microcomputer (Apple Macintosh) was used in connection with the polygraph (photo 2).

The data processing was conducted using some specific applications developed with

LabView by LAA.

2.6 - Other data -

In addition, the number of Controllers orders to pilots were provided by EEC. It is

expected that the number of Controllers orders will be reduced for the best airspace

organisations.

2.7 - Data Collection Schedule -

The subjective measures were collected on the whole sample during the three

weeks.

The objective measures were collected on sub-groups (figure 4). The ERP

recordings involved one approach controller per organisation. Each of these controllers

was assigned to the same sectors and position. In total, 5 EEG recordings were

performed per organisation. The schedule of the data collection is presented (in figure

4).

Salivary cortisol was collected for all approach sectors and one en-route sector

(REN) for the three weeks. During the last week two other en-route sectors (RWS and

RWN) were included.

Page 29: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

15

Fz

Cz

Pz G

Fz-P3

Cz-P3

Pz-P3

P3

Figure 3.Electrodes locations for ERP

Fz, Cz, and Pz electrodes are used for ERP recordingP3 was the referenceG = ground electrode

Page 30: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

16

Exercise Exercise Exercise

- Self evaluation of fatigue - Self evaluation of fatigue - Self evaluation of fatigue - Salivary sample - Salivary sample - Salivary sample

(only REN and RWS position) - Self evaluation of fatigue - Self evaluation of fatigue - NASA-TLX - NASA-TLX - Self evaluation of fatigue - Salivary sample - Salivary sample - NASA-TLX

- Salivary sample - Auditory Evoked Potential (only REN and RWS position)

Four approach ATC All approach controllers En-route and Feed position controllers

Figure 4.Description of data collected before and after each simulation.

The duration of each simulation was about 1 hour 15.

Page 31: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

17

3 - RESULTS -

The results were analysed as a function of the following factors :

- traffic levels (T99, T02 and T05),

- organisations (A, B, C and the different versions of E),

- individual factors.

The results were also analysed regarding the sectors. As no significant

difference was found between the sectors the results are not reported for each

individual sectors. The lack of statistical results does not mean that there is no effects

but is probably related to the low number of data for each sector. However, a

comparison of the data between approach and en-route sectors shows some

interesting trends which are presented in a separate section.

3.1 - Sleep quantity and quality -

The figure 5 shows the evolution of averaged time to fall asleep and sleep

duration from the week preceding the simulation, the weeks of the simulation, the days-

off and the 3 days following the RTS. During the RTS, the mean sleep duration is lower

than 400 minutes (i.e. 06 hours 30) instead of 450 minutes (i.e.7 hours 30) during the

days-off or while the Controllers are at home. The sleep latency is very high (about 20

minutes) during the first week and then tends to decrease during the subsequent

periods. From these results, it is very clear that the presence of the Controllers in Paris

has affected their sleep duration with a reduction of around 1 hour compared to their

usual sleep time. The sleep reduction observed during the work periods is also

associated with a reduction of sleep quality (figure 6) with an increase of sleepiness

and fatigue at raisetime compared to the day-off periods. However, sleepiness and

fatigue at raisetime and sleep latency are the highest during the first week (T99) and

tend to decrease during the second and third week. Therefore, these results indicate

that Controllers were progressively adjusted to the hours of work from the first to the

last days of their stay in Paris.

Page 32: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

18

These data have obviously some impact on their diurnal alertness and

consequently on the evaluations performed during the RTS. Subjective evaluations of

fatigue and workload are generally amplified when sleep debts are cumulated over

more than one week.

Page 33: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

19

Figure 5.Evolution of sleep time and latency before, during

and after the simulation (n = 19).

0

10

20

30

40

50

60

70

80

1 weekbefore thesimulation

Days off Days off 3 daysafter the

simulation

Fat

igu

e (A

.U.)

Fatigue at bedtime Fatigue at raisetime

-

+

Figure 6.Evolution of fatigue and sleepiness at bedtime and raisetime before,

during and after the simulation (n = 19).

A.U. : Arbitrary Units.

300

350

400

450

500

1 weekbefore thesimulation

Days off Days off 3 daysafter the

simulation

leep

tim

e (m

n)

0

5

10

15

20

25

leep

late

ncy

(m

n)

Sleep time (mn) Sleep latency (mn)

**

*

* : Statistical significant difference at .05 compared to other periods

- : fresh ; + : tired.

Week 1 Week 2 Week 3

Week 2Week 1 Week 3

Page 34: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

20

3.2 - Traffic volume effect -

3.2.1 - Perceived workload -

The mean self-assessment of workload during the three weeks remained,

generally, at a low level, lower than 50 (figure 7). In the same time, the level of

performance is assessed at a high level, around 75 (for a maximum of 100) during the

three weeks. All the scales of the NASA-TLX show an increase with the traffic except

the frustration level and the self-assessment of performance. Statistically, the

differences are significant between the traffic T99 and T02, T99 and T05 but not

between T02 and T05. This suggests that the Controllers were sensitive to the

increase of traffic from T99 to T02 but not from T02 to T05. However, this increase of

traffic was not sufficient to make them perceive a decrease in their performance. From

this results it seems that the increasing traffic did not reach the capacity limit of the

Controllers. In other terms, they increase their effort to maintain the same level of

performance but the effort remains at an acceptable level.

3.2.2 - Fatigue -

In order to analyse the effect of the simulation on fatigue, the difference between

the values observed after the session and before the session were computed.

Therefore, an increase of the score means an increase of fatigue after the session

compared to before the session. The figure 8 shows a slight decrease of fatigue from

the first to the third week. This result could be explained by two factors. The first is

related to the fact that Controllers are more and more familiar with the context of the

simulation and to the schedule of the simulation which is quite different from their usual

hours of work. The second deals with the changes in the organisations from the first to

the third week. In the third week, the organisations (E) tested were based on the choice

of the controllers as well as on the data previously collected. Therefore, the reduction

of fatigue can be related to the fact that they were involved in the design of this

organisation.

Page 35: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

21

3.2.3 - Objective evaluation of mental fatigue by the ERP -

As already mentioned, these results were obtained on three Approach sectors

per day and do not concern the En-Route sectors.

Page 36: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

22

20

30

40

50

60

70

80

T99 T02 T05

Traffic level

A.U

.

-

+*

20

30

40

50

60

70

80

T99 T02 T05

Traffic level

A.U

.

-

+*

20

30

40

50

60

70

80

T99 T02 T05

Traffic level

A.U

.

-

+ *

20

30

40

50

60

70

80

T99 T02 T05

Traffic level

A.U

.

-

+

20

30

40

50

60

70

80

T99 T02 T05

Traffic level

A.U

.

-

+*

20

30

40

50

60

70

80

T99 T02 T05

Traffic level

$�8�

-

+

Mental Demand Physical Demand

Temporal Demand Performance

Effort Frustration Level

A.U. : Arbitrary Units.

Figure 7.Self-rating of Workload (NASA-TLX) as a

function of traffic volume (n = 19).

- : low ; + : high. * : Statistical significant difference at .05.

Page 37: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

23

5

6

7

8

9

10

T99 T02 T05

Traffic level

Mea

n d

iffe

ren

ce a

fter

-bef

ore

the

sess

ion

s o

f fa

tig

ue

(A.U

.)

A.U. : Arbitrary Units.

Figure 9.Mean difference of P300 amplitude after-before the sessions as a

function of traffic volume (n = 4).

-0,2

-0,15

-0,1

-0,05

0

0,05

0,1

0,15

0,2

T99 T02 T05

Traffic level

Mea

n d

iffe

ren

ce a

fter

-bef

ore

th

ese

ssio

ns

of

P30

0 am

plit

ud

e (µ

V)

-

+F

atig

ue

Figure 8.Mean difference of self evaluation of fatigue after-before the sessions as

a function of traffic volume (n = 19).

Page 38: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

24

The figure 9 depicts the evolution of the mean difference between the P300

amplitude after the session and before the session. An increase of the negative values

constitutes an objective index of mental fatigue. The results obtained on the sub

sample of 4 Approach Controllers, show a decrease of mental fatigue as a function of

the traffic volume and are consistent with the subjective evaluations collected on the

whole sample of Controllers.

3.2.4 - Stress -

As for the ERP, the stress level of Controllers is assessed by computing the

difference between the excretion of cortisol after and before the sessions (figure 10).

All the differences are negative because the cortisol level show a diurnal variation with

a decrease along the day. A reduction of the decrease, however, is usually related to a

stress. The figure 10 show that the results of cortisol are consistent with those of the

perceived workload (cf. figure 7). The difference between after and before tends to

decrease from T99 to T05. Therefore these results even if they are not significant show

that the increase of traffic increased the level of stress of controllers.

3.2.5 - Controllers orders to pilots -

The orders provided by the Controllers to the pilot provides information about

some aspects of the performance of the Controllers during the simulation. The figure

11 shows the results of the total number of orders by week divided by the number of

aircraft, i.e. the frequency of orders per aircraft. It can be observed a decrease of this

frequency from T99 to T05 simulations. This decrease can be explained by two main

factors. The first deals with a learning process. As the situation of a RTS is not strictly

as the reality, most Controllers have stated that they « learned » the simulation

regarding the procedures, the aircraft behaviours,... The second explanation lies on the

improvement of the different airspace organisations which were tested in the third

week. These two factors will be further discussed in the general discussion of results.

Page 39: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

25

-1

-0,9

-0,8

-0,7

-0,6

-0,5

-0,4

-0,3

-0,2

-0,1

0

T99 T02 T05

Traffic levelM

ean

dif

fere

nce

aft

er-b

efo

re t

he

sess

ion

s o

f co

rtis

ol s

ecre

tio

n (

ng

/ml)

Figure 10.Mean difference after-before the sessions

of salivary cortisol secretion as a function of traffic volume (n = 8).

Page 40: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

26

1

1,1

1,2

1,3

1,4

1,5

1,6

1,7

1,8

1,9

2

T99 T02 T05

Traffic level

Nu

mb

er o

f co

ntr

olle

rs o

rder

s / N

um

ber

of

airc

raft

Figure 11.Number of controllers orders divided by the number of aircraft

as a function of traffic volume (n = 15).

Page 41: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

27

3.3 - Organisation effect -

3.3.1 - Perceived Workload -

The results of perceived workload are presented on the figure 12 for the three

weeks. During the first week, the organisation A+ leads to the highest scores of

workload and the organisation B to the lowest. During the second week, the

organisation E showed the lowest scores of workload while the highest are observed

for the B. In the third week, the workload remains at a moderate level in E and F. The

organisation FW (windy condition) increased the perceived workload of Controllers

regarding mental, physical and temporal demands. The mental demand shows the

highest values, around 60. The self assessment of performance slightly decreased

during the organisation FW compared to the other organisations. On the contrary, the

windy condition associated with the organisation E (EW) leads to a moderate level of

workload and a higher self assessment of performance than the FW. This suggests

that the organisation E allowed the Controllers to cope with this condition.

3.3.2 - Self-rating of fatigue -

The figure 13 shows the data collected before and after the sessions. The

results are presented as a function of the day of week (from Monday to Thursday)

expect for the week 3 as various organisations were played everyday during this week

(cf table 2.3). For the three weeks, the self-rating of fatigue appears to be influenced by

the day of week with a level reaching a maximum the Monday and decreasing during

the other days. This is related to the effect of the week-end which changes the sleep-

wake patterns with a delay in the sleep schedules. On Monday morning these changes

lead to an increase of fatigue which can persist along the day. Some effects of the

organisations can be observed when the differences between after and before values

are computed (figure 14). During the first week the organisation B leads to the lowest

level of fatigue and A (on Monday) to the highest level. The organisation C showed the

lowest levels in the second week. In the third week, the lowest difference is observed

for FW and EW.

Page 42: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

28

This could be related to the fact that these 2 organisations were played in the

very last day of the RTS. On the contrary, the same day, the organisation F leads to a

significant increase of fatigue. Therefore this suggests that the amended procedures

allow to reduce the level of fatigue.

Page 43: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

29

20304050607080

A B C A+

Organisation

A.U

.

-

+

20304050607080

A B C A+

Organisation

A.U

.

-

+

Week 1

A.U. : Arbitrary Units.

Figure 12.Self-evaluation of Workload (NASA-TLX)

as a function of the organisations for the 3 levels of traffic (n = 19).

- : low ; + : high.

Mental Demand

Physical Demand

Temporal Demand

PerformanceEffortFrustration Level

20304050607080

A B C E

Organisation

.U.

-

+

20304050607080

A B C E

Organisation

A.U

.

-

+

Week 2

20304050607080

E F FW EW

Organisation

A.U

.

-

+

20304050607080

E F FW EW

Organisation

.U.

-

+

Week 3

Page 44: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

30

NB : Various organisations were played everyday during the third week (cf. table 2.3)

0102030405060

A B C A+Organisation

A.U

.

-

+ **

*

-202468

101214

A B C A+Organisation

Mea

n d

iffe

ren

ce o

fse

lf e

valu

atio

n o

ffa

tig

ue

(A.U

.)

Week 1 (T99)

0102030405060

A B C E

Organisation

A.U

.

-

+* * *

-202468

101214

A B C E

Organisation

Mea

n d

iffe

ren

ce o

fse

lf e

valu

atio

n o

fat

igu

e (A

.U.)

Week 2 (T02)

0102030405060

E F FW EWOrganisation

A.U

.

-

+ * *

-202468

101214

E F FW EW

OrganisationM

ean

dif

fere

nce

of

self

eva

luat

ion

of

fati

gu

e (A

.U.)

Week 3 (T05)

Week 1 (T99)

Week 2 (T02)

Week 3 (T05)

Figure 13.Mean values of self evaluation of fatigue

before and after the sessions as a functionof the organisations for the 3 levels of traffic (n = 19).

- : fresh ; + : tired.

Figure 14.Mean difference of self evaluation of fatigue

after-before the sessions as a functionof the organisations for the 3 levels of traffic (n = 19).

Before After * : Statistical significant difference at .05.

Page 45: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

31

3.3.3 - Objective evaluation of mental fatigue by the ERP’S -

During the first week, Controllers showed the most important level of mental

fatigue after the organisation A+ and the lowest level after the organisation B

(figure 15). The results of the second week are consistent with those of the first week

as fatigue was prominent for the organisations A and C and the less important after the

organisations B and E. Therefore these data seems to support the choice of the

organisation B and E. The third week, the results confirm those of the NASA-TLX with

the highest mental fatigue observed for the organisation FW and the lowest levels for

the organisation E. However it is not possible to compare these results with the

organisation EW as the data cannot be processed for technical reasons. Thus, these

results suggest that the windy condition leads to a greater effort compared to the

normal conditions and that the E and F lead to the minimum of fatigue. Moreover,

compared to subjective evaluations of fatigue, these results show that Controllers have

underestimated their level of fatigue in the windy condition (cf. figure 14).

3.3.4 - Stress -

The results concerning the first week (figure 16) show that the highest increase

of salivary cortisol is observed for the organisation C. During the second week the

lowest variation is noted for the organisation E, supporting the previous results of

workload and fatigue. The data of the last week are also consistent with the other data.

The highest level of stress is observed after the organisation FW (windy condition) and

the lowest levels of stress are noted for the organisation E as for the ERP values.

Page 46: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

32

3.3.5 - Controllers orders to pilots -

The frequency of Controllers orders per aircraft is presented for each

organisation on figure 17. A decrease of this parameter can be observed from the first

to the last week. However, during the two first weeks, the frequency shows a peak for

the organisation C and organisation B. In the third week, the organisation E was

associated with a lower frequency than during the organisation E of the previous week.

The lowest value is associated with the organisation EW and the highest is observed

for the organisation FW. It is interesting to notice that the windy condition had more

impact on the organisation F than on the organisation E. Taken as a whole the level

reached during this week is the lowest level of all the organisations throughout the 3

weeks. These results suggest an improvement of performance due to the organisation

or to a learning process phenomena.

Page 47: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

33

No dataavailable

Week 3 (T05)

-0,2-0,15

-0,1-0,05

00,050,1

0,150,2

A B C A+Organisation

Mea

n d

iffe

ren

ce o

f P

300

amp

litu

de

(µV

) +F

atigu

e

Week 1 (T99)

Week 2 (T02)

Figure 15.Mean difference of P300 amplitude after-before the sessions

as a function of the organisations for the 3 levels of traffic (n = 4).

-0,2-0,15

-0,1-0,05

00,050,1

0,150,2

A B C EOrganisation

Mea

n d

iffe

ren

ce o

f P

300

amp

litu

de

(µV

) +

Fatig

ue

-0,2-0,15

-0,1-0,05

00,050,1

0,150,2

E F FW EWOrganisation

Mea

n d

iffe

ren

ce o

f P

300

amp

litu

de

(µV

) +

Fatig

ue

Page 48: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

34

No dataavailable

-4-3-2-101234

A B C A+Organisation

Mea

n d

iffe

ren

ce o

f sa

livar

y co

rtis

ol (

ng

/ml) *

Week 3 (T05)

Figure 16.Mean difference of salivary cortisol secretion

after-before values as a function of the organisations for the 3 levels of traffic (n = 8).

-4-3-2-101234

A B C EOrganisation

Mea

n d

iffe

ren

ce o

f sa

livar

y co

rtis

ol (

ng

/ml)

-4-3-2-101234

E F FW EWOrganisation

Mea

n d

iffe

ren

ce o

f sa

livar

y co

rtis

ol (

ng

/ml)

* : Statistical significant difference at .05.

*

Page 49: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

35

1,4

1,5

1,6

1,7

1,8

1,9

2

A C B E E FW

Organisation

Nu

mb

er o

f co

ntr

olle

rs o

rder

s / N

um

ber

of

airc

raft

T99 T02 T05

Figure 17.Number of controllers orders divided by the number of aircraftas a function of organisations for the 3 levels of traffic (n = 19).

A

B A+ A C F EW

Page 50: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

36

3.4 - Effects of experience on the position -

As a significant difference was observed for the experience on the position as a

function of age and of genders (see § 2.1) the data were analysed only as a function of

the experience of Controllers. Therefore, the sample was divided into 2 sub-groups :

Controllers having an experience lower than 20 months and Controllers having an

experience higher than 20 months. The effect of this factor are presented for fatigue,

perceived workload and stress.

3.4.1 - Fatigue -

No effect of experience was observed on the level of fatigue.

3.4.2 - Perceived workload -

All the scales of the NASA-TLX except the frustration level show a significant

effect of the experience (figure 18) : the less experienced Controllers perceived less

workload than experienced Controllers.

3.4.3 - Stress -

Effect of experience on stress is opposite to the perceived workload (figure 19) :

the high experienced Controllers showed less increase of secretion of salivary cortisol

than low experienced Controllers. Therefore, a dissociation between the perception of

Controllers and their objective reaction to the simulation in terms of stress can be

noticed. This dissociation is an important point as it means that less experienced

Controllers probably underestimate their workload. On the contrary, experienced

Controllers have probably a good appraisal of their own level of workload as the level is

lower than 50 for all the scales of NASA-TLX.

Page 51: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

37

PhysicalDemand

Performance FrustrationLevel

0

20

40

60

80

100

MentalDemand Temporal

DemandEffort

A.U

.< 20 months of experience

≥ 20 months of experience

-

+

** *

*

*

-1

-0,8

-0,6

-0,4

-0,2

0

0,2

0,4

0,6

0,8

1

< 20 months of experience ≥ 20 months of experience

Mea

n d

iffe

ren

ce a

fter

-bef

ore

th

e se

ssio

ns

of

cort

isol

sec

reti

on

(ng/

l)

*

A.U. : Arbitrary Units,- : low ; + : high.

Figure 18.Effects of the experience of the position

on perceived workload (NASA-TLX) - n = 19.

Figure 19.Effects of the experience of the position on difference of salivary cortisol secretion

(after-before the sessions) - n = 8.

* : Statistical significant difference at .05.

* : Statistical significant difference at .05.

PhysicalDemand

Performance FrustrationLevel

Page 52: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

38

3.4.4 - Controllers orders to pilots -

The effect of experience on Controllers orders to pilots is depicted on the figure

20. Two statistical significant differences are observed.

First, the high experienced Controllers show a significant reduction of their

orders between T05, T99 and T02, while no significant variation was observed for the

Controllers having less than 20 months of experience. Secondly, during the whole

simulation, the low experienced Controllers showed lower number of orders compared

to the high experienced Controllers. The composition of this group can explain these

results. In fact, all Controllers which have less than 20 months of experience are all En

route Controllers and therefore have less orders to provide to pilots.

Furthermore, the results of the low experienced Controllers seem to suggest the

absence of a learning process during the simulation in so far as none reduction of

orders was observed for the 3 levels of traffic.

3.4.5 Approach versus En-route sectors

3.4.5.1 Traffic effect

As mentioned earlier, the sector per sector analysis leads to an insufficient

number of data to reveal statistical results, especially for objective data which were

focused on approach sectors. However, some interesting trends can be observed when

the data are averaged for en-route and approach sectors. The figure 21 shows a

comparison of fatigue and global score of the NASA-TLX for the two kinds of sectors. It

is worth to note that both en-route and approach Controllers rated their workload as

increasing as a function of the traffic, but only the approach Controllers felt an increase

of fatigue with traffic. This results is consistent with the results of experience presented

in the previous section as the en-route Controllers were also the less experienced.

Page 53: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

39

Figure 20.Effect of the experience of the position on the numberof controllers orders divided by the number of aircraft

as a function of the 3 levels of traffic (n = 19).

0,08

0,10

0,12

0,14

0,16

T99 T02 T05

Nu

mb

er o

f co

ntr

olle

rs o

rder

s / N

um

ber

of

airc

raft

*

*

**

****

* : Statistical significant difference at .05 between eachlevel of traffic

** : Statistical significant difference at .05 betweenthe two groups according to the level of traffic.

< 20 monthsof experience

≥ 20 monthsof experience

Page 54: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

40

40

45

50

55

60

Traffic 1999 Traffic 2002 Traffic 2005

Mea

n N

AS

A-T

LX

sco

re (

A.U

.)MILAN 99 - REAL TIME SIMULATION -

0

5

10

15

Traffic 1999 Traffic 2002 Traffic 2005

Mea

n d

iffe

ren

ce o

f se

lfev

alu

atio

n o

f fa

tig

ue

(A.U

.)

En routecontrollers TiredFresh Å

1000Å Approachcontrollers

Approachcontrollers Low Å :

En routecontrollers

High

1000 Å

Figure 21.Mean difference of self evaluation of fatigue and Mean NASA-TLX score for

En route and Approach controllers as a function of traffic.

A.U. : Arbitrary Units.

Page 55: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

41

MILAN 99 - REAL TIME SIMULATION

30

40

50

60

70

A B C A+

Mea

n N

AS

A-T

LX

sc

ore

(A

.U.)

-10

0

10

20

30

40

A B C A+

Mea

n d

iffe

ren

ce o

f se

lf e

valu

atio

n o

f fa

tig

ue

(A.U

.)

30

40

50

60

70

E F FW EW

Mea

n N

AS

A-T

LX

sc

ore

(A

.U.)

-10

0

10

20

30

40

E F FW EW

Mea

n d

iffe

ren

ce o

f se

lf e

valu

atio

n o

f fa

tig

ue

(A.U

.)

30

40

50

60

70

A B C E

Mea

n N

AS

A-T

LX

sc

ore

(A

.U.)

-10

0

10

20

30

40

A B C E

Mea

n d

iffe

ren

ce o

f se

lf e

valu

atio

n o

f fa

tig

ue

(A.U

.)

En route controllersTiredFresh Å

1000 Å Approach controllers HighLow

100 0 Å

WEEK 1

WEEK 2

WEEK 3

Figure 22.Mean difference of self evaluation of fatigue and Mean NASA-TLX score

for En route and Approach controllers as a function of organisations.

A.U. : Arbitrary Units.

Å

Page 56: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

42

No dataavailable

-4-3-2-101234

A B C A+

Mea

n d

iffe

ren

ce o

f co

rtis

ol s

ecre

tio

n (

ng

/ml)

MILAN 99 - REAL TIME SIMULATION

-4-3-2-101234

E F FW EW

Mea

n d

iffe

ren

ce o

f co

rtis

ol s

ecre

tio

n (

ng

/ml)

En route controllers

Approach controllers

-4-3-2-101234

A B C E

Mea

n d

iffe

ren

ce o

f co

rtis

ol s

ecre

tio

n (

ng

/ml)

WEEK 1

WEEK 2

WEEK 3

Figure 23.Mean difference of salivary cortisol secretion

for En route and Approach controllers as a function of organisations.

Page 57: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

43

T99 T02 T05

Figure 24.Number of controllers orders divided by the number of aircraft as a function of

organisations and type of sectors for the 3 levels of traffic (n = 19).

W = Wind

1,2

1,4

1,6

1,8

2

2,2

2,4

2,6

A B C A+ A B C E E F FW EW

Nu

mb

er o

f co

ntr

olle

rs o

rder

s / N

um

ber

of

airc

raft

Approach sector

En-Route sector

Page 58: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

44

3.4.5.2 Organisations effect

The figure 22 shows that both fatigue and workload are rated lower for the en-

route Controllers for the organisation B and C during the first week. During the second

week, the en-route Controllers were more tired than the approach Controllers in, the

organisation C and E. However, the workload remains exactly at the same level for the

2 groups of Controllers. In the third week, the workload remains at the same level for

the two groups but fatigue shows a different trend with a peak for the en-route

Controllers during organisation FW. Therefore it seems that the en-route Controllers

were more affected in terms of fatigue by the windy condition associated with the

organisation F while they do not felt a higher level of workload. This result is still

consistent with those presented in the previous sections on the effect of experience

showing that the less experienced Controllers tend to underestimate their workload.

The results of salivary cortisol are presented on figure 23. It can be observed

that, generally speaking, en-route Controllers showed higher positive difference in

salivary cortisol. That means that their level of cortisol tends to increase more than for

approach Controllers, i.e. they had more stress related to the task. However, the

difference between the two groups of Controllers is especially high in the organisation

B of the second week. It is also worth to notice that both groups were affected by the

wind (FW).

The figure 24 compares the number of orders to pilots for en-route and approach

Controllers. As it could be expected, the number of orders are higher for approach

Controllers than for en-route Controllers. However, the evolution of this parameter

through the organisations is parallel for the two groups of Controllers.

Page 59: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

45

4 - DISCUSSION -

The aim of the Milan 99 RTS was to identify the best airspace organisation to

implement in the Milan TMA. The airspace organisation to keep is intended to ensure

that Controllers will be able to perform a safe and efficient control with a reasonable

level of workload, despite the foreseen increase of traffic. With this aim in view, 3

organisations (A, B, C) were tested in the first week at the current level of traffic

observed in the area of Milan. During a second week, a new organisation (E) was

designed in collaboration with the Italian Controllers and tested at the level foreseen in

2002. The third week, based on a first data analysis and Controllers’ opinions, the

organisation E and the organisation F (a variant of organisation E) were tested with the

level of traffic foreseen in 2005 including 2 windy simulations.

In addition to the traditional evaluation used at EEC, a set of data were collected

in order to support the operational choices in terms of airspace organisation. These

data cover the following topics that could not be evaluated only by subjective tools :

fatigue, workload and stress. The main results are summarised into the table 3. This

table shows the effects that can be statistically demonstrated as well as the main

trends which do no reach a statistical level. In fact, as the objective measures were

collected on sub-groups, even when the differences are large the amount of data is not

sufficient to gives statistical results.

From the results, it can be noticed that the increasing level of traffic yields to

an increasing level of workload and stress. However, it should be keep in mind that

the levels of workload remain at a moderate level, lower than 50 on the NASA TLX

even for the highest traffic volume (2005). In the real world, the same evaluations are

frequently higher than 50.

Page 60: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

46

Paradoxically, a slight decrease of fatigue, both subjective and objective is

observed. This finding could be explained by the progressive adaptation of the

Controllers to their stay in Paris in unusual conditions (i.e. the hotel, the hours of

work,...). This hypothesis is supported by the results of sleep quality which tends to

improve during the second and third week. However, two other factors dealing with the

RTS itself can explain this result. First, during the debriefing the Controllers have

stated that they need some time to adapt to the simulator which does not reflect exactly

the reality of their real work conditions. Therefore, the learning of the simulator

reaction had probably helped the controllers to slightly decrease their fatigue despite

the increase in traffic. The second factor concerns the organisation which have been

improved from the first to the third week on the basis of Controllers’ opinions.

Page 61: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

47

Levelof traffic

Organisations(associated with

the lowest values)

Experienceof the position

Approach versus En-route sectors

Perceived

workload

(NASA-TLX)

(n=19)

Increase with

traffic (S)

Week 1 : B (NS)

Week 2 : E(NS)

Week 3 : E and F (NS).

Lower for less

experienced

Controllers (S)

Lower for en-route

than approach during

the first week. Higher

during the organisation

FW for approach (NS)

but lower for approach

for EW (NS)

Self rating of

fatigue

(n=19)

Decrease with

traffic (NS)

Week 1 : B (S)

Week 2 : C (S)

Week 3 : FW (S)

No effect. Lower for en-route

than approach during

the first week. Higher

during the organisation

FW for en-route (NS)

Objective

mental fatigue

assessed by the

Event Related

Potentials

(n=4)

Decrease with

traffic (NS)

Week 1 : B (NS)

Week 2 : B, E (NS)

Week 3 : E (NS)

Insufficient number

of data

En-route Controllers

were not recorded

Stress

assessed by the

salivary cortisol

(n=8)

Increase with

traffic (NS)

Week 1 : A+ (S)

Week 2 : E (NS)

Week 3 : E (S)

Higher for less

experienced

Controllers (S)

Insufficient number of

data

Frequency of

Controllers

orders to pilots

(n=19)

Decrease with

traffic (NS)

Week 1 : A+ (NS)

Week 2 : A (NS)

Week 3 : E and EW

(NS)

Higher for high

experienced

Controllers (S)

Higher for Approach

Controllers (NS)

NS : Not statistically SignificantS : Significant at P<.05

Table 3.Synthesis of results.

Page 62: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

48

The feeling of a better organisation, well adapted to the level of traffic, could also have

a positive effect on fatigue. It is thus likely that the adaptation to the living conditions,

the learning of the simulator reaction as well as the improvement in the organisations

had played together a role in the slight reduction of fatigue. This is consistent with the

fact that the Controllers reduced the frequency of orders to pilots. However, due to the

scheduling of the simulations, it is difficult to identify which are the most contributing

factors.

Based on the results summarised in the table 3, it is difficult to clearly

differentiate all the organisations. This statement supports partially the Controllers’

opinions.

In the first week, the lowest levels of workload and fatigue was observed for the

organisation B which was considered as a good one according to the Controllers point

of view. Moreover, the organisation E was derived from this organisation. However, the

Controllers orders to the pilots (index of activity) and stress level (objective measures)

were the lowest for A+.

The second week, two organisations : B and E are associated with the lowest

values of perceived workload, objective fatigue and stress, but Controllers orders to

pilots were still the lowest for the organisation A.

In the third week, most of values suggest that the organisation E is the most

adapted. However, it is necessary to remain very careful in the interpretation. In fact, it

is possible that the learning process of the simulation already mentioned has

influenced the results in maintaining their workload at a moderate level for the

organisations E tested with the highest level of traffic. This hypothesis is supported by

the fact that the frequency of Controllers orders to the pilots decreased from the first to

the third week. Moreover, the organisation E of the third week leads to a lower number

of Controllers orders than during the second week while the traffic had increased.

As the other organisations (A, B and C) were not replayed with the 2005 traffic,

the comparison of all the organisations with the same level of traffic is not possible.

Page 63: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

49

Some remarks can also be addressed from results reported in table 3

concerning the individual differences. Significant differences on stress, perceived

workload and number of manipulations appear between low and high experienced

Controllers. As mentioned before, it seems that the low experienced Controllers

underestimate their workload : they assess their workload lower than the experienced

Controllers although a stress reaction can be observed for them but not for

experienced Controllers. During the Sweden-Denmark RTS, strong individual

differences have been also revealed as a function of previous experience of the

interface. For Milan 99, the results of workload were contrary : the low experienced

Controllers had more workload than high experienced Controllers. This difference

could be explained by the fact that a totally new interface was tested in the Sweden-

Denmark campaign while Milan 99 involved new airspace organisations with the same

interface. Furthermore, most of the Italian Controllers included in the low experienced

group were only planning Controllers while the Swedish and Danish Controllers who

had no previous experience of the interface were all qualified as Executive Controllers.

The comparison of the data for the en-route and the approach sectors does not

revealed any significant differences due to the low number of Controllers in each of

these two groups.

Page 64: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

50

Intentionally Left Blank

Page 65: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

51

5 - CONCLUSION - PROSPECTS -

From the data collected in this RTS specific outcomes regarding the objectives

of Milan 99 can be addressed :

- the workload of Controllers was maintained at a moderate level for all the

organisations,

- the organisation E seems to be the most adapted as it induces less workload,

stress and fatigue. However, further investigations should be performed to

evaluate this organisation in different situations, e.g. fog (which is more frequent

in this area than wind), technical problems on aircraft,... and to determine

whether this organisation is still adapted. In addition, it should be worth to test

this organisation with Controllers who had not worked on previous exercises on

the simulator to avoid any learning effect.

From a more general point of view, these results have also some important

implications for further RTS :

- the day to day effect (e.g. increased level of fatigue and workload on Monday

morning, underestimation of fatigue on the last day of simulation) has to be taken

into account in the interpretation of subjective data,

- when setting up a group of controllers to be involved into a RTS it is necessary to

take into account the previous experience of Controllers on the position. If it is

not possible, the data processing has to be done separately for the high and low

experienced Controllers as the results would be significantly different for most

evaluations,

- due to the progressive adaptation of the Controllers to the general conditions of

the simulations and the learning process of the simulator, the scheduling of the

simulation should be also designed carefully to avoid misinterpretation. For the

specific case of Milan 99, this effect cannot be excluded and thus can mask

some aspects in the third week. Therefore, a training and familiarisation phase

should be planned before to start any evaluation on a simulator. This

familiarisation period should be representative of the exercises that will be

tested. Another method to avoid this learning effect should be to counterbalance

the order of the organisations from one week to another.

* * * *

Page 66: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

52

Intentionally Left Blank

Page 67: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

53

6 - REFERENCES -

CABON (P.) ; MOLLARD (R.) ; COINTOT (B.) ; MARTEL (A.) ; BESLOT (P.).-Elaboration of a method for the assessment of psychophysiological states of Air Trafficcontrollers in simulation. EEC Report N° 323, 1997, 64 p.

CABON (P.) ; FARBOS (B.) ; BOURGEOIS (S.) ; COINTOT (B.) ; MOLLARD (R.).-Objective evaluation of the learning process of controllers adapting to a new HMI forATC. EEC Note No 16/98, 1998, 26 p.

CABON (P.) ; FARBOS (B.) ; MOLLARD (R.) ; COBLENTZ (A.).- Objective evaluation oflearning process in Air Traffic Control Simulation. The Tenth International Symposium onAviation Psychology, Colombus, Ohio, USA, May 3 -6, 1999, 6 p.

DAVID (H.) ; CABON (P.) ; BOURGEOIS-BOUGRINE (S.) ; MOLLARD (R.).-Psychophysiological measures of fatigue and somnolence in simulated Air TrafficControl. In : Contempory Ergonomics, 1998, Taylor and Francis (ed.) pp. 429-433.

DUNCAN-JOHNSON (C.G.) ; DONCHIN (E.).- On quantifying surprise : The variation inevent-related potentials with subjective probability.- Psychophysiology, 14, 1977, pp.456-467.

FARBOS (B.) ; CABON (P.) ; BOURGEOIS (S.) ; DAVID (H.).- Psychophysiologicalmeasures of fatigue and somnolence in simulated Air Traffic Control. In : Proceedings ofthe Measuring Behavior 98 Conference, Groningen, August 18-21 1998, 2 p.

FARBOS (B.) ; CABON (P.) ; MOLLARD (R.). ; CALOO (F.) ; DAVID (H.).- Evaluationobjective de l'adaptation des contrôleurs aériens à une nouvelle interface homme-machine. Communication présentée au XXXIV Congrès de la Société d'Ergonomie deLangue Française, Caen, 15-17 Septembre 1999.

FIBIGER (W.) ; EVANS (O.) ; SINGER (G.).- Hormonal responses to graded mentalworkload.- European Journal Applied Physiology and Occupational Physiology, 55,1986, pp. 339-43.

JASPER (H.H.).- The ten-twenty electrode system of the International Federation.-Electroencephalography and Clinical Neurophysiology. - 10, 1958, 371-376.

NAVON (D.) ; GOPHER (D.).- On the economy of the human processing system.-Psychological Review, 86, 1979, pp. 214-255.

ZEIER (H.) ; BRAUCHLI (P.) ; JOLLER-JEMELKA (H.I.).- Effects of work demands onimmunoglobulin A and cortisol in air traffic controllers.- Biological Psychology, 42, 1996,pp. 413-423.

* * *

Page 68: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

54

Intentionally Left Blank

Page 69: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

55

Traduction en langue française

SOMMAIRE

La simulation temps réel MILAN 99 menée au Centre Expérimental Eurocontrol

(CEE) en Jan/Fév 99 avait pour principal objectif la réorganisation de la TMA Milan

dans le cadre de l’ouverture du nouvel aéroport de Malpensa.

Le CEE a réalisé plusieurs études sur des mesures psychophysiologiques et des

processus d’adaptation des contrôleurs à de nouvelles interfaces hommes/machines,

dans un premier temps en laboratoire puis au cours de la simulation temps réel

Suède/Danemark 98.

Des mesures objectives d’évaluation de la fatigue mentale par potentiel évoqué

auditif, de surcharge de travail et de stress par analyse de cortisol salivaire ont été

effectuées sur certains secteurs sélectionnés et complémentées par des mesures

subjectives tels que agendas du sommeil, questionnaires de surcharge de travail et de

fatigue.

Les résultats de ces observations psychophysiologiques suggèrent qu’il existe un

effet de l’heure pendant la journée ainsi que du jour de la semaine pouvant modifier,

de manière significative, les mesures de fatigue et de surcharge de travail , par

exemple, le Lundi et le dernier jour de la simulation, que l’expérience des contrôleurs

en ce qui concerne leurs secteurs a aussi un effet mesurable sur leurs réponses, qui

devra être pris en considération et enfin, que le processus d’adaptation se maintient

durant les exercices faisant l’objet de ces mesures y compris dans une simulation

d’organisation.

Il apparaît clairement que de telles évaluations psychophysiologiques

sélectionnées pour répondre aux objectifs d’une simulation opérationnelle, peuvent

contribuer d’une manière significative à une meilleure évaluation d’organisations

alternatives soit directement soit indirectement en alertant sur une fatigue superflue ou

des effets d’adaptation pouvant influencer des conclusions subjectives.

Page 70: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

56

AVANT-PROPOS -

L’un des principaux objectifs du Centre d’expertise “Independant Research” au

Centre Expérimental EUROCONTROL est la recherche et l’introduction de méthodes

de recherches novatrices dans le domaine du contrôle aérien.

Le besoin d’évaluer plus objectivement l’impact du contrôle aérien sur les

contrôleurs est une préoccupation ancienne et de nombreuses études ont été menées

au CEE pour déterminer les méthodes d’investigations les plus adaptées (CEE

Rapports 64, 164, 183,219,226,228, 323 et 334).

Le Laboratoire d’Anthropologie Appliquée de l’Université Paris V (Université

René Descartes) a mené, sous la direction du Pr Alex Coblentz, de nombreuses

études sur la fatigue, les troubles du sommeil et autres troubles associés notamment

sur les pilotes de ligne (Cabon et al 1996) les conducteurs d'automobiles (Cointot et al

1997) et les contrôleurs aériens (Mollard et al 1996).

Conformément à notre politique d’actualisation de nos programme d’études, les

derniers développements dans le domaine d’études EEG et d’analyses de cortisol

salivaire ont retenu notre attention et conduit à penser que de telles mesures pouvaient

se révéler très utiles.

C’est pourquoi, nous avons demandé au Laboratoire d’Anthropologie Appliquée,

leader dans cette spécialité, de conduire une étude de faisabilité sur l’utilisation de ces

techniques au CEE. Cette étude a fait l’objet d’un rapport (CEE n° 323/97) et d’une

étude complémentaire (note CEE n° 16 /98).

Certaines de ces méthodes ont été appliquées à une simulation temps réel

(Suède/ Danemark) et fait l’objet d’un rapport CEE n° 334/99. Cette simulation avait

pour objectif d’évaluer une nouvelle interface homme/machine.

La simulation temps réel Milan 99 concerne l’évaluation de modification de

secteurs dans la TMA Milan, assez proche du système existant. L’occasion nous a été

donnée de pouvoir appliquer ces méthodes psychophysiologiques à une simulation

“Organisationnelle” par opposition à une simulation de “Recherche”. Ce rapport décrit

le transfert de ces méthodes.

Le Directeur du Centre Expérimental, les chercheurs du Laboratoire

d’Anthropologie Appliquée ainsi que les chefs de projets tiennent à exprimer leurs

remerciements aux contrôleurs et aux personnels du CEE pour leur étroite

collaboration à cette étude menée pendant la simulation Milan 99.

Page 71: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

57

INTRODUCTION - OBJECTIFS -

Ce document rapporte les résultats des évaluations objectives du comportement

psychophysiologique des Contrôleurs au cours de la simulation temps réel Milan 99 qui

s’est déroulée au Centre Expérimental d’Eurocontrol. Ces évaluations ont pour objectif

d’orienter des choix opérationnels concernant l’organisation du trafic aérien de la

région de Milan dans le contexte de l’ouverture du nouvel aéroport de Malpenza. Après

Suède-Danemark 98, la simulation Milan 99 constitue la deuxième transposition dans

une simulation temps réel de mesures physiologiques validées dans des travaux

menés sur des simulations simplifiées(3) utilisant le logiciel TRACON PRO (Cabon et

coll., 1997, 1999 ; David et coll, 1998 ; Farbos et coll, 1998, 1999). Cependant, alors

que le but de la simulation Suède-Danemark était d’évaluer l’impact d’une nouvelle

interface(4) (Cabon et coll., 1998), l’objectif de la simulation Milan 99 concerne la

comparaison de plusieurs organisations dans leur capacité à gérer l’augmentation du

trafic aérien prévue dans cette région. La méthode utilisée a donc été adaptée aux

objectifs spécifiques de cette simulation. Trois aspects essentiels ont été évalués en

fonction des différentes organisations testées :

• la fatigue,

• la charge de travail,

• le stress.

Dans la perspective de la future organisation du trafic aérien, ces trois aspects

apparaissent essentiels d’un point de vue opérationnel puisqu’ils peuvent dégrader la

performance des Contrôleurs et donc la sécurité. De ce fait, ces évaluations

renforcent la validité des choix opérationnels réalisés au cours de cette simulation

temps réel.

3 EEC report N° 323 et EEC note 16/98.4 Rapport EEC N° 334.

Page 72: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

58

CONCLUSIONS - RECOMMANDATIONS -

A partir des données recueillies dans cette simulation, les résultats suivants ont

été mis en évidence :

• la charge de travail des Contrôleurs est restée à un niveau modéré pour toutes les

organisations,

• l’organisation E semble la plus adaptée, car elle induit le moins de charge de travail,

de stress et de fatigue. Néanmoins, des simulations complémentaires devraient être

effectuées pour évaluer cette organisation dans différentes situations, par exemple la

présence de brouillard ou de problèmes techniques survenant sur un avion… et ainsi

déterminer si cette organisation reste toujours adaptée. Par ailleurs, il serait

nécessaire de tester cette organisation avec des contrôleurs n’ayant pas

préalablement effectué d’exercices sur le simulateur afin d’écarter un éventuel effet

d’apprentissage.

D’un point de vue plus général, ces résultats ont des implications importantes

pour les futures simulations temps réel :

• il existe un effet du jour de la semaine (par exemple une augmentation de la fatigue

le lundi matin, une sous-estimation de la fatigue le dernier jour de la simulation) qui

doit être pris en compte dans l’interprétation des données subjectives,

• lors de la constitution du groupe de Contrôleurs qui doivent participer à la simulation,

il est nécessaire de prendre en compte l’expérience passée de ces Contrôleurs sur le

secteur. Si cela n’est pas possible, le traitement des données doit être effectué

séparément pour les Contrôleurs expérimentés et non expérimentés car les résultats

peuvent être significativement différents pour la plupart des évaluations,

• en raison de l’adaptation progressive des Contrôleurs aux conditions générales de la

simulation, la planification de la simulation doit être conçue avec précaution pour

éviter de fausses interprétations. Dans le cas spécifique de Milan 99, cet effet ne

peut être exclu et peut donc masquer certains aspects relatifs aux évaluations

effectuées dans la 3ème semaine. Une période de familiarisation et d’entraînement

doit donc être prévue avant de débuter les évaluations sur le simulateur. Cette

période doit être représentative des exercices qui vont être présentés aux

Contrôleurs. Une autre méthode consisterait à contrebalancer l’ordre des

organisations d’une semaine à l’autre.

* * * *

Page 73: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

59

* * *

A N N E X

* * *

QUESTIONNAIRES USED DURING

THE REAL TIME SIMULATION

- SLEEP LOG

- FATIGUE EVALUATION

- NASA-TLX

Page 74: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

60

- Agenda de sommeil / Sleep log -

- Une feuille par cycle à détacher et à remettre, chaque jour au médecin ou dans la boite prévue à cet effet -- One sheet per cycle to remove and to give every day to the doctor or to put in the designed box-

Date

Jour Mois Année

Day Month Year

EveilléAwake

FatiguéTired

SomnolentDrowsy

En formeFresh

AU COUCHER / WHEN GOING TO BED

AU LEVER / WHEN GETTING UP

Temps d’endormissement

Time to fall asleep

Heure de réveil

Waking time

Heure de lever

Raise time

Si vous avez des commentaires, inscrivez les au verso de cette feuille / If you have somecomments, write them on the back of this sheet.

Heure de coucher / Bed time

Comment vous sentiez-vous au couchez ? / How did you feel at bedtime ?

Réveil naturel

Natural awakening

Réveil planifié Autres raisons

Other reasons

Réveil provoqué par une gêne

Disturbance

Avez-vous pris un médicament pour dormir / Did you take a drug for sleep ?Si oui, lequel / If yes, which one :

Au cours de la nuit vous êtes-vous réveillé pendant une durée importante/ Did you wake upduring the night for a significant time ?

Si oui, indiquer la durée et les heures approximatives / If yes, indicate the approximate time andduration :

Quelle a été la raison de votre réveil ? / What was the reason for your awakening ?

Planned awakening

Comment vous sentez-vous actuellement ? / How do you feel right now ?

EveilléAwake

FatiguéTired

SomnolentDrowsy

En formeFresh

Page 75: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

61

Fresh

Sleepy

Tired

Awake

Date :Time :Name :

Fatigue evaluation( after session)

Did you feel difficulties, to remember information, to concentrate and tomaintain your attention, to interpret information or to estimate time ?

Indicate the degree through which you felt these manifestations :

Did you feel a hearing fatigue (difficulty to hearing) or a visual fatigue ?

Indicate the degree through which you felt these manifestations :

Did you feel headaches, pains in legs, in arms, in the back or in the neck ?

Indicate the degree through which you felt these manifestations :

Did you feel strained, aggressive, irritable, impatient, less interesting inyour surroundings or your environment ?

Indicate the degree through which you felt these manifestations :

HighAver

age

NoneVer

y high

Wea

k

4 - Mood

3 - Physical fatigue

2 - Sensorial fatigue

1 - Mental fatigue

According to your current feeling, write a mark on the following scales :

During the previous period, did you feel the following manifestations related with fatigue

HighAver

age

NoneVer

y high

Wea

k

HighAver

age

NoneVer

y high

Wea

k

HighAver

age

NoneVer

y high

Wea

k

Page 76: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

62

On the following pages, you will find six scales concerning different aspects of operational loadwhich may contribute to the overall work load during the flight.Please, indicate on these six scales retrospectively your average load during the last part of theflight.

Scale 1 : Mental Demand

How much mental and perceptual activity was required (e.g. thinking, deciding, calculating,remembering, looking, searching, etc…) ?Was the work easy or demanding, simple or complex, exacting (exigeant) or forgiving ?

Low High

Scale 2 : Physical Demand

How much physical activity was required (e.g., pushing, pulling, turning, controlling, activating,etc…) ?Was the work easy or demanding, slow or brisk (rapide), slack (détendu) or strenuous (soutenu),restful or laborious ?

Low High

Scale 3 : Temporal Demand

How much time pressure did you feel due to the rate or pace (rythme ou cadence) at wich the workhad to be done ?Was the pace slow and leisurely (tranquille) or rapid and frantic (effréné) ?

Low High

NASA-TLX (Task Load Index)

Ce questionnaire en langue anglaise a été validé par la NASA

Néanmoins, certains termes n'étant pas du langage courant, unetraduction est présentée entre parenthèses et en italique

"Task difficulty" evaluation [1-3]

Page 77: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

63

Scale 4 : Performance

How successful do you think you were in accomplishing the goals of the tasks set by the respectivework demands ?How satisfied were you with your performance in accomplishing these goals ?

Poor Good

Scale 5 : Effort

How hard did you have to work (mentally or physically) to accomplish your level of performance ?

Low High

Scale 6 : Frustration Level

How insecure, discouraged, irritated, stressed, and annoyed versus secure, gratified, content, relaxedand complacent (confiant) did you feel during the past part of the test.

Low High

"Task difficulty" evaluation [2-3]

How difficult was this session :

Veryeasy

Verydifficult

Page 78: EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental centre objective evaluation of physiological behaviour and workload

64

You will see bellow the six TLX scales presented in pairs.Please, mark a cross for the scale in each pair which was more importantin your overall workload

Mental demand Physical demand

Physical demand Temporal demand

Temporal demand Effort

Physical demand Frustration

Temporal demand Mental demand

Performance Effort

Frustration Effort

Temporal demand Performance

Mental demand Frustration

Physical demand Performance

Frustration Temporal demand

Mental demand Performance

Effort Physical demand

Performance Frustration

Mental demand Effort

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

"Task difficulty" evaluation [3-3]


Recommended