Actively Managed Safety Cases?

Adelard ACSE User Forum: 4 Dec 2014

Mark Deakin MSc BSc(Hons) GCGI CEng MIMechE

Deaks579 Consulting

Email: mark@deaks579consulting.co.uk

Background• 24 years in the Royal Air Force as an Engineer Officer/Aircraft Technician

• Last four years in a contracting role including a year with EDF Energy at HPB

• Majority of contract support roles as a safety and airworthiness consultant

• Limited experience with ‘construction’ of ASCE files

• Various tasks requiring review and update of Safety Cases/Hazard Logs…

2

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

Introduction• During time as contractor have seen a continuing theme within the MOD

Defence Equipment and Support (DES) Project Team (PT) environment

• Caveat: This is my view from my limited experience's

• Contractors often used to update, there seems to be a lack of ‘active’ management of platform safety cases/safety case reports

• Adelard GSN/CAE file often seen as standalone

• Hope to use this session to get my view across but also gain your feedback/lessons learnt…

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

3

Scope• Regulatory Requirements (Defence Aviation)

• Interaction with required strategies, plans and tools within an DES PT Safety Management System (SMS)

• Safety Case Evidence Management

• Issues Identified

• Possible solutions.

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

4

Military Aviation Authority (MAA) Regulations• JSP 815: Defence Health, Safety and Environmental Protection

• Def Stan 00-56: Safety Management Requirements for Defence Systems

• MAA Manual of Air Safety (MAS)

5

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

MAS: SMS Four Safety Pillars

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

6

Military Aviation Authority (MAA) Regulations• JSP 815: Defence Health, Safety and Environmental Protection

• Def Stan 00-56: Safety Management Requirements for Defence Systems

• MAA Manual of Air Safety (MAS)

• Regulatory Article (RA) 1000 Series: Competence, Roles and Responsibilities for Regulated Entities

• RA 1200 Series: Air Safety Management

• RA 1300 Series: Release to Service.

7

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

Air System Safety Cases• RA 1205(1): Air System Safety Case (SC):

An Air System SC is an up-to-date, through-life body of evidence that presents a coherent safety argument that demonstrates that all credible Risks to Life (RtL) associated with an Air System have been identified, assessed and mitigated satisfactorily.

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

8

Defence Air Safety Management• RA 1220(2): PT Airworthiness and Safety – Safety Case

• The PT Leader shall produce and update a Safety Case The Safety Case is to address airworthiness and safety It should clearly describe the evidence and arguments used to justify the safety

of the system It will be structured hierarchically and the safety justification summarised in a

Safety Case Report (SCR) The Safety Case should be maintained through the life of the aircraft Once a platform is in service the SCR should be reviewed and amended on a

regular basis, not exceeding 4 years.

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

9

Release to Service (RTS) Process RA 1300 GM 1300(1) 4

Dec

201

4D

eaks

579

Cons

ultin

g

10

SafetyCase

RA 1220(2)

Design & Modification

RA 5000 Series

Interaction• The Platform SC will require linkage to the following:

Through-Life Management Plan (TLMP) Release to Service (RTS) and supporting RTS Recommendations/Safety Statements Platform Airworthiness Strategy Safety Management System (SMS) Quality Management System (QMS) Hazard Log (HL): eCassandra Configuration Management Plan (CMP)

• Other/Future tools: Air Support Safety & Environmental Reporting Tool (ASSERT) BowTieXP (CGE Risk Management Solutions) Resolve (TLM Nexus).

11

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

Integrity Mgt Strategy

RA 5700

CMPRA 5311

AP1: SMS

Airworthiness StrategyAim: To ensure an explicit approach to demonstrate and sustain Platform Airworthiness

RA 1220(1)

SCRSCR

RTSRA 1360

SC/SCRRA 1220(2)

RTSRRA 1300

Project Team - Through Life Management PlanJSP 886 & RA 1220(1)

AP3: CompetenceAP2: Recognised Standards AP4: Independence

Hazard LogeCassandra

Safety AssessmentTop Level Safety Claim:

The Aircraft, when maintained and

operated and iaw the relevant ADS, is acceptably safe

RA1220(2)

OSD

SP1: Safety Policy and Objectives

SP3: Safety Assurance

SP2: Safety Risk Management

SP4: Safety Promotion

Safety Statements

QMPRA 4700

SMPRA 1220(2)

Evidence Management• Complex and ever changing process

• MAA Regulatory Publications (MRP) require:All significant airworthiness documents shall be maintained throughout the aircraft’s service life and retained for a minimum of 5 years beyond the aircraft’s out-of-service date (RTSA and PT) RA 1335: RTS Audit Trail:

• DES PT Safety Statements support any changes to how platform is used via RTS

• Changes recorded via Release to Service Recommendation Letter

• Additional evidence for Safety Case from multiple sources (.doc, .xls, .ppt, .axml, etc)

• Stored in Shared Area or Microsoft Office SharePoint Server (MOSS)

• Platform Safety Case GSN/CAE often seen as stand alone file, updated (only?) by contractors.

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

13

Issues• SCR only updated in-line with 4 year requirement from RA 1220

• Since switch to electronic file storage ‘registry’ function lost

• File/Folder structure poorly managed

• Mixed shared area and MOSS

• File naming convention causes issues 20141204-Title-O (date makes it difficult to reference)

• GSN/CAE File stand alone, ‘shelf wear’ ‘tick box culture’

• ASCE seen as specialist tool, unused Licences (120 paid for in ABW ‘X’ only in use)

• No use of Hazard Log Plugin

• Limited use of Internet Explorer ‘export’ function.

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

14

Possible Solutions• Generate model/framework that looks at more than just the Platform, integrated in to

the whole SMS (AMS ASCE FILE)

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

15

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

16

Airworthiness Management System

SC

PT Supported Meetings

SMP

Aw Strategy

TLMP

CMPQMS

HL

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

17

P2G PT Gazelle Safety Management Annual Meeting Requirement's

PIWG

HLWG

GSAM

2* Review

HAMG

ASSWG

DASOR Review

Aircraft Type Modifications Mtg

In-Service Mtg

UK Technical Cttee RT

Propulsion

Systems

Structural Integrity

ASSG

SASB

USG

AwSP

1* Quartet

DE&S SEMS DH ASMS

SEMF

Possible Solutions• Generate model/framework that looks at more than just the Platform, integrated into

the whole SMS (AMS ASCE FILE)

• Development and strict management of SC supporting files (all current in pdf format) similar to the way EDF Energy do business with their Living SC Documents

• Nominate a SC ‘Manager’

• Use Contractors to build/generate a robust framework for PT to populate as part of their daily routine (fed by .doc, .xls, .ppt files)

• Use QMS to audit and cross check that daily routine input.

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

18

Summary• Complex Regulatory Requirements

• Interaction with required strategies, plans, software tools, etc

• Evidence Management key foundation

• Issues are mainly with ‘management’ of evidence

• Solutions are very easy to achieve with buy-in of PTs…

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

19

Questions?

4 D

ec 2

014

Dea

ks57

9 Co

nsul

ting

20