PNNL Safety Management SystemPNNL Safety Management SystemMeasurement, Improvement and it’s Use Measurement, Improvement and it’s Use

In Governance/AssuranceIn Governance/Assurance

PNNL Safety Management SystemPNNL Safety Management SystemMeasurement, Improvement and it’s Use Measurement, Improvement and it’s Use

In Governance/AssuranceIn Governance/Assurance

Pat Wright and Sharon DossettPacific Northwest National Laboratory

Integrated ES&H Programpat.wright@pnl.gov

PNNL-SA-49641

2

PNNL-SA-49641

Measuring ISM System PerformanceMeasuring ISM System PerformanceMeasuring ISM System PerformanceMeasuring ISM System PerformanceObjectives:

Go beyond traditional lagging indicators:TRCR/DART “body count”Use leading indicators of System performanceAddress all aspects of ISMCore Functions and Guiding PrinciplesAddress all levels of ISM implementationInstitution, Facility, ActivityAddress efficiency of system performanceas well as effectivenessAutomate to control cost of performance measurementProvide a comprehensive ISM measure for Governance/Assurance Process

3

PNNL-SA-49641

Define Work Scope• Balanced Priorities

Analyze Hazards

Develop/Implement Hazards Controls

• Identification of safety standards and requirements

• Hazard controls tailored to work being performed

Perform Work• Operations authorization

PNNL Integrated ES&H Management ProgramPNNL Integrated ES&H Management ProgramCore Functions and Guiding PrinciplesCore Functions and Guiding Principles

Feedback and Improvement

Overarching Guiding Principles:

• Line management responsibility for safety

• Clear roles and responsibilities

• Competence commensurate with responsibility

Overarching Guiding Principles:

• Line management responsibility for safety

• Clear roles and responsibilities

• Competence commensurate with responsibility

PNNL Integrated ES&H ManagementPNNL Integrated ES&H Management((ISM) ModelISM) Model

Core Function/Guiding Principle “couplets”Core Function/Guiding Principle “couplets”

PNNL Integrated ES&H ManagementPNNL Integrated ES&H Management((ISM) ModelISM) Model

Core Function/Guiding Principle “couplets”Core Function/Guiding Principle “couplets”

4

PNNL-SA-49641

SBMS-based systems and tools work togetherSBMS-based systems and tools work togetherto give PNNL Integrated ES&H Managementto give PNNL Integrated ES&H Management

5

PNNL-SA-49641

6. Mgmt Resp;R2A2;

Competence

1. DefineScope;

BalancedPriorities

2. AnalyzeHazards

3. Develop &ImplementControls;

Identify Stds;Tailor Controls

4. PerformWork;

Authorize Work

5. Feedback &Improvement

Integrated ES&H Metric

FacilityOperationalBoundary

Facility Reliability

Lab SafetyImprovement

Budget

R&D Project RiskIdentification

(performance)

Activity HazardIdentification

Lab SafetyImprovementCommitments

R&D Project RiskIdentification(adequacy)

Activity HazardIdentification

Activity Permit

Facility WorkPractices

Incidents fromHazard Recog

failure

EnvironmentalManagement

aspects & impacts

FacilityOperationalTech Basis

Industrial HygieneMonitoring

HazardousMaterial

Management

SubcontractorRequirements

Flowdown

Compliant FacilityOperations

Maint & ConstrHazard Controls

RequirementsManagement

RequirementsAnalysis

Activity Permit

Facility WorkPractices

Incidents fromProcedure Content

failure

EnvironmentalManagement

System

SubcontractorPerformance

Compliant FacilityOperations

WorkObservations

Offsite WorkAuthorization

R&D Project WorkAuthorization

Job SpecificTraining

ActivityAuthorization

EnvironmentalCompliance

TRCR/DART

Incidents fromProcedure Use

failure

IndependentOversight Results

ExternalAssessment

Results

Use ofLessons Learned/

Best Practices

Assessment DataQuality

Corrective ActionManagement

Program

Envir MgmtCustomer

Satisfaction

RadiologicalControl Trends

Staff Engagement(Gallup)

Staff Concerns

Excellence &Effectiveness ofES&H (PEMP)

Staff Participationin Requirements

Development

ISM Validation

VPP STAR status

Staff VPP SurveyResults

Staff/ManagementCognizance &Engagement

Staff Training

Institutional Level

Facility Level

Activity Level

6

PNNL-SA-49641

PNNL Integrated ES&H ManagementPNNL Integrated ES&H ManagementMeasurement & Improvement ProcessMeasurement & Improvement ProcessPNNL Integrated ES&H ManagementPNNL Integrated ES&H Management

Measurement & Improvement ProcessMeasurement & Improvement Process

IdentifyProgram

PerformanceAreas

Identify DataStreams for

each ProgramPerf. Area

Create DataStreams

Establish RiskLimits

MonitorPerformance ofeach Indicator

Identify MetricDesign or

Performanceissues

EvaluatePerformance

Issues

DevelopActions to

CorrectPerformance

Report Trends& Risk Areas to

Governance

DevelopInstitutionalPerformanceImprovement

Agenda

ApproveInstitutionalPerformanceImprovement

Agenda

MonitorImplementation

DevelopPerformance

Metrics

MonitorPerformance

Metrics

Assurance &Governance

7

PNNL-SA-49641

How performance data is used for AssuranceHow performance data is used for AssuranceHow performance data is used for AssuranceHow performance data is used for Assurance

PNNLDirector Operations

CouncilOperations

Council

Lab Director / PNNL Leadership Council

Level 1 Councils

Forums

Research Council

Operations Council

Business CouncilResearch Forum

Operations Management

ForumBusiness

Forum

Management

*Chairperson

FOR INTERNAL USE ONLY

BusinessCouncil

8

PNNL-SA-49641

Operations Forum Provides Operations Forum Provides “Demanding Customer” for Data“Demanding Customer” for Data

Operations Forum Provides Operations Forum Provides “Demanding Customer” for Data“Demanding Customer” for Data

Primary focus of the forum is to identify cross-cutting risks/issues/concerns to Level 1 chair of the Operations Council Level 1 decides if/when/how to act on the issues

Senior level 2 managers with operations experience Systematically analyze and evaluate operational performance using

a number of indicators – including this ISM system performance metric

Recommendations on areas of performance with the greatest potential risks

Recommendations on risk limits for key ES&H and security indicators

Greater self-assessment attention to areas with performance problems

9

PNNL-SA-49641

PNNL ISM MetricPNNL ISM MetricPath ForwardPath Forward

PNNL ISM MetricPNNL ISM MetricPath ForwardPath Forward

Improve/validate indicators based on input from Operations Management Forum (continuous improvement)Use indicators to drive improvement agenda(FY07 business planning)Develop indicators of system efficiency(Develop in FY06 – Implement use in FY07)