+ All Categories
Home > Documents > Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition...

Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition...

Date post: 24-Sep-2020
Category:
Upload: others
View: 0 times
Download: 0 times
Share this document with a friend
37
Is Error-Free SM Possible for Transmission? Dr. Chong Chiu, Dr. Ray Waldo, Dr. Mostafa Mostafa Mr. Hany Helmy Performance Improvement International, LLC 760-722-0202 (o), 248-312-8220 (c) [email protected] 1 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013. For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.
Transcript
Page 1: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Is Error-FreeSM Possible for Transmission?

Dr. Chong Chiu, Dr. Ray Waldo, Dr. Mostafa Mostafa Mr. Hany Helmy

Performance Improvement International, LLC

760-722-0202 (o), 248-312-8220 (c) [email protected]

1 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 2: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

IMPORTANT TRADE SECRET & COPYRIGHT WARNING

This is a proprietary document of Performance Improvement International, PII (formerly known as FPI international), California, U.S.A. The contents of this document shall not be disclosed or taught to a third party and are protected under trade secret laws (Section 757, Restatement of Torts).

This document and each of its pages are copyright protected (under Performance Improvement International, 1997 per U.S. Constitution, Art. I Sec. 8, Clause 8). No part of this book shall be reproduced, copied, or re-compiled in any form without prior written agreement from Performance Improvement International, LLC. Producing any derivative product such as abstracts of information for use in non-PII procedures, literature, training materials, job-site briefings, or reformatting for presentations based on the copyrighted materials, etc., is strictly prohibited by the U.S. federal copyright laws.

Any violation of the copyright and confidentiality will be prosecuted to the fullest extent of the law by PII’s legal counsel: Olins Riviere Coates and Bagula, 2214 Second Avenue, San Diego, CALIFORNIA, 92101, Telephone - (619) 333-2459, Facsimile - (619) 333-2459. Any questions or concerns about the copyright shall be directed to PII c/o Olins Riviere Coates and Bagula, attention Russell Riviere, Esq.

PII Proprietary Document: NERC Conference March 26-28, 2013

NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited. 2

Page 3: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

(1) What is Wrong with the Big Picture? (2) What Shall We Do or What Have We Done?

Human Performance in Transmission

3 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 4: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Some System Reliability Standards by FERC/NERC

4 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 5: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

(~5%-30%) Faults in Planning Analyses (Next-Day, Seasonal, etc.)

Qualification Tests (~10%-100%)

Planning Failure Model

Independent Review and Verification

(~5%-30%)

5 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 6: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

(~0.1%-1.5%) Errors

Review and Verification (~5%-100%)

Operations Failure Model

JIT Risk Reminder

(~5%-100%)

6 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 7: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Loss of Critical Generation or Transmission (~0.0001%-1%)

Regional Operational Intervention (Situational

Awareness) (5%-100%)

Blackout Failure Model

System Self-Recovery

(~1%-5%)

Cross-Region Operational Intervention (Situational

Awareness) (5%-100%)

7 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 8: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Event Rate

Event (Injury) Rate = Probability of Triggering Event*

LOP1 Failure Probability*

LOP2 Failure Probability*

LOP3 Failure Probability*

8

Triggering Event Could be a Consequential Error, an Equipment Failure or a Special Condition

NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 9: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Thought Provoking Questions

9 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 10: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Question 1

Are we familiar with the LOPs (barriers) established to prevent human error events, including injuries, as well as with those for critical components, such as a transformer bank?

If not, why not?

10 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 11: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Question 2

If we monitor performance and do routine maintenance on critical components, do we do the same for our critical LOPs?

If not, why not?

11 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 12: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Question 3

Do we design the reliability of transmission based on quantitative analysis of LOPs? As such, would we know the important from the unimportant?

If not, why not?

12 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 13: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

0

0.5

1

1.5

2

2.5

3

3.5

OE FS EC SIH FE SB VEH PPT SA DB DII EA GFB IB FBR CPN FBE

Number of Barriers

Relative Risk

More Management

Attention is Needed

Management Attention to Various Injuries

Copyright and Proprietary, Performance Improvement International, LLC, 2013. For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

NERC March 2013 13

Page 14: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Question 4

We know the definition of “risk”: probability of failure times the consequence of failure.

What is the equivalent term to risk, but on the side of success? Probability of success times the benefit of success.

If we do not know that term, why not?

14 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 15: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Answer: There is no such term

Security? Utility?

Expected Value?

15 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 16: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Question 5

Our workers’ lives are dear to us. As we start the day, do we know where, when, and what fatality or injury will most likely to occur? If yes, have we done anything to mitigate them?

If not, why?

16 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 17: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0 2 4 6 8 10 12

Probability of Consequential Error % per Day

Mitigation Zone

Probability of Consequential Errors

Number of Error Traps a Worker Encounters

(PII Field Research, International Data, 6,555 events, 1994-2010)

Copyright and Proprietary, Performance Improvement International, LLC, 2013. For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

NERC March 2013 17

Page 18: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Question 6

The transmission industry’s outage event rate has not dropped over the past few years, mainly due to various human errors involving the planning process, operational process and execution of tasks. Do we know how to decrease it?

If not, why not?

18 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 19: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Injury Statistics per Year in the USA (2005-2011)

~3.0 million recordable injuries, ~5,000 fatalities (The injury rates and fatality rates essentially remain constant from 2002 and on, considering significant reduction of manufacturing industry workforce in the USA)

Workplaces

19 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited. NERC March 2013

Vehicle – 37% LOF- 16% Fall -13% Harmful Substance – 4.3% Electrocution -3.7% Fire and Explosion – 2.5%

Fatality

Page 20: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Question 7

To control the flow rate of a pump, we design a control system that regulates the flow through:

• Real-time flow measurement

• Error between the actual measurement and the set-point

• Controller to change valve position and pump speed to reduce error

Human performance is as important as the pump flow in our system. Do we have a human performance control system?

If not, why not?

20 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 21: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Flow Rate Control

21 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 22: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Expectations Human Performance

Standards (ABC, TQA, HEE)

Gap Analysis

Root Cause Analysis

Corrective Actions

Change Management

Performance Monitoring

1. Leading 2. Real Time 3. Lagging

Satisfactory?

Human Performance Control Loop

Copyright and Proprietary, Performance Improvement International, LLC, 2013. For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

NERC March 2013 22

Page 23: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Answers to all Questions

We don’t know what we don’t

know.

The optimism bias in the form of complacency prevents some of us from elevating to a higher level of thinking and a relentless pursuit of

advanced knowledge.

23 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 24: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

The Error-Free ZoneSM

Unless we can predict it quantitatively, we really don’t know how to improve the system…

Problems can’t be solved by the same level of thinking that

creates them…

Einstein, 1921, 1934

24 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 25: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

What’s the New Thinking?

Quantitative Analysis

(>80,000 Lessons

Learned)

Different Error Traps for

Different Jobs

Recognizing Brain

Limitation

Recognizing Importance

of LOPs

•7 Marbles •4 Months Long-Term Memory •4 Hours Working Memory •Human Error Cycles

25 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 26: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

A

T

T

E

N

T

I

O

N

F A M I L I A R I T Y

Knowledge-based

Errors

Rule-based

Errors

Skill-based Errors

Low High

Low

High 1:10 activities performed in error

1:1000 activities performed in error

1:100 activities

performed in error

Human Error Types

Rules, Standards, Check List, Written Procedures

Memorization, Practice

26 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 27: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Definition of Errors Type Mode Term Definition

Skill-based Commission Slips During routine and repetitive activities (e.g., driving a vehicle, reading meters, etc.), an unintentional error is made without thought, reason, or judgment. A typical example is: while driving, the driver turns the right turn signal on when making a left turn.

Omission Lapses During routine and repetitive activities (e.g., driving a vehicle, reading meters, etc.), forgetting an action occurs without thought, reason, or judgment. A typical example is: while driving, the driver forgets to turn the right turn signal on when making a right turn.

Rule-Based Intentional Non-compliance Error

The rules, standards, procedures, or policies in question are adequate. However, workers choose to intentionally (with thought, reason, or judgment) disobey the requirements in the policies, standards, procedures or policies.

Non-intentional

Rule Application Error

The rules, standards, procedures, or policies in question are not adequately designed, communicated to, and/or applied to the workers. In essence, they violate the principles of ABC (all-inclusive, bypass resistant, clear) and/or TQA (workers are trained, qualified, being held accountable) for adequacy of rules.

Knowledge-based

Commission Mistakes A decision error made to cause unexpected and negative impact to the organization.

Omission Indecision No decision is made when a decision is needed in a troubled situation, a downward performance trend, an event, or a situation (e.g., routine resource re-allocation, standards change management, etc.) needing decision.

27 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited. NERC March 2013

Page 28: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Eight Human Error Experiential Curves

Skill-Based Rule-Based Knowledge-

Based

Commission Error

1) Unintentional Slips Curve

3) Application Errors Curve

4) Non-compliance Curve

5) Mistakes Curve

Omission Error

2) Forgetting Curve 6) Indecision Curve

Unintentional Intentional

7) Engineering Error Rate Curve 8) Project Failure Rate Curve (FUSESM)

28 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 29: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

How to Calculate Human Error Probability per Activity (Error Rate)?

29 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 30: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Simplified Calculation

Error Rate = Nominal Error Rate*

First Order Shaping Factors

Note: For each of three error types, if it is indeterminate about omission or commission error, the average error rate shall be used in error rate calculation

30 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 31: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

PII’s Model of Human Errors (Balance of Attention Marbles)

Task Marbles

Attention Marbles Missing Marbles due to Error Traps

31 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited. NERC March 2013

Page 32: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Shaping Factors = Marble Imbalance

Task Marbles – Attention Marbles

Error Rate

0.0

32 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 33: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Make Sure to Place Horse-before-the-Cart

Error-FreeSM Road Map (Preventive + Quantitative)

Event Investigation and Lessons Learned

33 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited. NERC March 2013

Page 34: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Error-FreeSM Transmission Road Map

Error-FreeSM Behavior

Seek Wisdom

Control Risk

Avoid Error Traps

Reflection in Action

Error Trap Mitigation by Supervisors

Time Specific

Activity Specific

Personal Specific

Environment Specific

Error-FreeSM LOPs by Managers

Quantitative

Design Maintain Monitor

34 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 35: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

The Error-Free ZoneSM Lessens the Burden

Expected Event Rate Reduction

Items Influence Impact in Event Rate Reduction

Error-FreeSM Behavior (SCARSM)

Reduce probability of triggering events, such as making a calculation error, use of wrong design code or data, or omission of a critical requirement by using job-specific error avoidance techniques.

2X-5X

Error Trap Mitigation (TAPESM)

Reduce both the probability of triggering events and LOP failure rates through mitigating the effects of time pressure, distractions, and inexperience.

1.5X-3X

Effective LOPs Reduce event rates by detecting and correcting planning errors before they cause events through improved review, qualification tests, etc.

5X-10X

35 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited. NERC March 2013

Page 36: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

Let us Pause and Think about the 2003 Northeast and 2011

Southwest Blackouts…

2003 Blackout: Software Design Errors, Review Errors, Planning Errors, Decision Errors

2011 Blackout: Operating Error, Verification Errors, Planning Errors

36 NERC March 2013 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited.

Page 37: Is Error-FreeSM Possible for Transmission? Human...Definition of Errors Type Mode Term Definition Skill-based Commission Slips During routine and repetitive activities (e.g., driving

37 Copyright and Proprietary, Performance Improvement International, LLC, 2013.

For NERC Conference Attendees Only. Reproduction or Derivative Products Strictly Prohibited. NERC March 2013


Recommended