+ All Categories
Home > Documents > Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  ·...

Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  ·...

Date post: 25-Oct-2020
Category:
Upload: others
View: 3 times
Download: 0 times
Share this document with a friend
60
1 RELIABILITY | ACCOUNTABILITY External Document Links Relay Misoperations Reliability Indicators Dashboard http://www.nerc.com/page.php?cid=4|331|400 Misoperations Template: http://www.nerc.com/docs/pc/rmwg/Protection_System_Misoperation_Reporting_Template_Final.xlsx Misoperations Template Q&A Document: http://www.nerc.com/docs/pc/rmwg/Q&A_on_Consistent_Misop_Reporting_FINAL.pdf
Transcript
Page 1: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

1 RELIABILITY | ACCOUNTABILITY

External Document Links

bull Relay Misoperations Reliability Indicators Dashboard httpwwwnerccompagephpcid=4|331|400

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

Protection System Misoperation Identification and Correction NERC Industry Webinar December 1 2011 11 am ndash 1 pm

3 RELIABILITY | ACCOUNTABILITY

Anti-Trust Notice

bull It is NERCrsquos policy and practice to obey the antitrust laws and to avoid all conduct that unreasonably restrains competition

bull This policy requires the avoidance of any conduct that violates or that might appear to violate the antitrust laws

bull Among other things the antitrust laws forbid any agreement between or among competitors regarding prices availability of service product design terms of sale division of markets allocation of customers or any other activity that unreasonably restrains competition

4 RELIABILITY | ACCOUNTABILITY

Public Meeting Notice

bull Participants are reminded that this meeting is public

bull Notice of the meeting was posted on the NERC website and widely distributed The notice included the number for dial-in participation

bull Participants should keep in mind that the audience may include members of the press and representatives of various governmental authorities in addition to the expected participation by industry stakeholders

Misoperations Data Reporting and Overview Joe Spencer Chair ERO-RAPA Manager of Planning and Engineering SERC Reliability Corporation NERC Industry Webinar December 1 2011

6 RELIABILITY | ACCOUNTABILITY

Background

bull Protection Systems Misoperations identified as 1 NERC reliability issue in 2010

bull Data collected under NERC standards PRC-003 and 004

bull Significant regional differences existed in analysis and collection of misops

bull Difficult to Trackingtrend misops on the NERC-wide level

7 RELIABILITY | ACCOUNTABILITY

Background (2)

bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio

bull Options for consistent reporting assessed

bull Near term solution Regions align misops reporting procedures (via ERO-RAPA

and NERC SPCS)

bull Consistent categories cause codes and reporting frequencies developed

bull Misops template developed

8 RELIABILITY | ACCOUNTABILITY

Background (3)

bull Long term solution Use NERC-wide standard development process (Project

2010-055)

bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3

bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400

bull TADs data to be leveraged for ALR 41 calculation

9 RELIABILITY | ACCOUNTABILITY

Next Presenter

2Q2011 Misoperation Results

John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011

11 RELIABILITY | ACCOUNTABILITY

2Q2011 Misoperations

Summary Statistics

Total REs Providing Data 8

Total Mis-operations 812

Unnecessary Trip 95 (771)

Slow or Failure to Trip 5 (41)

TADS Reportable 21 (173)

TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo

36 (63)

12 RELIABILITY | ACCOUNTABILITY

by Category

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Category

Misoperations by Region and Category in 2011Q2

Unnecessary Trip during Fault

Unnecessary Trip without Fault

Failure to Trip

Slow Trip

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 2: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

Protection System Misoperation Identification and Correction NERC Industry Webinar December 1 2011 11 am ndash 1 pm

3 RELIABILITY | ACCOUNTABILITY

Anti-Trust Notice

bull It is NERCrsquos policy and practice to obey the antitrust laws and to avoid all conduct that unreasonably restrains competition

bull This policy requires the avoidance of any conduct that violates or that might appear to violate the antitrust laws

bull Among other things the antitrust laws forbid any agreement between or among competitors regarding prices availability of service product design terms of sale division of markets allocation of customers or any other activity that unreasonably restrains competition

4 RELIABILITY | ACCOUNTABILITY

Public Meeting Notice

bull Participants are reminded that this meeting is public

bull Notice of the meeting was posted on the NERC website and widely distributed The notice included the number for dial-in participation

bull Participants should keep in mind that the audience may include members of the press and representatives of various governmental authorities in addition to the expected participation by industry stakeholders

Misoperations Data Reporting and Overview Joe Spencer Chair ERO-RAPA Manager of Planning and Engineering SERC Reliability Corporation NERC Industry Webinar December 1 2011

6 RELIABILITY | ACCOUNTABILITY

Background

bull Protection Systems Misoperations identified as 1 NERC reliability issue in 2010

bull Data collected under NERC standards PRC-003 and 004

bull Significant regional differences existed in analysis and collection of misops

bull Difficult to Trackingtrend misops on the NERC-wide level

7 RELIABILITY | ACCOUNTABILITY

Background (2)

bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio

bull Options for consistent reporting assessed

bull Near term solution Regions align misops reporting procedures (via ERO-RAPA

and NERC SPCS)

bull Consistent categories cause codes and reporting frequencies developed

bull Misops template developed

8 RELIABILITY | ACCOUNTABILITY

Background (3)

bull Long term solution Use NERC-wide standard development process (Project

2010-055)

bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3

bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400

bull TADs data to be leveraged for ALR 41 calculation

9 RELIABILITY | ACCOUNTABILITY

Next Presenter

2Q2011 Misoperation Results

John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011

11 RELIABILITY | ACCOUNTABILITY

2Q2011 Misoperations

Summary Statistics

Total REs Providing Data 8

Total Mis-operations 812

Unnecessary Trip 95 (771)

Slow or Failure to Trip 5 (41)

TADS Reportable 21 (173)

TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo

36 (63)

12 RELIABILITY | ACCOUNTABILITY

by Category

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Category

Misoperations by Region and Category in 2011Q2

Unnecessary Trip during Fault

Unnecessary Trip without Fault

Failure to Trip

Slow Trip

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 3: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

3 RELIABILITY | ACCOUNTABILITY

Anti-Trust Notice

bull It is NERCrsquos policy and practice to obey the antitrust laws and to avoid all conduct that unreasonably restrains competition

bull This policy requires the avoidance of any conduct that violates or that might appear to violate the antitrust laws

bull Among other things the antitrust laws forbid any agreement between or among competitors regarding prices availability of service product design terms of sale division of markets allocation of customers or any other activity that unreasonably restrains competition

4 RELIABILITY | ACCOUNTABILITY

Public Meeting Notice

bull Participants are reminded that this meeting is public

bull Notice of the meeting was posted on the NERC website and widely distributed The notice included the number for dial-in participation

bull Participants should keep in mind that the audience may include members of the press and representatives of various governmental authorities in addition to the expected participation by industry stakeholders

Misoperations Data Reporting and Overview Joe Spencer Chair ERO-RAPA Manager of Planning and Engineering SERC Reliability Corporation NERC Industry Webinar December 1 2011

6 RELIABILITY | ACCOUNTABILITY

Background

bull Protection Systems Misoperations identified as 1 NERC reliability issue in 2010

bull Data collected under NERC standards PRC-003 and 004

bull Significant regional differences existed in analysis and collection of misops

bull Difficult to Trackingtrend misops on the NERC-wide level

7 RELIABILITY | ACCOUNTABILITY

Background (2)

bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio

bull Options for consistent reporting assessed

bull Near term solution Regions align misops reporting procedures (via ERO-RAPA

and NERC SPCS)

bull Consistent categories cause codes and reporting frequencies developed

bull Misops template developed

8 RELIABILITY | ACCOUNTABILITY

Background (3)

bull Long term solution Use NERC-wide standard development process (Project

2010-055)

bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3

bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400

bull TADs data to be leveraged for ALR 41 calculation

9 RELIABILITY | ACCOUNTABILITY

Next Presenter

2Q2011 Misoperation Results

John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011

11 RELIABILITY | ACCOUNTABILITY

2Q2011 Misoperations

Summary Statistics

Total REs Providing Data 8

Total Mis-operations 812

Unnecessary Trip 95 (771)

Slow or Failure to Trip 5 (41)

TADS Reportable 21 (173)

TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo

36 (63)

12 RELIABILITY | ACCOUNTABILITY

by Category

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Category

Misoperations by Region and Category in 2011Q2

Unnecessary Trip during Fault

Unnecessary Trip without Fault

Failure to Trip

Slow Trip

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 4: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

4 RELIABILITY | ACCOUNTABILITY

Public Meeting Notice

bull Participants are reminded that this meeting is public

bull Notice of the meeting was posted on the NERC website and widely distributed The notice included the number for dial-in participation

bull Participants should keep in mind that the audience may include members of the press and representatives of various governmental authorities in addition to the expected participation by industry stakeholders

Misoperations Data Reporting and Overview Joe Spencer Chair ERO-RAPA Manager of Planning and Engineering SERC Reliability Corporation NERC Industry Webinar December 1 2011

6 RELIABILITY | ACCOUNTABILITY

Background

bull Protection Systems Misoperations identified as 1 NERC reliability issue in 2010

bull Data collected under NERC standards PRC-003 and 004

bull Significant regional differences existed in analysis and collection of misops

bull Difficult to Trackingtrend misops on the NERC-wide level

7 RELIABILITY | ACCOUNTABILITY

Background (2)

bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio

bull Options for consistent reporting assessed

bull Near term solution Regions align misops reporting procedures (via ERO-RAPA

and NERC SPCS)

bull Consistent categories cause codes and reporting frequencies developed

bull Misops template developed

8 RELIABILITY | ACCOUNTABILITY

Background (3)

bull Long term solution Use NERC-wide standard development process (Project

2010-055)

bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3

bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400

bull TADs data to be leveraged for ALR 41 calculation

9 RELIABILITY | ACCOUNTABILITY

Next Presenter

2Q2011 Misoperation Results

John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011

11 RELIABILITY | ACCOUNTABILITY

2Q2011 Misoperations

Summary Statistics

Total REs Providing Data 8

Total Mis-operations 812

Unnecessary Trip 95 (771)

Slow or Failure to Trip 5 (41)

TADS Reportable 21 (173)

TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo

36 (63)

12 RELIABILITY | ACCOUNTABILITY

by Category

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Category

Misoperations by Region and Category in 2011Q2

Unnecessary Trip during Fault

Unnecessary Trip without Fault

Failure to Trip

Slow Trip

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 5: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

Misoperations Data Reporting and Overview Joe Spencer Chair ERO-RAPA Manager of Planning and Engineering SERC Reliability Corporation NERC Industry Webinar December 1 2011

6 RELIABILITY | ACCOUNTABILITY

Background

bull Protection Systems Misoperations identified as 1 NERC reliability issue in 2010

bull Data collected under NERC standards PRC-003 and 004

bull Significant regional differences existed in analysis and collection of misops

bull Difficult to Trackingtrend misops on the NERC-wide level

7 RELIABILITY | ACCOUNTABILITY

Background (2)

bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio

bull Options for consistent reporting assessed

bull Near term solution Regions align misops reporting procedures (via ERO-RAPA

and NERC SPCS)

bull Consistent categories cause codes and reporting frequencies developed

bull Misops template developed

8 RELIABILITY | ACCOUNTABILITY

Background (3)

bull Long term solution Use NERC-wide standard development process (Project

2010-055)

bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3

bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400

bull TADs data to be leveraged for ALR 41 calculation

9 RELIABILITY | ACCOUNTABILITY

Next Presenter

2Q2011 Misoperation Results

John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011

11 RELIABILITY | ACCOUNTABILITY

2Q2011 Misoperations

Summary Statistics

Total REs Providing Data 8

Total Mis-operations 812

Unnecessary Trip 95 (771)

Slow or Failure to Trip 5 (41)

TADS Reportable 21 (173)

TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo

36 (63)

12 RELIABILITY | ACCOUNTABILITY

by Category

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Category

Misoperations by Region and Category in 2011Q2

Unnecessary Trip during Fault

Unnecessary Trip without Fault

Failure to Trip

Slow Trip

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 6: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

6 RELIABILITY | ACCOUNTABILITY

Background

bull Protection Systems Misoperations identified as 1 NERC reliability issue in 2010

bull Data collected under NERC standards PRC-003 and 004

bull Significant regional differences existed in analysis and collection of misops

bull Difficult to Trackingtrend misops on the NERC-wide level

7 RELIABILITY | ACCOUNTABILITY

Background (2)

bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio

bull Options for consistent reporting assessed

bull Near term solution Regions align misops reporting procedures (via ERO-RAPA

and NERC SPCS)

bull Consistent categories cause codes and reporting frequencies developed

bull Misops template developed

8 RELIABILITY | ACCOUNTABILITY

Background (3)

bull Long term solution Use NERC-wide standard development process (Project

2010-055)

bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3

bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400

bull TADs data to be leveraged for ALR 41 calculation

9 RELIABILITY | ACCOUNTABILITY

Next Presenter

2Q2011 Misoperation Results

John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011

11 RELIABILITY | ACCOUNTABILITY

2Q2011 Misoperations

Summary Statistics

Total REs Providing Data 8

Total Mis-operations 812

Unnecessary Trip 95 (771)

Slow or Failure to Trip 5 (41)

TADS Reportable 21 (173)

TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo

36 (63)

12 RELIABILITY | ACCOUNTABILITY

by Category

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Category

Misoperations by Region and Category in 2011Q2

Unnecessary Trip during Fault

Unnecessary Trip without Fault

Failure to Trip

Slow Trip

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 7: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

7 RELIABILITY | ACCOUNTABILITY

Background (2)

bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio

bull Options for consistent reporting assessed

bull Near term solution Regions align misops reporting procedures (via ERO-RAPA

and NERC SPCS)

bull Consistent categories cause codes and reporting frequencies developed

bull Misops template developed

8 RELIABILITY | ACCOUNTABILITY

Background (3)

bull Long term solution Use NERC-wide standard development process (Project

2010-055)

bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3

bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400

bull TADs data to be leveraged for ALR 41 calculation

9 RELIABILITY | ACCOUNTABILITY

Next Presenter

2Q2011 Misoperation Results

John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011

11 RELIABILITY | ACCOUNTABILITY

2Q2011 Misoperations

Summary Statistics

Total REs Providing Data 8

Total Mis-operations 812

Unnecessary Trip 95 (771)

Slow or Failure to Trip 5 (41)

TADS Reportable 21 (173)

TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo

36 (63)

12 RELIABILITY | ACCOUNTABILITY

by Category

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Category

Misoperations by Region and Category in 2011Q2

Unnecessary Trip during Fault

Unnecessary Trip without Fault

Failure to Trip

Slow Trip

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 8: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

8 RELIABILITY | ACCOUNTABILITY

Background (3)

bull Long term solution Use NERC-wide standard development process (Project

2010-055)

bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3

bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400

bull TADs data to be leveraged for ALR 41 calculation

9 RELIABILITY | ACCOUNTABILITY

Next Presenter

2Q2011 Misoperation Results

John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011

11 RELIABILITY | ACCOUNTABILITY

2Q2011 Misoperations

Summary Statistics

Total REs Providing Data 8

Total Mis-operations 812

Unnecessary Trip 95 (771)

Slow or Failure to Trip 5 (41)

TADS Reportable 21 (173)

TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo

36 (63)

12 RELIABILITY | ACCOUNTABILITY

by Category

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Category

Misoperations by Region and Category in 2011Q2

Unnecessary Trip during Fault

Unnecessary Trip without Fault

Failure to Trip

Slow Trip

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 9: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

9 RELIABILITY | ACCOUNTABILITY

Next Presenter

2Q2011 Misoperation Results

John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011

11 RELIABILITY | ACCOUNTABILITY

2Q2011 Misoperations

Summary Statistics

Total REs Providing Data 8

Total Mis-operations 812

Unnecessary Trip 95 (771)

Slow or Failure to Trip 5 (41)

TADS Reportable 21 (173)

TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo

36 (63)

12 RELIABILITY | ACCOUNTABILITY

by Category

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Category

Misoperations by Region and Category in 2011Q2

Unnecessary Trip during Fault

Unnecessary Trip without Fault

Failure to Trip

Slow Trip

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 10: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

2Q2011 Misoperation Results

John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011

11 RELIABILITY | ACCOUNTABILITY

2Q2011 Misoperations

Summary Statistics

Total REs Providing Data 8

Total Mis-operations 812

Unnecessary Trip 95 (771)

Slow or Failure to Trip 5 (41)

TADS Reportable 21 (173)

TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo

36 (63)

12 RELIABILITY | ACCOUNTABILITY

by Category

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Category

Misoperations by Region and Category in 2011Q2

Unnecessary Trip during Fault

Unnecessary Trip without Fault

Failure to Trip

Slow Trip

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 11: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

11 RELIABILITY | ACCOUNTABILITY

2Q2011 Misoperations

Summary Statistics

Total REs Providing Data 8

Total Mis-operations 812

Unnecessary Trip 95 (771)

Slow or Failure to Trip 5 (41)

TADS Reportable 21 (173)

TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo

36 (63)

12 RELIABILITY | ACCOUNTABILITY

by Category

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Category

Misoperations by Region and Category in 2011Q2

Unnecessary Trip during Fault

Unnecessary Trip without Fault

Failure to Trip

Slow Trip

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 12: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

12 RELIABILITY | ACCOUNTABILITY

by Category

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Category

Misoperations by Region and Category in 2011Q2

Unnecessary Trip during Fault

Unnecessary Trip without Fault

Failure to Trip

Slow Trip

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 13: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

13 RELIABILITY | ACCOUNTABILITY

by Category (2)

0

150

300

450

600

0

50

100

150

200

Unnecessary Trip during Fault Unnecessary Trip without Fault

Failure to Trip Slow Trip

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Category and Region

Misoperations by Category and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 14: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

14 RELIABILITY | ACCOUNTABILITY

by Cause

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Cause Code

Misoperations by Region and Cause Code in 2011Q2

Incorrect setting logic or design errors

Relay FailuresMalfunctions

Communication Failures

UnknownUnexplainable

As-left Personnel Error

AC System

DC System

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 15: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

15 RELIABILITY | ACCOUNTABILITY

by Cause (2)

0

80

160

240

320

400

0

20

40

60

80

100

NER

C M

isop

erat

ion

Coun

t

Reg

iona

l Ent

ity

Mis

oper

atio

n Co

unt

Cause Code and Region

Misoperations by Cause Code and Region in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 16: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

16 RELIABILITY | ACCOUNTABILITY

by Voltage Class

0

100

200

300

400

500

600

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Voltage

Misoperations by Region and Voltage in 2011Q2

100 kV ndash 199 kV

200 kV ndash 299 kV

300 kV ndash 399 kV

400 kV ndash 599 kV

600 kV ndash 799 kV

Other

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 17: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

17 RELIABILITY | ACCOUNTABILITY

by Voltage Class (2)

0

150

300

450

600

0

50

100

150

200

100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other

NER

C En

tity

Mis

oper

atio

n Co

unt

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Voltage and Region

Misoperations by Region and Voltage in 2011Q2

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 18: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

18 RELIABILITY | ACCOUNTABILITY

by Relay Technology

0

50

100

150

200

250

300

NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC

Mis

oper

atio

n Co

unt

Region and Relay Technology

Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

Microprocessor

Electromechanical

Solid State

Other

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 19: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

19 RELIABILITY | ACCOUNTABILITY

by Relay Technology (2)

0

50

100

150

200

250

300

0

10

20

30

40

50

60

Microprocessor Electromechanical Solid State Other

NER

C M

isop

erat

ion

Coun

t

Regi

onal

Ent

ity

Mis

oper

atio

n Co

unt

Relay Technology and Region

Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)

FRCC

MRO

NPCC

RFC

SERC

SPP RE

TRE

WECC

NERC

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 20: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

20 RELIABILITY | ACCOUNTABILITY

Top CauseRelay Technology

Microprocessor 213 75

Electromechanical 48 17

Solid State 11 4

Other 10 4

Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 21: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

21 RELIABILITY | ACCOUNTABILITY

Initial Observations

bull Data quality appears consistent across all 8 regions

bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their

complexity

Microprocessor relay make up a large of the overall population of BES relays

bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to

100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 22: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

22 RELIABILITY | ACCOUNTABILITY

Next Steps

bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters

minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies

bull Ultimately the goal is to help Entities reduce the number of misops

bull Tie-in to System Events How misops contribute to system events will be able to be better

tracked with the advent of the NERC EAWG and the established event categories and reporting forms

bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 23: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

23 RELIABILITY | ACCOUNTABILITY

Next Presenter

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 24: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

Misoperation Template Annual Review

Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 25: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

25 RELIABILITY | ACCOUNTABILITY

Misoperations Template

bull Relay Misoperations Reported on Common Template

bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional

Entities

Increases Efficiency in Sending PRC-004 Data to NERC

Reduces NERC-wide Aggregation Time for NERC Staff

bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx

bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 26: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

26 RELIABILITY | ACCOUNTABILITY

Misop Template Comments

bull Sixteen (16) Comments Received as of 1212011

bull Misoperation Template Comments Cover

Sudden Pressure Relay Misoperation Reporting Status

o Currently report as per Regional Entity procedures

Corrective Action Plan Clarifications

TADS Linkage Comments

o Remove automatically generated TADS Cause Code column

o TADS data should only be reported if a misoperation itself is TADS reportable

Formatting and Administrative Comments

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 27: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

27 RELIABILITY | ACCOUNTABILITY

Misop Template CommentsSlow Trips

bull A Particular Focus on Slow to Trip Misoperations

bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo

Determining ldquoessential to transmission system performancerdquo

Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo

Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 28: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

28 RELIABILITY | ACCOUNTABILITY

Additional Misop Template Comments

bull Additional Comments are Welcome

bull Comments Taken on an On-going Basis

bull Comments RespondedReviewed at Annual Review

bull Please Send Comments to

Andrew Slone AndrewSlonenercnet

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 29: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

29 RELIABILITY | ACCOUNTABILITY

Next Presenter

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 30: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 31: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

31 RELIABILITY | ACCOUNTABILITY

Rapid Development Team Efforts

bull Combined PRC-003 amp PRC-004

bull Changed to a Results-Based Standard

bull Placed time restrictions on actions

bull Rewrote Misoperation definition due to Ambiguity of language

Align with Causes of Misoperation

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 32: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

32 RELIABILITY | ACCOUNTABILITY

Standard Drafting Team Efforts

bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault

bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or

action plans Improvements to allow for changes in CAP amp subsequent

development of CAP

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 33: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

33 RELIABILITY | ACCOUNTABILITY

Next Presenter

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 34: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

NERC Industry Webinar

Protection System Misoperation Identification and Correction

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 35: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

35

Misoperation Management Key Ingredients 1 Management SupportCulture of

Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 36: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

Cooperation Between Departments

36

PRC-004 COMPLIANCEAUDITS

DATA SUBMITTAL EVIDENCE

SYSTEM PROTECTION (Subject Matter Expert)

OPERATIONS (Transmission Control Center)

CONTROL SYSTEMS (Maintenance)

Compliance Administration

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 37: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

Formal Procedure

37

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 38: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

Corporate Tools

38

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 39: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

Corporate Tool - DEETS

39

bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 40: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

Corporate Tool - DEETS

40

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 41: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document

Weekly review of Engineering Status Monthly review of Open

Follow Up with Control Systems

41

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 42: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

TrainingMentoring

42

bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 43: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

Human Performance Improvement

43

bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events

bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes

bullTrack and report the number of Human Error Events

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 44: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

44

Contact information Tedkramerduke-energycom (513) 287-4163

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 45: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

45 RELIABILITY | ACCOUNTABILITY

Next Presenter

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 46: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg

Managing Misoperations

Kristian Koellner PE LCRA Transmission Services

System Protection

NERC Protection System Misoperation Webinar December 1 2011

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 47: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg Topics

bull Intro to LCRA Transmission Services bull Proactive efforts

ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture

bull Reactive efforts ndash Misoperation Review

bull Misoperation performance 47

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 48: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg LCRA Transmission Services

bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV

48

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 49: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg Relay Setting Standards

bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)

standards bull Twenty-nine standards documents ranging from capacitors

to DFRs to underfrequency to reclosing

49

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 50: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg Settings Issuing Process

bull All settings undergo peer review amp approval

bull All settings issued electronically via document management system

bull Electronic setting file issued when possible

bull As-left settings provided by relay technicians and reviewed

bull SubWAN remote access available for spot-checking 50

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 51: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg Voltage Class Coordination Studies

bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example

51

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 52: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg Short Circuit Modeling

bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built

annually by ERCOT System Protection Working Group

bull Multi-pass collaborative approach bull Cases include extensive mutual

coupling within model

52

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 53: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg Short Circuit Model Validation

53

Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 54: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg Corporate Culture

bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns

bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line

fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 55: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg Misoperation Review

bull Responsibility shared between System Protection group and Asset Performance and Reliability group

bull All faults at 69kV and above are reviewed for appropriate operation

bull Weekly Fault Review Rotation bull Events categorized by location cause

voltage class etc bull Automated reminder e-mail for open

investigations bull Reported quarterly to TRE

55

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 56: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg Misoperation Review Database

56

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 57: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg Historical Performance

57

35 37

22 23 25

23

989 974 891

846 820

939

000

200

400

600

800

1000

1200

0

5

10

15

20

25

30

35

40

FY 06 FY 07 FY 08 FY 09 FY 10 FY 11

Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes

(includes reclosing misoperations)

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 58: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg A Future Effort

bull Tie Line Review Checklist

58

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 59: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

wwwlcraorg Thank-you for your time

59

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60
Page 60: Relay Misoperations Reliability Indicators Dashboard DL/misoperations_webinar...2011/12/01  · Microprocessor relay make up a large % of the overall population of BES relays. •

60 RELIABILITY | ACCOUNTABILITY

Question and Answer Session

  • External Document Links
  • Slide Number 2
  • Anti-Trust Notice
  • Public Meeting Notice
  • Slide Number 5
  • Background
  • Background (2)
  • Background (3)
  • Slide Number 9
  • Slide Number 10
  • 2Q2011 Misoperations
  • by Category
  • by Category (2)
  • by Cause
  • by Cause (2)
  • by Voltage Class
  • by Voltage Class (2)
  • by Relay Technology
  • by Relay Technology (2)
  • Top CauseRelay Technology
  • Initial Observations
  • Next Steps
  • Slide Number 23
  • Slide Number 24
  • Misoperations Template
  • Misop Template Comments
  • Misop Template CommentsSlow Trips
  • Additional Misop Template Comments
  • Slide Number 29
  • Slide Number 30
  • Rapid Development Team Efforts
  • Standard Drafting Team Efforts
  • Slide Number 33
  • NERC Industry Webinar
  • Misoperation Management
  • Cooperation Between Departments
  • Formal Procedure
  • Corporate Tools
  • Corporate Tool - DEETS
  • Corporate Tool - DEETS
  • Assign Responsibility Progress Review
  • TrainingMentoring
  • Human Performance Improvement
  • Slide Number 44
  • Slide Number 45
  • Managing Misoperations
  • Topics
  • LCRA Transmission Services
  • Relay Setting Standards
  • Settings Issuing Process
  • Voltage Class Coordination Studies
  • Short Circuit Modeling
  • Short Circuit Model Validation
  • Corporate Culture
  • Misoperation Review
  • Misoperation Review Database
  • Historical Performance
  • A Future Effort
  • Thank-you for your time
  • Slide Number 60

Recommended