1 RELIABILITY | ACCOUNTABILITY
External Document Links
bull Relay Misoperations Reliability Indicators Dashboard httpwwwnerccompagephpcid=4|331|400
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
Protection System Misoperation Identification and Correction NERC Industry Webinar December 1 2011 11 am ndash 1 pm
3 RELIABILITY | ACCOUNTABILITY
Anti-Trust Notice
bull It is NERCrsquos policy and practice to obey the antitrust laws and to avoid all conduct that unreasonably restrains competition
bull This policy requires the avoidance of any conduct that violates or that might appear to violate the antitrust laws
bull Among other things the antitrust laws forbid any agreement between or among competitors regarding prices availability of service product design terms of sale division of markets allocation of customers or any other activity that unreasonably restrains competition
4 RELIABILITY | ACCOUNTABILITY
Public Meeting Notice
bull Participants are reminded that this meeting is public
bull Notice of the meeting was posted on the NERC website and widely distributed The notice included the number for dial-in participation
bull Participants should keep in mind that the audience may include members of the press and representatives of various governmental authorities in addition to the expected participation by industry stakeholders
Misoperations Data Reporting and Overview Joe Spencer Chair ERO-RAPA Manager of Planning and Engineering SERC Reliability Corporation NERC Industry Webinar December 1 2011
6 RELIABILITY | ACCOUNTABILITY
Background
bull Protection Systems Misoperations identified as 1 NERC reliability issue in 2010
bull Data collected under NERC standards PRC-003 and 004
bull Significant regional differences existed in analysis and collection of misops
bull Difficult to Trackingtrend misops on the NERC-wide level
7 RELIABILITY | ACCOUNTABILITY
Background (2)
bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio
bull Options for consistent reporting assessed
bull Near term solution Regions align misops reporting procedures (via ERO-RAPA
and NERC SPCS)
bull Consistent categories cause codes and reporting frequencies developed
bull Misops template developed
8 RELIABILITY | ACCOUNTABILITY
Background (3)
bull Long term solution Use NERC-wide standard development process (Project
2010-055)
bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3
bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400
bull TADs data to be leveraged for ALR 41 calculation
9 RELIABILITY | ACCOUNTABILITY
Next Presenter
2Q2011 Misoperation Results
John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011
11 RELIABILITY | ACCOUNTABILITY
2Q2011 Misoperations
Summary Statistics
Total REs Providing Data 8
Total Mis-operations 812
Unnecessary Trip 95 (771)
Slow or Failure to Trip 5 (41)
TADS Reportable 21 (173)
TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo
36 (63)
12 RELIABILITY | ACCOUNTABILITY
by Category
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Category
Misoperations by Region and Category in 2011Q2
Unnecessary Trip during Fault
Unnecessary Trip without Fault
Failure to Trip
Slow Trip
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
Protection System Misoperation Identification and Correction NERC Industry Webinar December 1 2011 11 am ndash 1 pm
3 RELIABILITY | ACCOUNTABILITY
Anti-Trust Notice
bull It is NERCrsquos policy and practice to obey the antitrust laws and to avoid all conduct that unreasonably restrains competition
bull This policy requires the avoidance of any conduct that violates or that might appear to violate the antitrust laws
bull Among other things the antitrust laws forbid any agreement between or among competitors regarding prices availability of service product design terms of sale division of markets allocation of customers or any other activity that unreasonably restrains competition
4 RELIABILITY | ACCOUNTABILITY
Public Meeting Notice
bull Participants are reminded that this meeting is public
bull Notice of the meeting was posted on the NERC website and widely distributed The notice included the number for dial-in participation
bull Participants should keep in mind that the audience may include members of the press and representatives of various governmental authorities in addition to the expected participation by industry stakeholders
Misoperations Data Reporting and Overview Joe Spencer Chair ERO-RAPA Manager of Planning and Engineering SERC Reliability Corporation NERC Industry Webinar December 1 2011
6 RELIABILITY | ACCOUNTABILITY
Background
bull Protection Systems Misoperations identified as 1 NERC reliability issue in 2010
bull Data collected under NERC standards PRC-003 and 004
bull Significant regional differences existed in analysis and collection of misops
bull Difficult to Trackingtrend misops on the NERC-wide level
7 RELIABILITY | ACCOUNTABILITY
Background (2)
bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio
bull Options for consistent reporting assessed
bull Near term solution Regions align misops reporting procedures (via ERO-RAPA
and NERC SPCS)
bull Consistent categories cause codes and reporting frequencies developed
bull Misops template developed
8 RELIABILITY | ACCOUNTABILITY
Background (3)
bull Long term solution Use NERC-wide standard development process (Project
2010-055)
bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3
bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400
bull TADs data to be leveraged for ALR 41 calculation
9 RELIABILITY | ACCOUNTABILITY
Next Presenter
2Q2011 Misoperation Results
John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011
11 RELIABILITY | ACCOUNTABILITY
2Q2011 Misoperations
Summary Statistics
Total REs Providing Data 8
Total Mis-operations 812
Unnecessary Trip 95 (771)
Slow or Failure to Trip 5 (41)
TADS Reportable 21 (173)
TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo
36 (63)
12 RELIABILITY | ACCOUNTABILITY
by Category
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Category
Misoperations by Region and Category in 2011Q2
Unnecessary Trip during Fault
Unnecessary Trip without Fault
Failure to Trip
Slow Trip
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
3 RELIABILITY | ACCOUNTABILITY
Anti-Trust Notice
bull It is NERCrsquos policy and practice to obey the antitrust laws and to avoid all conduct that unreasonably restrains competition
bull This policy requires the avoidance of any conduct that violates or that might appear to violate the antitrust laws
bull Among other things the antitrust laws forbid any agreement between or among competitors regarding prices availability of service product design terms of sale division of markets allocation of customers or any other activity that unreasonably restrains competition
4 RELIABILITY | ACCOUNTABILITY
Public Meeting Notice
bull Participants are reminded that this meeting is public
bull Notice of the meeting was posted on the NERC website and widely distributed The notice included the number for dial-in participation
bull Participants should keep in mind that the audience may include members of the press and representatives of various governmental authorities in addition to the expected participation by industry stakeholders
Misoperations Data Reporting and Overview Joe Spencer Chair ERO-RAPA Manager of Planning and Engineering SERC Reliability Corporation NERC Industry Webinar December 1 2011
6 RELIABILITY | ACCOUNTABILITY
Background
bull Protection Systems Misoperations identified as 1 NERC reliability issue in 2010
bull Data collected under NERC standards PRC-003 and 004
bull Significant regional differences existed in analysis and collection of misops
bull Difficult to Trackingtrend misops on the NERC-wide level
7 RELIABILITY | ACCOUNTABILITY
Background (2)
bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio
bull Options for consistent reporting assessed
bull Near term solution Regions align misops reporting procedures (via ERO-RAPA
and NERC SPCS)
bull Consistent categories cause codes and reporting frequencies developed
bull Misops template developed
8 RELIABILITY | ACCOUNTABILITY
Background (3)
bull Long term solution Use NERC-wide standard development process (Project
2010-055)
bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3
bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400
bull TADs data to be leveraged for ALR 41 calculation
9 RELIABILITY | ACCOUNTABILITY
Next Presenter
2Q2011 Misoperation Results
John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011
11 RELIABILITY | ACCOUNTABILITY
2Q2011 Misoperations
Summary Statistics
Total REs Providing Data 8
Total Mis-operations 812
Unnecessary Trip 95 (771)
Slow or Failure to Trip 5 (41)
TADS Reportable 21 (173)
TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo
36 (63)
12 RELIABILITY | ACCOUNTABILITY
by Category
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Category
Misoperations by Region and Category in 2011Q2
Unnecessary Trip during Fault
Unnecessary Trip without Fault
Failure to Trip
Slow Trip
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
4 RELIABILITY | ACCOUNTABILITY
Public Meeting Notice
bull Participants are reminded that this meeting is public
bull Notice of the meeting was posted on the NERC website and widely distributed The notice included the number for dial-in participation
bull Participants should keep in mind that the audience may include members of the press and representatives of various governmental authorities in addition to the expected participation by industry stakeholders
Misoperations Data Reporting and Overview Joe Spencer Chair ERO-RAPA Manager of Planning and Engineering SERC Reliability Corporation NERC Industry Webinar December 1 2011
6 RELIABILITY | ACCOUNTABILITY
Background
bull Protection Systems Misoperations identified as 1 NERC reliability issue in 2010
bull Data collected under NERC standards PRC-003 and 004
bull Significant regional differences existed in analysis and collection of misops
bull Difficult to Trackingtrend misops on the NERC-wide level
7 RELIABILITY | ACCOUNTABILITY
Background (2)
bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio
bull Options for consistent reporting assessed
bull Near term solution Regions align misops reporting procedures (via ERO-RAPA
and NERC SPCS)
bull Consistent categories cause codes and reporting frequencies developed
bull Misops template developed
8 RELIABILITY | ACCOUNTABILITY
Background (3)
bull Long term solution Use NERC-wide standard development process (Project
2010-055)
bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3
bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400
bull TADs data to be leveraged for ALR 41 calculation
9 RELIABILITY | ACCOUNTABILITY
Next Presenter
2Q2011 Misoperation Results
John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011
11 RELIABILITY | ACCOUNTABILITY
2Q2011 Misoperations
Summary Statistics
Total REs Providing Data 8
Total Mis-operations 812
Unnecessary Trip 95 (771)
Slow or Failure to Trip 5 (41)
TADS Reportable 21 (173)
TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo
36 (63)
12 RELIABILITY | ACCOUNTABILITY
by Category
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Category
Misoperations by Region and Category in 2011Q2
Unnecessary Trip during Fault
Unnecessary Trip without Fault
Failure to Trip
Slow Trip
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
Misoperations Data Reporting and Overview Joe Spencer Chair ERO-RAPA Manager of Planning and Engineering SERC Reliability Corporation NERC Industry Webinar December 1 2011
6 RELIABILITY | ACCOUNTABILITY
Background
bull Protection Systems Misoperations identified as 1 NERC reliability issue in 2010
bull Data collected under NERC standards PRC-003 and 004
bull Significant regional differences existed in analysis and collection of misops
bull Difficult to Trackingtrend misops on the NERC-wide level
7 RELIABILITY | ACCOUNTABILITY
Background (2)
bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio
bull Options for consistent reporting assessed
bull Near term solution Regions align misops reporting procedures (via ERO-RAPA
and NERC SPCS)
bull Consistent categories cause codes and reporting frequencies developed
bull Misops template developed
8 RELIABILITY | ACCOUNTABILITY
Background (3)
bull Long term solution Use NERC-wide standard development process (Project
2010-055)
bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3
bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400
bull TADs data to be leveraged for ALR 41 calculation
9 RELIABILITY | ACCOUNTABILITY
Next Presenter
2Q2011 Misoperation Results
John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011
11 RELIABILITY | ACCOUNTABILITY
2Q2011 Misoperations
Summary Statistics
Total REs Providing Data 8
Total Mis-operations 812
Unnecessary Trip 95 (771)
Slow or Failure to Trip 5 (41)
TADS Reportable 21 (173)
TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo
36 (63)
12 RELIABILITY | ACCOUNTABILITY
by Category
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Category
Misoperations by Region and Category in 2011Q2
Unnecessary Trip during Fault
Unnecessary Trip without Fault
Failure to Trip
Slow Trip
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
6 RELIABILITY | ACCOUNTABILITY
Background
bull Protection Systems Misoperations identified as 1 NERC reliability issue in 2010
bull Data collected under NERC standards PRC-003 and 004
bull Significant regional differences existed in analysis and collection of misops
bull Difficult to Trackingtrend misops on the NERC-wide level
7 RELIABILITY | ACCOUNTABILITY
Background (2)
bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio
bull Options for consistent reporting assessed
bull Near term solution Regions align misops reporting procedures (via ERO-RAPA
and NERC SPCS)
bull Consistent categories cause codes and reporting frequencies developed
bull Misops template developed
8 RELIABILITY | ACCOUNTABILITY
Background (3)
bull Long term solution Use NERC-wide standard development process (Project
2010-055)
bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3
bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400
bull TADs data to be leveraged for ALR 41 calculation
9 RELIABILITY | ACCOUNTABILITY
Next Presenter
2Q2011 Misoperation Results
John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011
11 RELIABILITY | ACCOUNTABILITY
2Q2011 Misoperations
Summary Statistics
Total REs Providing Data 8
Total Mis-operations 812
Unnecessary Trip 95 (771)
Slow or Failure to Trip 5 (41)
TADS Reportable 21 (173)
TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo
36 (63)
12 RELIABILITY | ACCOUNTABILITY
by Category
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Category
Misoperations by Region and Category in 2011Q2
Unnecessary Trip during Fault
Unnecessary Trip without Fault
Failure to Trip
Slow Trip
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
7 RELIABILITY | ACCOUNTABILITY
Background (2)
bull NERC Planning Committee (PC) approves misops metric in 2009 (ALR 41) Focus on misops to operations ratio
bull Options for consistent reporting assessed
bull Near term solution Regions align misops reporting procedures (via ERO-RAPA
and NERC SPCS)
bull Consistent categories cause codes and reporting frequencies developed
bull Misops template developed
8 RELIABILITY | ACCOUNTABILITY
Background (3)
bull Long term solution Use NERC-wide standard development process (Project
2010-055)
bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3
bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400
bull TADs data to be leveraged for ALR 41 calculation
9 RELIABILITY | ACCOUNTABILITY
Next Presenter
2Q2011 Misoperation Results
John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011
11 RELIABILITY | ACCOUNTABILITY
2Q2011 Misoperations
Summary Statistics
Total REs Providing Data 8
Total Mis-operations 812
Unnecessary Trip 95 (771)
Slow or Failure to Trip 5 (41)
TADS Reportable 21 (173)
TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo
36 (63)
12 RELIABILITY | ACCOUNTABILITY
by Category
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Category
Misoperations by Region and Category in 2011Q2
Unnecessary Trip during Fault
Unnecessary Trip without Fault
Failure to Trip
Slow Trip
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
8 RELIABILITY | ACCOUNTABILITY
Background (3)
bull Long term solution Use NERC-wide standard development process (Project
2010-055)
bull Voluntary regional reporting in 2011Q1 and 2011Q2 mandatory for 2011Q3
bull Preliminary NERC wide and regional data available on NERC website httpwwwnerccompagephpcid=4|331|400
bull TADs data to be leveraged for ALR 41 calculation
9 RELIABILITY | ACCOUNTABILITY
Next Presenter
2Q2011 Misoperation Results
John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011
11 RELIABILITY | ACCOUNTABILITY
2Q2011 Misoperations
Summary Statistics
Total REs Providing Data 8
Total Mis-operations 812
Unnecessary Trip 95 (771)
Slow or Failure to Trip 5 (41)
TADS Reportable 21 (173)
TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo
36 (63)
12 RELIABILITY | ACCOUNTABILITY
by Category
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Category
Misoperations by Region and Category in 2011Q2
Unnecessary Trip during Fault
Unnecessary Trip without Fault
Failure to Trip
Slow Trip
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
9 RELIABILITY | ACCOUNTABILITY
Next Presenter
2Q2011 Misoperation Results
John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011
11 RELIABILITY | ACCOUNTABILITY
2Q2011 Misoperations
Summary Statistics
Total REs Providing Data 8
Total Mis-operations 812
Unnecessary Trip 95 (771)
Slow or Failure to Trip 5 (41)
TADS Reportable 21 (173)
TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo
36 (63)
12 RELIABILITY | ACCOUNTABILITY
by Category
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Category
Misoperations by Region and Category in 2011Q2
Unnecessary Trip during Fault
Unnecessary Trip without Fault
Failure to Trip
Slow Trip
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
2Q2011 Misoperation Results
John A Seidel Vice Chair ERO-RAPA Senior Mgr Event Analysis and Reliability Improvement Midwest Reliability Organization NERC Industry Webinar December 1 2011
11 RELIABILITY | ACCOUNTABILITY
2Q2011 Misoperations
Summary Statistics
Total REs Providing Data 8
Total Mis-operations 812
Unnecessary Trip 95 (771)
Slow or Failure to Trip 5 (41)
TADS Reportable 21 (173)
TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo
36 (63)
12 RELIABILITY | ACCOUNTABILITY
by Category
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Category
Misoperations by Region and Category in 2011Q2
Unnecessary Trip during Fault
Unnecessary Trip without Fault
Failure to Trip
Slow Trip
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
11 RELIABILITY | ACCOUNTABILITY
2Q2011 Misoperations
Summary Statistics
Total REs Providing Data 8
Total Mis-operations 812
Unnecessary Trip 95 (771)
Slow or Failure to Trip 5 (41)
TADS Reportable 21 (173)
TADS Reportable with Event ID Left Blank or ldquoUnavailablerdquo
36 (63)
12 RELIABILITY | ACCOUNTABILITY
by Category
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Category
Misoperations by Region and Category in 2011Q2
Unnecessary Trip during Fault
Unnecessary Trip without Fault
Failure to Trip
Slow Trip
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
12 RELIABILITY | ACCOUNTABILITY
by Category
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Category
Misoperations by Region and Category in 2011Q2
Unnecessary Trip during Fault
Unnecessary Trip without Fault
Failure to Trip
Slow Trip
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
13 RELIABILITY | ACCOUNTABILITY
by Category (2)
0
150
300
450
600
0
50
100
150
200
Unnecessary Trip during Fault Unnecessary Trip without Fault
Failure to Trip Slow Trip
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Category and Region
Misoperations by Category and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
14 RELIABILITY | ACCOUNTABILITY
by Cause
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Cause Code
Misoperations by Region and Cause Code in 2011Q2
Incorrect setting logic or design errors
Relay FailuresMalfunctions
Communication Failures
UnknownUnexplainable
As-left Personnel Error
AC System
DC System
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
15 RELIABILITY | ACCOUNTABILITY
by Cause (2)
0
80
160
240
320
400
0
20
40
60
80
100
NER
C M
isop
erat
ion
Coun
t
Reg
iona
l Ent
ity
Mis
oper
atio
n Co
unt
Cause Code and Region
Misoperations by Cause Code and Region in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
16 RELIABILITY | ACCOUNTABILITY
by Voltage Class
0
100
200
300
400
500
600
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Voltage
Misoperations by Region and Voltage in 2011Q2
100 kV ndash 199 kV
200 kV ndash 299 kV
300 kV ndash 399 kV
400 kV ndash 599 kV
600 kV ndash 799 kV
Other
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
17 RELIABILITY | ACCOUNTABILITY
by Voltage Class (2)
0
150
300
450
600
0
50
100
150
200
100 kV ndash 199 kV 200 kV ndash 299 kV 300 kV ndash 399 kV 400 kV ndash 599 kV 600 kV ndash 799 kV Other
NER
C En
tity
Mis
oper
atio
n Co
unt
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Voltage and Region
Misoperations by Region and Voltage in 2011Q2
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
18 RELIABILITY | ACCOUNTABILITY
by Relay Technology
0
50
100
150
200
250
300
NERC FRCC MRO NPCC RFC SERC SPP RE TRE WECC
Mis
oper
atio
n Co
unt
Region and Relay Technology
Misoperations by Region and Relay Technology in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
Microprocessor
Electromechanical
Solid State
Other
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
19 RELIABILITY | ACCOUNTABILITY
by Relay Technology (2)
0
50
100
150
200
250
300
0
10
20
30
40
50
60
Microprocessor Electromechanical Solid State Other
NER
C M
isop
erat
ion
Coun
t
Regi
onal
Ent
ity
Mis
oper
atio
n Co
unt
Relay Technology and Region
Misoperations by Relay Technology and Region in 2011Q2 (Only Incorrect setting and Relay FailuresMalfunctions Causes)
FRCC
MRO
NPCC
RFC
SERC
SPP RE
TRE
WECC
NERC
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
20 RELIABILITY | ACCOUNTABILITY
Top CauseRelay Technology
Microprocessor 213 75
Electromechanical 48 17
Solid State 11 4
Other 10 4
Misoperations by Relay Technology in 2011Q2 (Only Incorrect SettingLogicDesign Error Cause)
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
21 RELIABILITY | ACCOUNTABILITY
Initial Observations
bull Data quality appears consistent across all 8 regions
bull Highest cause ndash Incorrect settingsdesign error Mostly associated with microprocessor relays and their
complexity
Microprocessor relay make up a large of the overall population of BES relays
bull 70 of misops occur on transmission facilities operating between 100 kV to 200 kV Shows the need for collection of TADs outage data down to
100 kV- to enable Metric ALR-4-1 ldquoMis-operations Raterdquo to include entire BES
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
22 RELIABILITY | ACCOUNTABILITY
Next Steps
bull 2011 third quarter data is due November 30 2011 bull Once sufficient data is collected (possibly 3-4 quarters
minimum) NERC staff and the Regions can begin to identify certain areascauses that entities may explore within their own companies
bull Ultimately the goal is to help Entities reduce the number of misops
bull Tie-in to System Events How misops contribute to system events will be able to be better
tracked with the advent of the NERC EAWG and the established event categories and reporting forms
bull How often misops (as well as other causes) contribute to system events will be an important focus in the future Will be included in the annual ldquoState of Reliabilityrdquo reports
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
23 RELIABILITY | ACCOUNTABILITY
Next Presenter
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
Misoperation Template Annual Review
Andrew Slone Reliability Performance Analysis Engineer NERC NERC Industry Webinar December 1 2011
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
25 RELIABILITY | ACCOUNTABILITY
Misoperations Template
bull Relay Misoperations Reported on Common Template
bull Common Reporting Template Benefits Lessens Burden on Entities Spanning Multiple Regional
Entities
Increases Efficiency in Sending PRC-004 Data to NERC
Reduces NERC-wide Aggregation Time for NERC Staff
bull Misoperations Template httpwwwnerccomdocspcrmwgProtection_System_Misoperation_Reporting_Template_Finalxlsx
bull Misoperations Template QampA Document httpwwwnerccomdocspcrmwgQampA_on_Consistent_Misop_Reporting_FINALpdf
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
26 RELIABILITY | ACCOUNTABILITY
Misop Template Comments
bull Sixteen (16) Comments Received as of 1212011
bull Misoperation Template Comments Cover
Sudden Pressure Relay Misoperation Reporting Status
o Currently report as per Regional Entity procedures
Corrective Action Plan Clarifications
TADS Linkage Comments
o Remove automatically generated TADS Cause Code column
o TADS data should only be reported if a misoperation itself is TADS reportable
Formatting and Administrative Comments
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
27 RELIABILITY | ACCOUNTABILITY
Misop Template CommentsSlow Trips
bull A Particular Focus on Slow to Trip Misoperations
bull Comments on Slow to Trip Misoperations Meaning of ldquoessential to transmission system performancerdquo
Determining ldquoessential to transmission system performancerdquo
Clarification on boundary between ldquoSlow to Triprdquo and ldquoFailure to Triprdquo
Should all ldquoSlow to Triprdquo misoperations be reported or only ldquoSlow to Triprdquo misops that impact the Bulk Electric System
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
28 RELIABILITY | ACCOUNTABILITY
Additional Misop Template Comments
bull Additional Comments are Welcome
bull Comments Taken on an On-going Basis
bull Comments RespondedReviewed at Annual Review
bull Please Send Comments to
Andrew Slone AndrewSlonenercnet
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
29 RELIABILITY | ACCOUNTABILITY
Next Presenter
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
Project 2010-055 Protection System Misoperations Standard Drafting Team Art Buanno Senior Consultant ReliabilityFirst Corporation NERC Industry Webinar December 1 2011
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
31 RELIABILITY | ACCOUNTABILITY
Rapid Development Team Efforts
bull Combined PRC-003 amp PRC-004
bull Changed to a Results-Based Standard
bull Placed time restrictions on actions
bull Rewrote Misoperation definition due to Ambiguity of language
Align with Causes of Misoperation
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
32 RELIABILITY | ACCOUNTABILITY
Standard Drafting Team Efforts
bull Responding to industry comments bull Revising definition and standard based on comments bull Definition changes Added clause excluding operations during maintenance amp testing Included concepts from Guidelines amp Technical Basis section Added language for a slow trip other than Fault
bull Standard changes Divided the requirement into several requirements Revised timeframes for identifying causes amp determining CAPs or
action plans Improvements to allow for changes in CAP amp subsequent
development of CAP
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
33 RELIABILITY | ACCOUNTABILITY
Next Presenter
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
NERC Industry Webinar
Protection System Misoperation Identification and Correction
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
35
Misoperation Management Key Ingredients 1 Management SupportCulture of
Compliance 2 Formal Procedure 3 Corporate Tools 4 Assigned Responsibility 5 Progress Review 6 TrainingMentoring 7 Human Performance Improvement
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
Cooperation Between Departments
36
PRC-004 COMPLIANCEAUDITS
DATA SUBMITTAL EVIDENCE
SYSTEM PROTECTION (Subject Matter Expert)
OPERATIONS (Transmission Control Center)
CONTROL SYSTEMS (Maintenance)
Compliance Administration
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
Formal Procedure
37
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
Corporate Tools
38
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
Corporate Tool - DEETS
39
bullLINKED TO EMS LOGSTIMESTAMPS BREAKER OPERATIONS bullSYSTEM OPERATORS ADD RELAY TARGETING INFO bullSYSTEM PROTECTION DOCUMENTS ANALYSIS ndash CORRECT OR MISOPERATION INVESTIGATION CAUSE CORRECTIVE ACTION PLAN bullCREATES AUDIT TRAIL bullRUN REPORTS
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
Corporate Tool - DEETS
40
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
Assign Responsibility Progress Review Weekly rotation Gather data Solicit helpadvice Follow up Document
Weekly review of Engineering Status Monthly review of Open
Follow Up with Control Systems
41
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
TrainingMentoring
42
bullINVESTMENT IN CO-OP INTERN PROGRAM bullON THE JOB TRAINING bullASSIGN CAPITAL PROJECTS bullSELF STUDY SYMMETRICAL COMPONENTS bullMENTOR AS NEEDED bullUSE OF FEEDBACK FORMS FOR RELAY SETTINGS bullPERFORMANCE GOALS THAT SUPPORT QUALITY bullASSIGN RESPONSIBILITY FOR OUTAGE REVIEW
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
Human Performance Improvement
43
bullIdentify and analyze Human Error Events and other unexplained operating events that appear to need additional investigation and follow-up and for each of these events
bullIdentify the Contributing Causes bullCommunicate the ldquoLessons Learnedrdquo during the analysis throughout the effected organization(s) bullChampion the development amp implementation of measures to prevent the occurrence of future Events from similar causes
bullTrack and report the number of Human Error Events
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
44
Contact information Tedkramerduke-energycom (513) 287-4163
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
45 RELIABILITY | ACCOUNTABILITY
Next Presenter
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg
Managing Misoperations
Kristian Koellner PE LCRA Transmission Services
System Protection
NERC Protection System Misoperation Webinar December 1 2011
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg Topics
bull Intro to LCRA Transmission Services bull Proactive efforts
ndash Setting Standards amp Issuing Process ndash Voltage Class Coordination Studies ndash Short Circuit Modeling ndash Corporate Culture
bull Reactive efforts ndash Misoperation Review
bull Misoperation performance 47
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg LCRA Transmission Services
bull gt800 miles of 345kV gt2400 miles of 138kV gt600 miles of 69kV
48
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg Relay Setting Standards
bull Standardized method for implementing RampC designs bull Setting standards must complement design (print)
standards bull Twenty-nine standards documents ranging from capacitors
to DFRs to underfrequency to reclosing
49
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg Settings Issuing Process
bull All settings undergo peer review amp approval
bull All settings issued electronically via document management system
bull Electronic setting file issued when possible
bull As-left settings provided by relay technicians and reviewed
bull SubWAN remote access available for spot-checking 50
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg Voltage Class Coordination Studies
bull 345kV system ndash once every 2 years bull 138kV system ndash once every 3 years bull 69kV system ndash once every 5 years Study scope amp guidelines bull Phase distance verification (settings vs model) bull Ground distance verification (settings vs model) bull DCB scheme verification (blocking vs tripping elements) bull K-factors (settings vs model) bull Ground time verification (as backup and as primary) bull Ground instantaneous (verify proper reach per latest standard) bull SOTF (proper pickup voltage supervise if necessary) bull Include all lines and autotransformers bull Consider ldquosecondaryrdquo setting updates ndash SER ER PMU for example
51
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg Short Circuit Modeling
bull ERCOT-wide Short Circuit Case bull One CY and four FY cases built
annually by ERCOT System Protection Working Group
bull Multi-pass collaborative approach bull Cases include extensive mutual
coupling within model
52
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg Short Circuit Model Validation
53
Ground fault duty from near terminal is within 4 Model 7699 A Relay 7416 A
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg Corporate Culture
bull Continuous Process Improvement ndash Preventing Reoccurrence ndash Reducing Unknowns
bull Corporate Misoperation Trending Reporting amp Key Performance Indicators ndash Transmission system availability Line
fault index and Misoperation rate bull Emphasis on technical training bull If yoursquore gonna make one changehellip 54
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg Misoperation Review
bull Responsibility shared between System Protection group and Asset Performance and Reliability group
bull All faults at 69kV and above are reviewed for appropriate operation
bull Weekly Fault Review Rotation bull Events categorized by location cause
voltage class etc bull Automated reminder e-mail for open
investigations bull Reported quarterly to TRE
55
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg Misoperation Review Database
56
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg Historical Performance
57
35 37
22 23 25
23
989 974 891
846 820
939
000
200
400
600
800
1000
1200
0
5
10
15
20
25
30
35
40
FY 06 FY 07 FY 08 FY 09 FY 10 FY 11
Misoperation Percentage all voltage classes all causes of Misoperations all voltage classes all causes
(includes reclosing misoperations)
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg A Future Effort
bull Tie Line Review Checklist
58
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
wwwlcraorg Thank-you for your time
59
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session
60 RELIABILITY | ACCOUNTABILITY
Question and Answer Session