Margaret GoodrichCIMug MeetingNov. 16, 2011
UCA Test CommitteeUCA ICTA Status
ENTSO-E IOP&
Part 3, Part 6, Part 9, Part 4,and Part 13 IOP Report
Topics• UCA Testing Committee/ICTA Status
• ENSTO-E IOP Results
• Infrastructure for 2011 61968 IOP Tests
• CIM 61968-Part 3 IOP
– IOP Participants
– IOP Test Witnesses
– IOP Result Highlights
• CIM 61968-Part 6 IOP
– IOP Participants
– IOP Test Witnesses
– IOP Result Highlights
Topics
• Test Approach – 61968-Part 3 & Part 6– Part 3 Scenarios
– Part 6 Scenarios
• CIM 61968-Part 9 IOP– IOP Participants
– IOP Test Witnesses
– IOP Contents
– Test Scenarios
Topics• CIM61968-Part 4 and Part 13 IOP
– IOP Participants
– IOP Test Witnesses & Test Host
– IOP Contents
– IOP Result Highlights
• Test Approach – 61968-Part 4 & Part 13– Profile Data Groups
– Import/Export Exchange Tests
– Interoperation Tests
– Power Flow Tests
• IOP Report Contents & Status
55
UCA Testing Committee Background• Until this year, the Committee only covered 61850
• Group created during UCA IUG creation for
• Began work in 2005 for
• Technical Tasks
– Test Procedures
– Quality Assurance Program
– Tester Accreditation
• Administrative Tasks
– Maintain Conformance Certificates
– Maintain testing documents
66
Testing Subcommittee Charter
• Composed of Chairs of each UG TestingSubcommittee
• Single point focus for UCA IUG
• Arbitrates technical issues
• Coordinates Test Subcommittee groups within UCA
– 61850 Testing
– Open Smart Grid Conformity
– CIM Conformance and Interoperability
77
UCA Pilot of NIST IPRM• UCA has volunteered to pilot IPRM
– UCA procedures almost meet IPRM
– UCA status will be improved
• Some changes needed: UCA and testers
– UCA to become Guide 65 Certification Body
• UCA must adopt formal quality management sys
• UCA will issue (sign off on) certificates
– Testers to become 17025 certified/compliant
• Tester will not have final say on certificate issue
• UCA will review the “tester file” before cert issued
February 1, 2010February 1, 2010 UCA IUG Testing Past, Present, and FutureUCA IUG Testing Past, Present, and Future 88
UCA Pilot of NIST IPRM (cont.)
• 2011 is transition year for IPRM
– User Group need to declare ITCA intent
– Lack of progress nullifies that declaration
• Changes needed
– Create quality manual for UCA testing
– Have testers upgrade 9001 -> 17025
– Remove tester authority to issue certificates
– Significant per-test UCA work (review all tests)
– Testing fees might be considered
ENTSO-E IOP 2011 – A brief overview of the test topics
• Interoperability using the last UML (v15 + Dynamics + any modificationsagreed among test participants) – new draft of the 2nd edition of theprofile
• Interoperability using 1st and 2nd editions of the profile, including namingconvention
• Model Authority Sets (MAS), file headers, model assembling process• Incremental exchange• Exchange of short-circuit data according to IEC 60909• Exchange of dynamic models (standard models, user-defined models,
proprietary models)• Diagram layout – 61970-453; GIS data• Exchange “operations to planning” – The goal: detailed model to be
exported to fit to ENTSO-E profile and imported by planning applications.• ENTSO-E Equipment profile is the 452, “operational to operational”
exchange
ENTSO-E IOP 2011 – A brief summary
• A lot of participants – more than 50 including vendors + testwitnesses
• Issues identified and submitted to IEC. Three major efforts started:– Profiles discussion – TF in WG13– CIM for Dynamics – 2nd phase of EPRI project ongoing– HVDC modelling – WG13 discusses this with a priority
• Complete interoperability between all tools could not be seen dueto the large scope of the test and the large number of tools thathave different level of development and different features that theysupport.
• Preparation of good test files is a challenge• Recommendation on the implementation of the draft 2nd profile –
currently under ENTSO-E discussion
Part 3, 6 & 9 Test Infrastructure
• All tests were remotely executed• The ESB vendors performed any transformation that was
necessary to transmit the messages from one Vendor toanother– From Generic WSDL to Strongly Typed WSDL– From Strongly Types WSDL to Java Messaging Services
• Connectivity tests between the ESB and the Product vendorswere conducted prior to the test as well as dry runs
• Used GoTo Meeting to allow the test witnesses to view thevendor screens, see the messages and watch the progress ofthe test.
Part 3 IOP Participants
• L+G AMI
• Oracle OMS
• Oracle ESB
• TIBCO ESB
• IBM ESB
• Alstom Grid DMS & SCADA
• EDF ESB
• EDF R&D SCADA
• GE OMS
• Telvent OMS
Part 3 IOP Test Witnesses
• David Bogen, ONCOR Electric Delivery (Transmission/DistributionOperator, USA)
• Frank Wilhoit, American Electric Power (AEP – Transmission/DistributionOperator, USA
• Jim Greene, American Electric Power (AEP – Transmission/DistributionOperator, USA
• Mark Ortiz, Consumers Energy (Transmission/Distribution Operator, USA)
• Hugo Bruers, Alcatel-Lucent (Belgium)
• Matthias Stifter, Austrian Institute of Technology (Austria)
Part 3 IOP Result Highlights• All planned scenarios were executed
• All Product and ESB Vendors Passed all executedscenarios
Part 3 Test Approach: Scenarios
Part 3 Test Approach: Scenarios
Part 6 IOP Participants
• Alstom Grid DMS
• EDF R&D Simulator
• Sunflower Systems AMS
• IBM Maximo
• EDF ESB
• TIBCO ESB
• IBM ESB
• Oracle ESB
Part 6 IOP Test Witnesses
• David Bogen, ONCOR Electric Delivery (Transmission/DistributionOperator, USA)
• Frank Wilhoit, American Electric Power (AEP – Transmission/DistributionOperator, USA
• Jim Greene, American Electric Power (AEP – Transmission/DistributionOperator, USA
• Mark Ortiz, Consumers Energy (Transmission/Distribution Operator, USA)
• Hugo Bruers, Alcatel-Lucent (Belgium)
• Matthias Stifter, Austrian Institute of Technology (Austria)
Part 6 IOP Result Highlights• All planned scenarios were executed
• All Product and ESB Vendors Passed all executedscenarios
Part 6 Test Approach: Scenarios
Part 6 Test Approach: Scenarios
Part 9 IOP Participants
• Oracle
• Elster
• Landis + Gyr
• OPC Foundation
• Ecologic
• EnergyICT
• eMeter
• AEP
• Alstom
• TIBCO ESB
• IBM ESB
• Oracle ESB
Part 9 IOP Test Witnesses
• David Bogen, ONCOR Electric Delivery
• Jerry Grey and John Simmins, EPRI
Part 9 IOP Contents
• Messages Tested Include:
– Meter Reading
– End Device Control
– End Device Event
Part 9 Test Scenarios
Part 9 Test Scenarios
Part 9 Test Scenarios
Part 9 Test Scenarios
Part 9 Test Scenarios
Part 9 Test Scenarios
Meter Readings Sync R/R (1/2)
<MDM>eMeter
<AMI>AEP
<ESB>WebSphere ESB
MDM sends an on-demand meter readings
request to AMI
Get(GetMeterReadings) Get(GetMeterReadings)
ESB sends the meter readings request to AMIwithout Changes.
<MDM>eMeter
<AMI>AEP
<ESB>WebSphere ESB
Get(GetMeterReadings)
ESB sends the ACK to MDM
without changes
AMI returns an ACK toMDM synchronously
Request
Sync ACK Response
Get(GetMeterReadings)
Part 9 Test Scenarios
Part 4 & Part 13 IOP Participants
• Alstom Grid
• EDF
• GE Energy
• Open DSS
• Open Grid Systems
• Oracle
• Siemens
• SISCO
• SupeLec
• TIBCO
Part 4 & Part 13 IOP Test Witnesses & TestHost
• Alfredo Espinosa Reza, IIE (Institute for CFE, Mexico)
• Romano Napolitano, ENEL (DSO, Italy)
• Hugo Bruers, Alcatel-Lucent (Belgium)
• Matthias Stifter, Austrian Institute of Technology (Austria)
• EDF R&D – Michel Barberis, Eric Lambert, Pascale Bredillet forHosting the IOP and providing wonderful refreshments andfood!
Part 4 & Part 13 IOP Contents• CIM XML Profile Exchange tests for the Individual Profiles
with a Profile Group including:– Full Model Exchange (import and export)– Power Flow Solutions– Interoperation of full test models between two or more
vendors• CIM XML Profile Exchange tests for the combined Profile
Group including:– Full Model Exchange (import and export)– Power Flow Solutions– Interoperation of full test models between two or more
vendors
Part 4 and Part 13 IOP Result Highlights
• All vendors imported at least one Profile Group file for one ormore of the official test files.
• Five of the vendors ran a Power Flow solution on theimported files
• Seven of the vendors exported at least one set of ProfileData Group files for one or more of the official test files.
• All vendors executed one or more of the Interoperation TestProcedures
• There were also several unstructured tests generated andexecuted during this IOP.
Part 4 & Part 13 IOP Test Approach – ProfileData Groups
• For Power Flow:– Functional– Electrical Properties
• For GIS Import:– Functional– Asset
• For Power Flow Solution Exchange:– State Variables– Topology
Part 4 & Part 13 IOP Test Approach –Import/Export Exchange Tests
P artic ip an tA
X M LIm por t/Ex po rt
Te st Ca s e
5 .xBro w ser
XM LT oo lsX SL
S tyleShee t
C IMXM L
S c he m aX M L
Im p ort /Exp ort
P artic ip antB
Part 4 & Part 13 UCTE IOP Test Approach –Interoperation Tests
ParticipantA
ParticipantB
CIM XMLImport
TestCase-1
ModelMaint
System
CIM XMLImport
ModelMaint
System
CIM XMLExport
TestCase-2
CIM XMLValidator
Step 1
Steps 1,4Step 2
Step 2
Step 3
Step 4
Step 5
Steps1,4 Step 5
Part 4 & Part 13 IOP Test Approach – PowerFlow Tests
ParticipantA
ParticipantB
CIM XMLImport
TestCase-1
Power FlowApplication A
CIM XMLImport
Power FlowApplication B
Test Case-2(a previously imported/exported set ofCIM XML model files used in step 1)
CIM XMLValidator
Solution 1
(1)
(4,5)
(3)(2)
(2)
(1)
(3)
(4)
Solution 2
(2,5)
All IOP Reports: Contents & Status
• All IOP Test Reports will contain:– List of Vendors, Test Witnesses, Products and Models that were part of the
test including a full list of the Official files as well as the files that weregenerated
– Detailed Test Results– Product Descriptions for all participants– List of all Issues that were identified and the disposition/resolution/proposed
solution if possible– Summary description of the Test Approach
• The UCA IOP Test Report will be generated by the UCA and reviewed bythe team.
• The Report will be published to all UCA members, all SGIP/SGTCCmembers and every major CIM mail exploder we have as well as to manyCustomer lists by the Vendors.
• This report will be posted on the UCA Web Sites (both CIM and 61850) assoon as it is published.
Additional Information• UCA IOP Test Sponsors:
– Kay Clinard at UCA - [email protected]– Randy Lowe at AEP – [email protected]– John Simmins at EPRI – [email protected]
• UCA IOP Test Director:– Margaret Goodrich email – [email protected]– Margaret Goodrich Cell – + 1-903-477-7176
• UCA IOP Vendor Coordinators– 61968-4 – Bruce Scovill – [email protected]– 61968-13 – Eric Lambert – [email protected]– 61968-6 – Nada Reinprecht – [email protected]– 61968-3 – Jon Fairchild – [email protected]– 61968-9 – Margaret Goodrich – [email protected]
• IOP Host for 61850, 61968 Part 3, 4, 6, and 13:– Provided hosting, sponsorship and technical consulting– Eric Lambert – [email protected]