GENERAL MEMBERSHIP WEB MEETINGSteve WidergrenSGIP Plenary Chair29 October 2010

2

AGENDA

Time Durations Item Presenter

0:00 – 0:10 Welcome & SGIP High Points Steve Widergren

0:10 – 0:15 NIST Update George Arnold

0:15 – 0:20 Governing Board Update John McDonald

0:20 – 0:30 Grid-Interop & 2011 Events Paul Molitor

0:30 – 0:45 Coordination Function Updates– Administrator & Program Management Office– Bylaws & Operating Procedures– Communications, Marketing, and Education

Stuart McCaffertyMatt TheallMladen Kezunovic

0:45 – 0:55 Standing Committee Reports– Architecture Committee– Cyber Security WG

Ron AmbrosioMarianne Swanson

0:55 – 1:05 Other Business– Electromagnetic Interoperability Issues WG– Catalog of Standards

Galen KoepkeMark Klerer

1:05 – 1:50 Testing & Certification Committee Action Plan Rik Drummond

1:50 – 2:00 Questions Steve Widergren

2:00 Adjourn

3

• Membership• Accomplishments• Areas of leadership attention

WELCOME

4

• Total # of Member Organizations: 624• # of Participating Member Organizations: 542• # of Observing Member Organizations: 82• # of Organizations who joined in September: 3

• Total # of Individual Members*: 1,729 * Omits Signatory Authorities who aren’t also cited as a representative.

•

SGIP MEMBERSHIP AS OF 10.4.10

Undeclar

ed

Appliance

C&I Equip.

Consumers PEV

IOUs

MUNIs

REAs

Mark

et Tra

ders

Ind. Power ICT

IT AppDev

Pwr. Equip.

Associa

tionsR&D

Fed Govt

Renew

able

Retail

SDOs

Regulat

orsT&

C

TransO

ps

Ventu

re Cap

ital

42 3844

14 12

44

1710

1 1

51

78

38

51

22

2 4 1

25

11 14 10 13

# of Organizations by Country• USA: 562• Canada: 28• International: 34

# of Participating Member Organizations by Declared Stakeholder Category

Stakeholder Categories

5

ACCOMPLISHMENTS• SGIP St. Louis meeting

– Over 200 in attendance, with ~320 in other meeting sites and remotely– Successful format to progress PAP, WG, and committee work– Larry Barto and Steve van Ausdall recognized for their contributions– All attendees and materials are posted on the Twiki under Plenary Meetings– Need continued acknowledgement of people dialed-in to the meeting

• PAP highlights– PAP 2 Wireless Guidelines: NISTIR Report due October– PAP 4 Common Scheduling: OASIS WS-Calendar public review closes 23 Nov– PAPs 3 & 9 Pricing & DR Signals: standards approaching OASIS public comment phase– PAP 5 Meter Data: AEIC Guidelines for Meter Interoperability to GB in November– PAP 10 Energy Usage Information: NAESB draft in formal review, complete in December– PAP 11 Electric Vehicle: results to be submitted to GB in November– PAP 12: potential 1 year schedule reduction for DNP/61850 mapping with IEEE/IEC

• Electromagnetic Interoperability Issues WG formed• 2011 event schedule in place• Purpose and scope of catalog of standards drafted• ANSI license agreement for access to standards: 150 “floating” licenses

6

AREAS OF LEADERSHIP ATTENTION• PAP 15 – Harmonize PLC standards for appliance integration

– Joint IEEE and ITU-T narrow-band PLC process for single standard established• PAP 1 Role of Internet Protocol

– IETF guide for smart grid in review, open questions on cyber security, network management, and quality of service

– Concept of an SGIP Internet WG being considered for such questions• Architecture related concerns

– Semantics coordination across SGIP efforts progressing after Semantic Summit in St. Louis– Coordination of SG architecture in other organizations: coordination with IEC SG3, IETF,

IEEE P2030 and ITU-T initiated• Media communications support: part time resource provided by NIST• DEWG work plans

– Discussing potential new PAPs– Expect to be instrumental in reviewing items for Catalog of Standards

• Engagement with international smart grid efforts– SGIP face-to-face targeted for July in Montreal with international theme– GB International Task Force engaged

7

NIST UPDATE

04/19/2023

George ArnoldNational Coordinator for Smart Grid InteroperabilityNIST

8

GOVERNING BOARD UPDATE

04/19/2023

John McDonaldSGIP Governing Board Chair

9

GOVERNING BOARD ACTIVITIES• Sept 9 and Oct 10 Governing Board Meetings

– Reviewed proposed plan for accelerating SGTCC T&C activities• 3Q2010 and Beyond

– Architecture for Home Area Networks Task Force Report• Focus on consumer needs and appliance interfaces• Need for technology flexibility is key• Architecture and method for communicating dynamic rates is key

– Governing Board Roadmap update• Completed initial tasks, including Smart Grid interoperability vision

– Communications, Marketing, and Education WG update• Partitioned work into Administrative, Marketing & Communication, and Education• Completed list of deliverables for CME roadmap

– Intellectual Property Rights (IPR)• Meetings have begun with Governing Board members and their attorneys.

– NARUC coordination• Establishing series of meetings and webinars with NARUC to coordinate with state regulatory legislators

• Policy– Met with NSTC to discuss new White House Smart Grid Policy Team’s mission and coordination – Voted on and passed SGIP Working Group Consensus and Voting Process

• Remaining 2010 Meetings – Nov 30 F2F meeting 8:00 a.m. to Noon Central time at Grid-Interop in Chicago, IL

September 2010 Activities - PMO Monthly Report

10

Date Time Location RegistrationJan. 13 1pm to 4pm Eastern Virtual Web/phone access will be posted

by Dec. 15, 2010 March 29 8am to Noon Local Part of the Spring

Face-to-Face Registration will be opened by Jan. 15, 2011

May 12 1pm to 4pm Eastern Virtual Web/phone access will be posted by Apr. 15, 2011

July 12 8am to Noon Local Part of the Summer Face-to-Face

Registration will be opened by May 15, 2011

Sept. 8 1pm to 4pm Eastern Virtual Web/phone access will be posted by Aug. 15, 2011

Nov. 10 1pm to 4pm Eastern Virtual Web/phone access will be posted by Oct. 15, 2011

Dec. 5 8am to Noon Local Part of the Winter Face-to-Face

Registration will be opened by Sept. 15, 2011

2011 GOVERNING BOARD EVENTS

11

UPCOMING EVENTS

04/19/2023

Paul MolitorSGIP Plenary Secretary

12

GB

Election Timeline – Even Stakeholders, 2010

DUE DATE TASK

9.20 Call for candidates open

10.8 Call for candidates close

10.29 Nominations reviewed, slates finalized and candidates notified

11.17 Membership Applications to vote “frozen”

11.18 Electronic voting opens at 9a.m. EST

12.1 Candidate Introductions @ Grid-Interop

12.2 Electronic voting closes at 5p.m. EST

12.3 Announce winners and/or runoff

12.6 – 12.15 RUNOFF CONTINGENCY: Open runoff election 12 pm

13

UP

COMI

NG

2010 PLEN

ARY EVEN

TS

• 30 Nov – 3 Dec: Grid-Interop, Chicago– See http://www.grid-interop.com/2010/#agenda for detailed agenda

 Mon.11/29

Tue.11/30

Wed.12/1

Thu.12/2

Fri.12/3

8.00 am  GB Meeting

     

10.30 am     PAPs & WGs PAPs & WGs

12.00 pm

LUNCH

1.00 pmOptional Meetings

Opening Plenary

   Closing Plenary

3.30 pmDEWGs &

CommitteesPAPs & WGs PAPs & WGs

Optional Meetings

5.00 pm   Candidate Interviews

andOptional Meetings

     

7.00 pm   PAPs & WGs    

9.00 pm

14

2011 Plenary M

eeting Schedule

Month Date Time DetailJan 21 1 – 3 p.m. Virtual Meeting/Conf. CallFebMar 29-31 All Day F2F: Nashville likelyAprMay 26 1 – 3 p.m. Virtual Meeting/Conf. Call hosted @ ConnectivityWeekJun

Jul 12-14 All Day F2F: Montreal, Canada – International themeAugSep 15 1 – 3 p.m. Virtual Meeting/Conf. Call hosted @ GridWeekOctNovDec 5-8 All Day F2F: Grid-Interop, Phoenix

15

ADMINISTRATOR & PMO REPORT

04/19/2023

Erich GuntherStuart McCaffertySGIP Administration

16

• SGIP Working Group Consensus and Voting Process– Voted on and passed by Governing Board – Document posted to TWiki (

http://collaborate.nist.gov/twiki-sggrid/pub/SmartGrid/PMO/PMO_Voting_and_Consensus_Operating_Procedure_for_Working_Groups_APPROVED.docx)

– Process to be used by PAPs, ad-hoc WGs, and committees• ANSI standards portal

– Coming soon! Announcement planned for early November.– SGIP standards– For official SGIP business ONLY

• PAP team reviewers• Smart Grid standards review teams• Users will be required to acknowledge ANSI user license agreement

• Please visit the Interoperability Knowledge Base (IKB) on the TWiki – A “work in progress”

• SGIP Catalog of Standards• Common vocabulary• Use cases for member and public use• Actor normalization• Much more

SGIP ADMINISTRATOR HIGHLIGHTS

04/19/2023

17

• Election polls open 11/18 – 12/2• Voting requirements and rules

– Member must be in “good standing”• Has met initial 2 meeting attendance obligation• Has not missed 2 SGIP plenary meetings in a row OR 2 SGIP votes in a row

– Member must have declared a stakeholder category• Undeclared members may not vote• For undeclared members, this will count as a missed vote

– Only the member voting representative may vote in the election• Voting reps will receive email reminders of the vote prior to the election

– Members will vote only in their declared stakeholder category• Members may not vote for Governing Board candidates outside of their stakeholder category

• Meet the Candidates at Grid-Interop– Tuesday, November 30 6PM – 7:30PM Chicago

GOVERNING BOARD ELECTION VOTING IN NOVEMBER

18

PAP Status

PAP 1 - Role of IP in the Smart Grid Submitting final comments to IETF.

PAP 2 - Wireless Communications for the Smart Grid

Draft of Wireless Communications Guideline NISTIR completed and in review by PAP team to ensure requirements have been met.

PAP 3 - Common Price Communication Model Initial Draft of EMIX completed. Final Draft expected in late November, 2010.

PAP 4 - Common Scheduling Mechanism Final Draft complete and out for public comment. PAP team reviewing to ensure requirements have been met. Expected completion date November 26.

PAP 5 - Standard Meter Data Profiles Final Draft complete. PAP team identified minor issues for guidelines against submitted requirements, which are being addressed by AEIC.

PAP 6 - Common Semantic Model for Meter Data Tables Developing requirements.

PAP 7 - Electric Storage Interconnection Guidelines PAP WG has provided requirements to IEEE and IEC and are awaiting standards from them.

PAP 8 - CIM for Distribution Grid Management PAP WG is working to finalize Use Cases and requirements, and deliver them to SSO

PAP 9 - Standard DR and DER Signals PAP WG has delivered requirements to OASIS and is awaiting draft Standard for review.

PAP 1 – 9 STATUS

6/8/2010 Footer for this presentation

19

PAP Status

PAP 10 - Standard Energy Usage Information NAESB formal comment period complete. Now in executive committee. Next step is NAESB member ratification, then PAP team will review for requirements one final time.

PAP 11 - Common Object Models for Electric Transportation

Final reviews from cyber security and architecture teams underway. Will go to Governing Board soon to vote on adding to the SGIP Catalog of Standards.

PAP 12 - IEC 61850 Objects/DNP3 Mapping Standards requirements have been transmitted to the SSOs.

PAP 13 - Time Synchronization, IEC 61850 Objects/IEEE C37.118 Harmonization PAP WG met with IEEE WG to finalize the requirements and next steps

PAP 14 - Transmission and Distribution Power Systems Model Mapping

Determining and assessing key use cases. Scoping to transmission ONLY and using cross-PAP process with PAP 8 to manage distribution system interfaces.

PAP 15 - Harmonize Power Line Carrier Standards for Appliance Communications in the Home

Appliance centered PLC requirements transitioned to SSOs• Significant progress in broadband coexistence harmonization• Joint SSO team forming between IEEE-SA & ITU-T to harmonize

PAP 16 - Wind Plant Communications Preparing to submit requirements to IEC.

PAP 17 - Facility Smart Grid Information Standard Developing requirements.

PAP 10 – 17 STATUS

6/8/2010 Footer for this presentation

20

SEPTEMBER 2010 PAP TIMELINE STATUS

September 2010 Activities - PMO Monthly Report

Form Initial Team

Develop Requirements SSO Development

Milestone: Requirements Handoff

Milestone: PAP Initiation

PAP Charter

Milestone: Standards Handback

Milestone: GB/SGIPDecision

Analysis That Standard

Meets PAPRequirements

GB Decision

Post toCatalog

Milestone: Close PAP

Close PAP

Milestone: SSO Identified

Develop List ofDeliverables and Tasks

With Assignments

•PAP 0

•PAP 1

•PAP 3

•PAP 9

•PAP 10

•PAP 11

•PAP 13

•PAP 15

•PAP 4

•PAP 5

•PAP 2

•PAP 7

•PAP 12

•PAP 6

•PAP 8

•PAP 14

•PAP 16

•PAP 17

21

BYLAWS & OPERATING PROCEDURES WG

04/19/2023

Matt TheallBOPWG Chair

22

•New PAP Process Approved by GB and Sent to PAP Chairs

1. Requires PAP chairs do everything possible to reach consensus

2. In the event consensus can NOT be reached, voting is allowed to break an impasse

3. Voting must follow one of the following procedures• Chair can call for an immediate vote in a meeting• Chair can call for an electronic ballot• Chair can establish a voting group

BOPWG Update – Matt Theall

Please Support PAP Chairs As ThisNew Process is Implemented

23

COMMUNICATIONS, MARKETING, & EDUCATION WG

04/19/2023

Mladen KezunovicCME WG Chair

24

SGIP CMEWG ROADMAP ACTION ITEMS

• High priority action items– Coordinate press releases with SGIP PR Team (consists of NIST, GB, SGIP

Officer, Administrator)– SGIP Portal that directs users to categories of information and related

websites (sgipweb.org)– NARUC support with related CME artifacts– TCC report dissemination and promotion (when ready)

• Deliverables and schedules – Website&Newsletter content update in coordination with SGIP PR Team

(Q4,10)– Flyer#1: “What is the meaning of Interoperability” (Q1/11)– Flyer#2: “Public benefits of Interoperability”(Q2/11)– Flyer#3: “Testing process to assure interoperability” (Q3/11)– PP slides & videos for the “Speaker Bureau” (Q4/10)– OPMAN (procedures for Press releases and other activities)

24

25

SGIP CMEWG: SUPPORT ROLES

• NIST– Develop/maintain NIST Smart Grid Portal (www.nist.gov/smartgrid)– Provide content/some production for website, flyers, newsletter, etc

• Administrator (NIST Contractor)– Provide committee logistics support, including minutes– Gather information for content as needed– Provide content/production and dissemination of artifacts– Maintain sgipweb.org website (www.sgipweb.org)

• CMEWG (volunteer members)– Develop/maintain communication/marketing/education plan– Review the artifacts– Advise and contribute on content– Coordinate with SGIP PR team– Oversee execution of the CME Roadmap

25

26

ARCHITECTURE COMMITTEE

04/19/2023

Ron AmbrosioSGAC Chair

27

SGAC QUAD CHART

Deliverables

Published Semantic Model White Paper Published Architecture Process Document Published Draft National Goals White Paper Published National Goals Decomposition Spreadsheet Published Architectural Requirements Published Draft Business Services Definitions Published Draft PAP Mapping to NIST Concept Model and

GWAC Stack

Activities and Accomplishments

Ongoing focus on Architecture Process and Goals Conceptual Architecture

Goal Decomposition Workshop complete Requirements Workshop complete Business Services Workshop complete

Semantic Summit at St. Louis SGIP meeting Appointed SGAC liaisons to PAPs/DEWGs Developing SGAC Workplans (ongoing) Organizing SGAC participation at Grid-Interop 2010

Upcoming Key Milestones and Activities

Engage with and aid in coordination of key industry reference architecture activities

Contact initiated with IEC SG 3, IETF, IEEE P2030, ITU-T Conceptual Architecture

Automation Services Workshop prep underwaySemantic Modeling

Follow-on work with PAPs and SSOs from Summit Working on next version of white paper

Issues, Concerns, and Help Needed

Architecture development requires focused work that will go beyond volunteer only activities

There is GB concern on overlap and coordination of information models between the PAPs. Need greater SGAC oversight between the various PAP information modeling activities.

28

CYBER SECURITY WORKING GROUP

04/19/2023

Marianne SwansonCSWG Chair

29

C S W G

Q U A D

C H A R T O C T O B E R 2 0 1 0

Deliverables

Supporting Update to PAP 2 Requirements Matrix Supporting PAP 10 Requirement Development NEMA Meter Upgradability Standard Review PAP1 Security Review

Activities and Accomplishments Completed “Introduction to the NISTIR 7628, Guidelines for

Smart Grid Cyber Security” Completed Outreach Session with California PUC Created new CSWG Subgroup on AMI security and on Testing

and Certification Completed 5 Standards Assessments Expanded Support to PAPs

PAP1 – Security review PAP2 – Requirements update PAP 10 – Integrating Cyber Security Identified CWSG team members to provide support to

remaining PAPs

Upcoming Key Milestones and Activities

PAP2 Requirements Update NEMA Meter Upgradability Standard Review Upcoming outreach Sessions:

• IEEE 4-6 October at NIST• GridWeek 18-21 October in DC• University of Illinois – November 5, Champaign, IL• Georgia Tech – November 18-, Atlanta, GA

Issues, Concerns, and Help Needed

None

30

ELECTROMAGNETIC INTEROPERABILITY ISSUES

04/19/2023

Galen KoepkeNIST Lead

31

ELECTROMAGNETIC INTEROPERABILITY ISSUES WG

• Scope: This Working Group will investigate enhancing the immunity of Smart Grid devices and systems to the detrimental effects of natural and man-made electromagnetic interference, both radiated and conducted. The focus is to address these electromagnetic compatibility (EMC) issues and to develop recommendations for the application of standards and testing criteria to ensure EMC for the Smart Grid, with a particular focus on issues directly related to interoperability of Smart Grid devices and systems, including impacts, avoidance, generation and mitigation of and immunity to electromagnetic interference. These recommendations from the Electromagnetics Interoperability Issues Working Group can be considered by the SGIP for follow-on activity (PAP creation, SGTCC action, etc.). With its focus on interoperability, this effort is not a general review of electromagnetics and electric power related issues, such as power quality, which are being addressed in different groups outside the SGIP.

NIST Framework, Release 1 (section 7.3) identifies electromagnetic disturbances and interference as two of the “…major standards-related issues and barriers impacting standardization efforts and progress toward a fully operational Smart Grid.”

32

ELECTROMAGNETIC INTEROPERABILITY ISSUES WG

• Electromagnetic Interoperability Issues Working Group chartered– Charter reviewed and revised after discussion with Governing Board, TnD DEWG

and H2G DEWG• Progress to Date:

– Working Group page added to Twiki site and list server initiated– Announcement circulated to initial email list and SGIP forum– Good response to announcements– Initial teleconference/webcast November 1, 2010– Regular telecon/web meetings planned, F2F at Grid-Interop

NIST Framework, Release 1 (section 7.3) identifies electromagnetic disturbances and interference as two of the “…major standards-related issues and barriers impacting standardization efforts and progress toward a fully operational Smart Grid.”

33

CATALOG OF STANDARDS

04/19/2023

Mark KlererSGIP Plenary Vice Chair

34

Plenary leadership team working in conjunction with SGAC and other SGIP working groups

• Proposed Scope of the Standards Catalog– Standards and guides recognized as relevant for enabling SG capabilities

• Proposed Objectives of the Standards Catalog– Explain value & purpose of the catalog for SG community– Influential, but independent of NIST/FERC decision-making– Characterize the various specification organizations with respect to their processes in

developing their specifications– Provide an annotated resource that identifies standards created by recognized SSOs

and/or industry consortia that are relevant to Smart Grid applications– Identify functional areas of smart grid where each standard is appropriate (draw on

SGAC work)

CATALOG OF STANDARDS (STATUS OF WORK IN PROGRESS)

35

• Process– NIST Framework and Roadmap for SG Interoperability v1.0 identifies many standards to consider– Additional standards can be identified to the SGIP Administrator by any SGIP member for potential

inclusion in catalog– Relevance and importance evaluated by appropriate SGIP working group (e.g. DEWG, PAP, etc) and

consensus developed– 75% approval by SGIP membership required prior to SGIPGB approval for inclusion in the catalog– Standards included in the catalog may be deprecated from further use to changes in technology or

needs by following the same process.

• Catalog Structure– Entries in catalog to be structured based on application domain defined in the Framework and

further classified by GWAC stack

• Relationship to NIST and FERC lists– Standards Catalog strives for accurate characterization and relevance to the smart grid community,

and avoids recommendation– Standards Catalog expected to be a larger compilation which can inform NIST and FERC in their

decision processes

CATALOG OF STANDARDS: PROCESS & STRUCTURE

36

TESTING & CERTIFICATION COMMITTEE

04/19/2023

Rik DrummondSGTCC Chair

37

CONTENTS• Quad Chart• Purpose• Definitions• 4Q10• 2012 and beyond• 2011 the transition year

38

Deliverables D3 – Interoperability Process Reference Manual

(IPRM) is being finalized for SGIP review. Interoperability Maturity Assessment Tool

completed

Activities and Accomplishments D3 – Interoperability Process Reference Manual

(IPRM) completed 1st review and comment period during St. Louis meetings; comment resolution and final editing remains in progress

Began piloting IPRM with several Interoperability Testing and Certification Authorities (ITCA) who have expressed willingness to cooperate and participate in assessing their organizations against the IPRM recommendations.

Prepared draft ITCA audit process document and checklist in preparation for ITCA reviews

Launched discussion with accreditation bodies for future independent ITCA reviews

Upcoming Key Milestones and Activities Presentation on SGTCC framework and plan to

the SGIP on October 29 to build awareness and support for the process

Completing 2-3 ITCA reviews by late November Updates to the IPRM based on experience

gathered during the ITCA review process, and revision/release in early January

Engaging with the CSWG testing sub-team to coordinate security related testing issues

Issues, Concerns, and Help Needed Obtaining timely cooperation from the ITCAs to

participate in the review process with the TCC, and accelerating their commitment to adopt and enact the SGTCC recommendations in their operations

Engaging end users to gain their commitment towards requiring IPRM conformance for ITCAs certifying the products that they purchase

October 2010 Activities - PMO Monthly Report

SGTCC MONTHLY QUAD CHART

39

PURPOSE• Establish a Testing and Certification Framework for the Smart Grid• Establish a brand called ‘Interoperability’ that has a consistent meaning across

the Smart Grid for the buyers of interoperable products.– At this time a set of products deemed interoperable may be interoperable with a 80%,

95%, 99%, or 100% confidence level. Thus to say a product is interoperable has little current meaning in the market place as many purchasing organizations have found.

40

DEFINITIONS• ITCA – Interoperability Testing and Certification Authority • Framework Manual - IPRM – Interoperability Program Reference Manual• ISO 65 - General Requirements for Bodies Operating Product Certification

Systems• ISO 17025 – General Requirements for the Competence of Testing and Calibration

Laboratories • SGTCC Interoperability Test Construction Best Practices – Lists of best practices

not covered in ISO 65 and ISO 17025• SGTCC/CSWG Cyber Security Testing Best/Standard Practices –List of best

practices not covered in ISO 65 and ISO 17025• Interoperability Maturity Assessment Model – looking for IOP products based on

standards NOW.

41

GENERAL STRUCTURE OF THE FRAMEWORK MANUAL

ISO Guide 17025 ISO Guide 65

Best Practices for IOP Test Construction Best/Standard Practices for Cyber Security Test Construction

Introduction, Responsibilities, Rationale, Usage and Checklists

2011 Transition Bootstrap Support Plan for ITCAs

Evaluation Checklist for ITCA Delta to Manual

Framework Manual

42

• ISO Guide 65 contains the requirements necessary for an organization to demonstrate competence to perform certification activities related to the standards or specifications stated in the certification

• ISO Guide 65 criteria include:– Technical competence

• Certifying personnel criteria; accessibility of certification test processes; assessment fairness and integrity and others

– Management systems• Quality management processes, technical dispute resolution processes• Lab qualification criteria, lists of certified products, record control, ongoing certification

maintenance and withdrawal process

• ISO Guide 65 conformance demonstrates a robust, thorough and meaningful certification program

• Implements a monitoring program for IOP products in the field to ensure IOP remains

ISO GUIDE 65 OVERVIEW

43

• ISO 17025 contains all requirements that laboratories need to demonstrate that they – operate a management system, – are technically competent, – are able to generate technically valid results.

• ISO 17025 is the most widely accepted and used standard for the operation of test laboratories

• ISO 17025 applies to any testing laboratory operation (1st, 2nd or 3rd party), with many 3rd party labs formally accredited

• It facilitates acceptance of test results from accredited laboratories and serves as the requirements that formal accreditation bodies apply in assessing laboratories.

ISO 17025 OVERVIEW

44

– Test Suite Specification of a standard used for interoperability or conformance testing shall be managed in the same way as the standard they are derived from.

– IOP Certification test reports shall fully describe the test methodology used including the justification for statistical or deterministic testing.

– A certified interoperable product set shall also be conformant to the standard or profile of the standard.

– The only means to ensure interoperability among products is to perform a full matrix test.

BEST PRACTICES FOR IOP TEST CONSTRUCTION EXAMPLES

45

2011 TRANSITION BOOTSTRAP YEAR• SGTCC, with NIST will help bootstrap the process by offering tutorial help in 2011

to the first few committed ITCAs.– Preliminary review of implementation of ISO 65 and ISO 17025 implemented

processes.– Review and analysis of interoperability test construction best practices.– Other general guidance.

• Maintain a list for the industry showing ITCAs in the process of implementing the Manual.

46

2011 TRANSITION BOOTSTRAP YEAR• SGTCC, with NIST will help bootstrap the process by offering tutorial help in 2011

to the first few committed ITCAs.– Preliminary review of implementation of ISO 65 and ISO 17025 implemented

processes.– Review and analysis of interoperability test construction best practices.– Other general guidance.

• Maintain a list for the industry showing ITCAs in the process of implementing the Manual.

47

COST “ESTIMATES” TO IMPLEMENT THE MANUAL FOR ITCA• Initial

– 4 to 6 man months to implement the processes internally– Consulting help to do so: dependent on ITCA

• Annual– Maintenance of internal Quality processes around ISO 65 and ISO 17025: ½ to 1 person

per year– Audits/accreditation of ISO 65 processes: $10,000 +/- $2,500– Audits/accreditations of ISO 17025 processes: $10,000 +/- $2,500

• ROI– Purchasing organization ROI for implementation of interoperable products is significant

and will in almost all cases offset any additional purchase price by reducing: integration time, installation time and ongoing maintenance .

Note these are estimates and can vary widely depending on the standard.

48

2012 AND BEYOND• ITCAs will be using Test Labs using ISO 17025, and ISO 65 standards and be

accredited by the existing formal accreditation organizations. • SGTCC will maintain lists of SGIP Approved ITCAs (those implementing the

Manual) for a standard and demonstrating the production of interoperable products. The products of the standard will be monitored for interoperability in the field by ITCA and secondarily by SGTCC

• Accreditation Bodies (e.g., NVLAP and ANSI) will periodically audit test labs and certification bodies using the Manual as guidance and re-accredit them. SGTCC will subsequently update the ‘SGIP ITCA Approved List ’.

Note many Test lab now use ISO 17025, but not the IOP best practices. Also many ITCAs do not use ISO 65.

49

NEXT STEPS AND YOUR RESPONSE• Receive SGIP consensus for Manual / Framework• Each SGIP member MUST REQUIRE the purchase of interoperable products to

initiate the monetary incentive for many of the ITCAs to upgrade to the Manual / Framework.

– Note: this is an issue about wide scale interoperability across the smart grid. Having only a percentage requiring interop products will in many ways leave us in our current state.

• SGTCC will offer two Webinars in late November and early December to address questions and concerns. To be announced.

50

QUESTIONS

04/19/2023

Steve WidergrenSGIP Plenary Chair