http: //www.cigre-d2.org / CONSEIL INTERNATIONAL DES GRANDS RESEAUX ELECTRIQUES INTERNATIONAL COUNCIL ON LARGE ELECTRIC SYSTEMS STUDY COMMITTEE D2 INFORMATION SYSTEMS AND TELECOMMUNICATION 2011 Colloquium October 19 to 20, 2011 Buenos Aires – ARGENTINA 1 Preferential Subject N° - 2 Upgrade of Mexico City's downtown Distribution Network Ing. Francisco Javier González Guerra Comisión Federal de Electricidad CFE Mexico [email protected]SUMMARY Big projects of refurbishment and upgrading of metropolitan distribution networks provide an opportunity to introduce new concepts, architecture and solutions that may provide a completely new scenario to improve operability, sustainability and energy efficiency. The paper presents the project of modernization of the distribution network of downtown Mexico City. This modernization process has taken as a guide the Smart Grid model, because one of the objectives is to develop a network that supports advanced services and, from the telecommunications point of view, gives support to future functions that a Smart Grid requires. The project consists in the refurbishment of 261 state switchgears designed according to ANSI C37.74 and C37.60. The paper is focus on the telecommunication requirements since the telecommunications network has to be ready to give support to the services that will let the integration of other elements such as pumps in the vaults, "Intelligent" distribution transformers, position sensors on the vault lids and the future incorporation of IP cameras for surveillance. The telecommunication technology and the network architecture has to be able to seamlessly integrate legacy services based on a serial interface with IP-based advanced services on an Ethernet interface. The project integrates different services such as DNP over TCP/IP for SCADA, IED configuration and Teleprotection.
Transcript
http: //www.cigre-d2.org /
CONSEIL INTERNATIONAL DES GRANDS RESEAUX ELECTRIQUES INTERNATIONAL COUNCIL ON LARGE ELECTRIC SYSTEMS
STUDY COMMITTEE D2 INFORMATION SYSTEMS AND TELECOMMUNICATION
2011 Colloquium October 19 to 20, 2011
Buenos Aires – ARGENTINA
1
Preferential Subject N° - 2
Upgrade of Mexico City's downtown Distribution Network
Ing. Francisco Javier González Guerra Comisión Federal de Electricidad CFE
SUMMARY Big projects of refurbishment and upgrading of metropolitan distribution networks provide an opportunity to introduce new concepts, architecture and solutions that may provide a completely new scenario to improve operability, sustainability and energy efficiency. The paper presents the project of modernization of the distribution network of downtown Mexico City. This modernization process has taken as a guide the Smart Grid model, because one of the objectives is to develop a network that supports advanced services and, from the telecommunications point of view, gives support to future functions that a Smart Grid requires. The project consists in the refurbishment of 261 state switchgears designed according to ANSI C37.74 and C37.60. The paper is focus on the telecommunication requirements since the telecommunications network has to be ready to give support to the services that will let the integration of other elements such as pumps in the vaults, "Intelligent" distribution transformers, position sensors on the vault lids and the future incorporation of IP cameras for surveillance. The telecommunication technology and the network architecture has to be able to seamlessly integrate legacy services based on a serial interface with IP-based advanced services on an Ethernet interface. The project integrates different services such as DNP over TCP/IP for SCADA, IED configuration and Teleprotection.
http: //www.cigre-d2.org /
CONSEIL INTERNATIONAL DES GRANDS RESEAUX ELECTRIQUES INTERNATIONAL COUNCIL ON LARGE ELECTRIC SYSTEMS
STUDY COMMITTEE D2 INFORMATION SYSTEMS AND TELECOMMUNICATION
2011 Colloquium October 19 to 20, 2011
Buenos Aires – ARGENTINA
2
1. INTRODUCTION Since October 2009, Comisión Federal de Electricidad (CFE), took operation of the electric network of Mexico City and surrounding areas which was formerly operated by Luz y Fuerza del Centro (LFC). Mexico City's installations were having the following problems: Old equipment, a fully saturated network that was having constant faults and sabotage attacks from LFC's union workers forced CFE to upgrade the distribution network of downtown Mexico City. This modernization process has taken as a guide the Smart Grid model, because one of the objectives is to develop a network that supports advanced services and, from the telecommunications point of view, gives support to future functions that a Smart Grid requires. The project consists in the refurbishment of 261 state switchgears designed according to ANSI C37.74 and C37.60. The telecommunications network has to support the basic services of protection and control plus other advance services that belong to a Smart Grid. One IED will be doing the functions of control, protection and metering. The telecommunications network will be ready to give support to the services that will let the integration of other elements such as pumps in the vaults, "Intelligent" distribution transformers, position sensors on the vault lids and the future incorporation of IP cameras for surveillance. One of the fundamental characteristics of the designed telecommunication network is the capability of a seamless integration of legacy services based on a serial interface with IP-based advanced services on an Ethernet interface. The project will integrate communication networks one with DNP over TCP/IP for SCADA and IED configuration and the other based on a serial channel for Teleprotection. One of the challenges to outcome is the integration of real-time services which are highly critical such as Teleprotection and other Ethernet-based. That's why it was chosen to use optic multiplexers that both warranties the mentioned characteristics and offers the required scalability of the Smart Grid. The networks architecture allows to incorporate smart power meters and the fibre optics is the ideal medium for the data transfer of the smart meters' concentrators. The variety of data that is going to be transferred (TCP/IP, serial, video and all the different
http: //www.cigre-d2.org /
CONSEIL INTERNATIONAL DES GRANDS RESEAUX ELECTRIQUES INTERNATIONAL COUNCIL ON LARGE ELECTRIC SYSTEMS
STUDY COMMITTEE D2 INFORMATION SYSTEMS AND TELECOMMUNICATION
2011 Colloquium October 19 to 20, 2011
Buenos Aires – ARGENTINA
3
protocols) took the need to create a transparent and rugged network. For that reason it was required to look for a solution designed according to IEC 61850-3 and CWDM multiplexer. This paper shows the specific requirements of this project, the adopted solutions and the obtained results.
2. SERVICES AND REQUIREMENTS The main goal of the project was to improve power quality and service availability of the power distribution system of Mexico City downtown. Telecom service specification and performance requirements have been obtained from the Power System design. 2.1 Scope of the project The process of modernization of power system distribution was driven by the power distribution requirements. This implied the refurbishment of the high voltage apparatus due to the following reasons:
- Most of them were close to the end of their life-cycle - None of them cannot be remotely operated
The scope of the project was not limited to the refurbishment of Switchgear devices but also included the deployment of a new Telecontrol system and the required protection schemes. Since both systems require telecommunications services, the possibility of deploying a telecommunication network able to support all the new functionalities of a Smart Grid was also considered. Due to the availability of fibre optical infrastructure in most parts of the network, it was decided to deploy an optical network based on Wavelength Division Multiplexing technology. This network will be able to support both Operational Services as well as other services associated to the Smart Grid and the Smart City concept. The paper will focus on the telecommunication network requirements, design and implementation. 2.2 Methodology Due to the complexity and multidisciplinary aspects of the projects, an internal working group was formed in CFE. Specialist from power system planning, protection, control and telecommunication joint this working group. Focusing on the telecommunication aspects, the first step was to agree the actual requirements of protection and control services and the evolution of the new Power System towards a Smart Grid. This was a key driver to define the architecture and technological specifications.
http: //www.cigre-d2.org /
CONSEIL INTERNATIONAL DES GRANDS RESEAUX ELECTRIQUES INTERNATIONAL COUNCIL ON LARGE ELECTRIC SYSTEMS
STUDY COMMITTEE D2 INFORMATION SYSTEMS AND TELECOMMUNICATION
2011 Colloquium October 19 to 20, 2011
Buenos Aires – ARGENTINA
4
The second step was to analyse transmission media requirements and it was pretty clear that fibre optic was required in order to guarantee bandwidth requirements and future scalability of the services that may be deployed in the following years. The study of existing fibre optic infrastructure showed the viability of the project since most of the substations were already interconnected using fibre. Nevertheless, the number of fibres available was quite reduced so the need for an optical multiplexing technique was required. The final step was the definition of the network architecture, service allocation and calculation of the remaining capacity as well as the capability to support new services in a transparent mode. Finally, the network designers should consider that the telecommunication network topology has to use the Power distribution network structure with a node in every substation. This will imply that, for the first deployment stage, the network will be formed by two backbone nodes with 6 trunks everyone associated to a distribution cable. Every trunk line will connect up to 60 substations in series. The two backbone nodes are connected to the IP network so they should implement service recovery mechanisms in order to guarantee an improve service availability. 2.3 Key requirements Network requirements were the starting point for the design of the Telecommunication network. The key aspects were:
- Real-time and deterministic service to support Teleprotection and advanced protection applications.
- Able to support legacy services such as serial channel with traditional Telecontrol protocols
- Support of IEC 61850 both locally and between substations - Able to provide full isolation between public and control services - Able to provide transparent transport services - Cost-effective and compact solution. Due to the limited space available in
underground substations, all the telecommunication function should be provided by single equipment.
- Improved service availability - Powerful maintenance facilities - Telecommunication equipment should operate on a harsh environment and be able to
operate at very high temperatures (85ºC) without fans.
3. NETWORK ARCHITECTURE Simplicity, cost-effectiveness, scalability and service integration were the key drivers considered when network architecture was defined.
http: //www.cigre-d2.org /
CONSEIL INTERNATIONAL DES GRANDS RESEAUX ELECTRIQUES INTERNATIONAL COUNCIL ON LARGE ELECTRIC SYSTEMS
STUDY COMMITTEE D2 INFORMATION SYSTEMS AND TELECOMMUNICATION
2011 Colloquium October 19 to 20, 2011
Buenos Aires – ARGENTINA
5
Due to the fact that the network has to be able to support some services, related to the Smart City concept, that are not well defined yet it is important to use a transparent and open technology so WDM was selected to implement transmission and transport functions. The service layer was structure in two disjoint parts, the legacy service support layer able to transmit serial channels and the Ethernet layer providing transparent Ethernet service. Thanks to this, both IP services and DNP over TCP are supported. Every service is isolated using VLANs which also provide the capability of prioritization between services.
3.1 Optical Layer Once agreed that wavelength division multiplexing technique will be used, the point was to choose between coarse (CWDM) or dense (DWDM) multiplexing. From the comparison between these two technologies, CWDM was selected the main reasons being:
- Higher reliability and less sensible to temperature variations. - Cost-effective. - Simpler to operate and maintain. - Provides enough capacity to implement a Smart Grid and even to support Smart City
services.
3.2 Service Layer The service layer is implemented by means of an Ethernet network distributed in all the substation equipment. Every service is allocated to a VLAN and can be configured with a different priority. This priority can be mapped to a QoS level at the backbone nodes as the QoS level has to be maintained End-to-End. Legacy services based on serial channel will be supported by a serial bus that expands to every node of the network. Service layer is complemented by the two backbone nodes with Layer 3&4 functionality. This will provide the whole network with advanced routing functionality which is required to properly support end-to-end services specially those related with SCADA, Telecontrol, remote maintenance, etc.
3.3 External service provision The optical layer provides extra capacity for future services. The optical layer has been designed to provide two wavelengths in every node. These channels are fully transparent and can carry up to 10 Gbit/s each.
http: //www.cigre-d2.org /
CONSEIL INTERNATIONAL DES GRANDS RESEAUX ELECTRIQUES INTERNATIONAL COUNCIL ON LARGE ELECTRIC SYSTEMS
STUDY COMMITTEE D2 INFORMATION SYSTEMS AND TELECOMMUNICATION
2011 Colloquium October 19 to 20, 2011
Buenos Aires – ARGENTINA
6
4. IMPLEMENTATION AND PRACTICAL RESULTS The construction and refurbishment of the network is going on by the time of writing this paper. Preliminary test of the proposed solution has been successfully carried out. A field trial test was arranged to assess transmission performance related to protection applications and Teleprotection. A six month non-stop trial was carried out without any disruption being reported. The test is still under operation and is a good platform to verify new smart grid services. The following picture shows the block diagram of the substation node. Optical layer components are fully passive which means a very high availability. Ethernet layer functionality is included in the same equipment providing support for the substation LAN that interconnects IEC 61850 IEDs.
Equipment monitoring and management is carried out through and SNMP agent that is connected to the Ethernet service and using the IP connectivity provided by the IP nodes get connected with the network management centre.
5. CONCLUSIONS The project of modernization of the distribution network of downtown Mexico City has a very important social impact. On one hand, the former blackouts and service disruptions will be solved due to the refurbishment of high voltage apparatus and the deployment of new protection and control systems, one the other hand, the deployment of a full optical network
SUBSTATION LAN
http: //www.cigre-d2.org /
CONSEIL INTERNATIONAL DES GRANDS RESEAUX ELECTRIQUES INTERNATIONAL COUNCIL ON LARGE ELECTRIC SYSTEMS
STUDY COMMITTEE D2 INFORMATION SYSTEMS AND TELECOMMUNICATION
2011 Colloquium October 19 to 20, 2011
Buenos Aires – ARGENTINA
7
pave the way to the implementation of smart grid services based on the availability of Ethernet and IP services. The new protection and control system will allow for the implementation of advanced demand management systems since it will be very easy to provide access to customer and deploy interactive services. The access to customer premises can be implemented whether using Fibre optics or by means of PLC links. Both cases provide enough capacity to offer advanced broadband interactive services. Furthermore, the new protection and control system paves the way to the implementation and control of charging stations for electrical vehicles and also the possibility to implement new SCADA and DMS procedure to optimise energy efficiency in the overall distribution network. The great capacity of the optical network deployed provides the municipality with a platform to deploy a number of advanced services such as video surveillance, public WiFi access points, dynamic information displays, etc.
CURRENT NETWORK CONDITIONS Insecure network with frequent explosions and fires Improper installation of equipment in buildings Wiring direct burial High energy losses Lack of electric planes High maintenance costs Obsolete equipment
http: //www/
.cigre-d2.org
CONI
STUDYINFORMA
FUT
NSEIL INTERNINTERNATION
Y COMMITATION SYSTE
B
TURE NETW
NATIONAL DNAL COUNCI
TTEE D2 EMS AND TEL
2011 October
Buenos Aire
WORK DIA Secur Moni Mode Transstand Hand Modeoil Hous Low
