LLNL-PRES-673302
This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under contract DE-AC52-07NA27344. Lawrence Livermore National Security, LLC
Presented to PSERC summer workshop
July 14th, 2015
Liang Min
925-422-1187
Lawrence Livermore National Laboratory LLNL-PRES-673302 2
2500-house distribution system
model
2500-house distribution system
model with high penetration of PV
Renewables and electric energy storage in the distribution network will have
significant impacts throughout the entire network
Lawrence Livermore National Laboratory LLNL-PRES-673302 3
Lawrence Livermore National Laboratory LLNL-PRES-673302 4
National labs are investing on multi-scale
grid modeling and simulation
PNNL’s FNCS (Matpower+Gridlab-D+NS3)
LLNL’s Pargrid (GridDyn+Gridlab-D+NS3)
NREL IGMS (Matpower+Gridlab-D)
ORNL (NS2/adevs)
GMLC – Integrated T&D&C
Lawrence Livermore National Laboratory LLNL-PRES-673302 5
Lawrence Livermore National Laboratory LLNL-PRES-673302 6
Root finding and synchronization in FSKIT
Lawrence Livermore National Laboratory LLNL-PRES-673302 7
2
1
3
4
5
6
7
8
9
10
11
1314
15
16
17
18
19
21
22
23
24
25
26
27
28
29
39
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r rr
r
r
r
r
r
r
2-3
2-25
2-1
25-2
25-26
29-26
29-28
26-29
26-27
7-87-6
1-2
1-39
39-1
39-9
5-85-4
5-6
16-17
16-15
16-21
16-19
16-24
6-5
6-7
6-11
11-10
11-6
24-23
24-16
15-16
15-14
14-1514-13 14-4
13-14
13-10
10-13
10-11
4-14
4-5
4-3
18-17
18-3
3-43-18
3-2
8-5
8-9
8-7
9-39
9-8
26-28
26-25
28-29
28-26
19-16
27-17 27-26
17-16
17-27
17-1823-22
23-24
21-2221-16
22-23 22-21
16
19
21
22
23
24
r
rr
r
r
r
16-17
16-15
16-21
16-19
16-24
24-23
24-16
19-16
23-22
23-24
21-2221-16
22-23 22-21
26
28
29
r
r
r
29-26
29-28
26-29
26-27
26-28
26-25
28-29
28-26
Original Single Line Diagram
IEEE 39-bus System
Resultant Communication
System Model 2
1
3
4
5
6
7
8
9
10
11
1314
15
16
17
18
19
21
22
23
24
25
26
27
28
29
39
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r rr
r
r
r
r
r
r
NSubstation LAN
for bus N
r Gateway Router
A-B Protection Relay for end A of transmission line A to B
Point-to-Point Link
CSMA Link
2-3
2-25
2-1
25-2
25-26
29-26
29-28
26-29
26-27
7-87-6
1-2
1-39
39-1
39-9
5-85-4
5-6
16-17
16-15
16-21
16-19
16-24
6-5
6-7
6-11
11-10
11-6
24-23
24-16
15-16
15-14
14-1514-13 14-4
13-14
13-10
10-13
10-11
4-14
4-5
4-3
18-17
18-3
3-43-18
3-2
8-5
8-9
8-7
9-39
9-8
26-28
26-25
28-29
28-26
19-16
27-17 27-26
17-16
17-27
17-1823-22
23-24
21-2221-16
22-23 22-21
NSubstation LAN
for bus N
r Gateway Router
A-B
ns-3 Smart Grid Application (protection relay) for end A of transmission line A to B
Point-to-Point Link (propagation delay
proportional to transmission line reactance)
CSMA Link (5µs propagation delay)
Lawrence Livermore National Laboratory LLNL-PRES-673302 8
f, g and h are all functions of V1, V2, , and
Communication between objects in
federated simulators
The grid simulation assumption was made that
the time-scales on the distribution network do
not impact the transmission system.
Q&A
Thank You
Lawrence Livermore National Laboratory LLNL-PRES-673302 10
Small toolkit for coupling continuous and discrete time simulations
Provides
• Time control for advancing state of federated simulators
• Communication between objects in federated simulators
Designed for HPC • Asynchronous API design
• MPI used as communication layer
• Parallel conservative granted time window synchronization algorithm
Lawrence Livermore National Laboratory LLNL-PRES-673302 11
• We have built our own transmission simulator prototype. It is written
in C++ and use SUNDIALS/IDA and KINSOL as the solvers.
Software components are independent, reusable, and replaceable.
• Distribution simulator (GridLab-D) was modified and enhanced for
HPC.
Lawrence Livermore National Laboratory LLNL-PRES-673302 12
On-going work
Interface the scaled-up coupled transmission and
distribution simulator at LLNL and the PG&E’s DTY to
form a close-loop validation environment.
Lawrence Livermore National Laboratory LLNL-PRES-673302 13
2
1
3
4
5
6
7
8
9
10
11
1314
15
16
17
18
19
21
22
23
24
25
26
27
28
29
39
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r rr
r
r
r
r
r
r
2-3
2-25
2-1
25-2
25-26
29-26
29-28
26-29
26-27
7-87-6
1-2
1-39
39-1
39-9
5-85-4
5-6
16-17
16-15
16-21
16-19
16-24
6-5
6-7
6-11
11-10
11-6
24-23
24-16
15-16
15-14
14-1514-13 14-4
13-14
13-10
10-13
10-11
4-14
4-5
4-3
18-17
18-3
3-43-18
3-2
8-5
8-9
8-7
9-39
9-8
26-28
26-25
28-29
28-26
19-16
27-17 27-26
17-16
17-27
17-1823-22
23-24
21-2221-16
22-23 22-21
16
19
21
22
23
24
r
rr
r
r
r
16-17
16-15
16-21
16-19
16-24
24-23
24-16
19-16
23-22
23-24
21-2221-16
22-23 22-21
26
28
29
r
r
r
29-26
29-28
26-29
26-27
26-28
26-25
28-29
28-26
Original Single Line Diagram
IEEE 39-bus System
Resultant Communication
System Model 2
1
3
4
5
6
7
8
9
10
11
1314
15
16
17
18
19
21
22
23
24
25
26
27
28
29
39
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r
r rr
r
r
r
r
r
r
NSubstation LAN
for bus N
r Gateway Router
A-B Protection Relay for end A of transmission line A to B
Point-to-Point Link
CSMA Link
2-3
2-25
2-1
25-2
25-26
29-26
29-28
26-29
26-27
7-87-6
1-2
1-39
39-1
39-9
5-85-4
5-6
16-17
16-15
16-21
16-19
16-24
6-5
6-7
6-11
11-10
11-6
24-23
24-16
15-16
15-14
14-1514-13 14-4
13-14
13-10
10-13
10-11
4-14
4-5
4-3
18-17
18-3
3-43-18
3-2
8-5
8-9
8-7
9-39
9-8
26-28
26-25
28-29
28-26
19-16
27-17 27-26
17-16
17-27
17-1823-22
23-24
21-2221-16
22-23 22-21
NSubstation LAN
for bus N
r Gateway Router
A-B
ns-3 Smart Grid Application (protection relay) for end A of transmission line A to B
Point-to-Point Link (propagation delay
proportional to transmission line reactance)
CSMA Link (5µs propagation delay)
Total has about 100 communication nodes
Lawrence Livermore National Laboratory LLNL-PRES-673302 14
We could vary the line latency and the
throughput to assess different control
schemes. As the WAN latency
increases, trip times increase, which
affects system voltage recovery.
Supervisory (master agent) wide area control scenario:
fault at Bus 4 at t=0.2s and clear the fault at t=0.35s
Ad-hoc (peer to peer) protection relay systems scenario:
Bus fault at Bus 4 at t=0.2s and clear the fault at t=0.25s
Delayed Voltage
Recovery due to
long fault clear time
Lawrence Livermore National Laboratory LLNL-PRES-673302 15
Test Case – Coupled Transmission and
Distribution System Model
PG&E Feeder Model
IEEE 13 Feeder Model
WECC Transmission Model (180 buses)
• Assigned one distribution feeder simulation to one
core, the whole transmission simulation to one core.
• Increased load on Bus 140 by connecting more
distribution feeders to that transmission bus and
monitored what happens to the bus voltage.
• Goal is to run larger distribution problem in same
amount of time
Lawrence Livermore National Laboratory LLNL-PRES-673302 16
Test Case – Using scaled-up demand response
at the distribution level to offset the need for
load shedding to avoid voltage collapse
Background:
• As CAISO studied, after the SONGS retirement,
voltage stability collapse became the limiting
constraint in LA basin.
• The urgency to scale-up demand response is high
to maintain a reliable electric system, particularly
in Southern California, in the absence of the San
Onofre Nuclear Generating Station (SONGS).
1 T+ 1GridLab-D 1 T+ 63Gridlab-D
1 T+ 511Gridlab-D
2% DR was called to
offset the need of load
shedding to avoid
voltage collapse