LLNL-PRES-673302

This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under contract DE-AC52-07NA27344. Lawrence Livermore National Security, LLC

Presented to PSERC summer workshop

July 14th, 2015

Liang Min

min2@llnl.gov

925-422-1187

Lawrence Livermore National Laboratory LLNL-PRES-673302 2

2500-house distribution system

model

2500-house distribution system

model with high penetration of PV

Renewables and electric energy storage in the distribution network will have

significant impacts throughout the entire network

Lawrence Livermore National Laboratory LLNL-PRES-673302 3

Lawrence Livermore National Laboratory LLNL-PRES-673302 4

National labs are investing on multi-scale

grid modeling and simulation

PNNL’s FNCS (Matpower+Gridlab-D+NS3)

LLNL’s Pargrid (GridDyn+Gridlab-D+NS3)

NREL IGMS (Matpower+Gridlab-D)

ORNL (NS2/adevs)

GMLC – Integrated T&D&C

Lawrence Livermore National Laboratory LLNL-PRES-673302 5

Lawrence Livermore National Laboratory LLNL-PRES-673302 6

Root finding and synchronization in FSKIT

Lawrence Livermore National Laboratory LLNL-PRES-673302 7

2

1

3

4

5

6

7

8

9

10

11

1314

15

16

17

18

19

21

22

23

24

25

26

27

28

29

39

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r rr

r

r

r

r

r

r

2-3

2-25

2-1

25-2

25-26

29-26

29-28

26-29

26-27

7-87-6

1-2

1-39

39-1

39-9

5-85-4

5-6

16-17

16-15

16-21

16-19

16-24

6-5

6-7

6-11

11-10

11-6

24-23

24-16

15-16

15-14

14-1514-13 14-4

13-14

13-10

10-13

10-11

4-14

4-5

4-3

18-17

18-3

3-43-18

3-2

8-5

8-9

8-7

9-39

9-8

26-28

26-25

28-29

28-26

19-16

27-17 27-26

17-16

17-27

17-1823-22

23-24

21-2221-16

22-23 22-21

16

19

21

22

23

24

r

rr

r

r

r

16-17

16-15

16-21

16-19

16-24

24-23

24-16

19-16

23-22

23-24

21-2221-16

22-23 22-21

26

28

29

r

r

r

29-26

29-28

26-29

26-27

26-28

26-25

28-29

28-26

Original Single Line Diagram

IEEE 39-bus System

Resultant Communication

System Model 2

1

3

4

5

6

7

8

9

10

11

1314

15

16

17

18

19

21

22

23

24

25

26

27

28

29

39

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r rr

r

r

r

r

r

r

NSubstation LAN

for bus N

r Gateway Router

A-B Protection Relay for end A of transmission line A to B

Point-to-Point Link

CSMA Link

2-3

2-25

2-1

25-2

25-26

29-26

29-28

26-29

26-27

7-87-6

1-2

1-39

39-1

39-9

5-85-4

5-6

16-17

16-15

16-21

16-19

16-24

6-5

6-7

6-11

11-10

11-6

24-23

24-16

15-16

15-14

14-1514-13 14-4

13-14

13-10

10-13

10-11

4-14

4-5

4-3

18-17

18-3

3-43-18

3-2

8-5

8-9

8-7

9-39

9-8

26-28

26-25

28-29

28-26

19-16

27-17 27-26

17-16

17-27

17-1823-22

23-24

21-2221-16

22-23 22-21

NSubstation LAN

for bus N

r Gateway Router

A-B

ns-3 Smart Grid Application (protection relay) for end A of transmission line A to B

Point-to-Point Link (propagation delay

proportional to transmission line reactance)

CSMA Link (5µs propagation delay)

Lawrence Livermore National Laboratory LLNL-PRES-673302 8

f, g and h are all functions of V1, V2, , and

Communication between objects in

federated simulators

The grid simulation assumption was made that

the time-scales on the distribution network do

not impact the transmission system.

Q&A

Thank You

Lawrence Livermore National Laboratory LLNL-PRES-673302 10

Small toolkit for coupling continuous and discrete time simulations

Provides

• Time control for advancing state of federated simulators

• Communication between objects in federated simulators

Designed for HPC • Asynchronous API design

• MPI used as communication layer

• Parallel conservative granted time window synchronization algorithm

Lawrence Livermore National Laboratory LLNL-PRES-673302 11

• We have built our own transmission simulator prototype. It is written

in C++ and use SUNDIALS/IDA and KINSOL as the solvers.

Software components are independent, reusable, and replaceable.

• Distribution simulator (GridLab-D) was modified and enhanced for

HPC.

Lawrence Livermore National Laboratory LLNL-PRES-673302 12

On-going work

Interface the scaled-up coupled transmission and

distribution simulator at LLNL and the PG&E’s DTY to

form a close-loop validation environment.

Lawrence Livermore National Laboratory LLNL-PRES-673302 13

2

1

3

4

5

6

7

8

9

10

11

1314

15

16

17

18

19

21

22

23

24

25

26

27

28

29

39

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r rr

r

r

r

r

r

r

2-3

2-25

2-1

25-2

25-26

29-26

29-28

26-29

26-27

7-87-6

1-2

1-39

39-1

39-9

5-85-4

5-6

16-17

16-15

16-21

16-19

16-24

6-5

6-7

6-11

11-10

11-6

24-23

24-16

15-16

15-14

14-1514-13 14-4

13-14

13-10

10-13

10-11

4-14

4-5

4-3

18-17

18-3

3-43-18

3-2

8-5

8-9

8-7

9-39

9-8

26-28

26-25

28-29

28-26

19-16

27-17 27-26

17-16

17-27

17-1823-22

23-24

21-2221-16

22-23 22-21

16

19

21

22

23

24

r

rr

r

r

r

16-17

16-15

16-21

16-19

16-24

24-23

24-16

19-16

23-22

23-24

21-2221-16

22-23 22-21

26

28

29

r

r

r

29-26

29-28

26-29

26-27

26-28

26-25

28-29

28-26

Original Single Line Diagram

IEEE 39-bus System

Resultant Communication

System Model 2

1

3

4

5

6

7

8

9

10

11

1314

15

16

17

18

19

21

22

23

24

25

26

27

28

29

39

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r

r rr

r

r

r

r

r

r

NSubstation LAN

for bus N

r Gateway Router

A-B Protection Relay for end A of transmission line A to B

Point-to-Point Link

CSMA Link

2-3

2-25

2-1

25-2

25-26

29-26

29-28

26-29

26-27

7-87-6

1-2

1-39

39-1

39-9

5-85-4

5-6

16-17

16-15

16-21

16-19

16-24

6-5

6-7

6-11

11-10

11-6

24-23

24-16

15-16

15-14

14-1514-13 14-4

13-14

13-10

10-13

10-11

4-14

4-5

4-3

18-17

18-3

3-43-18

3-2

8-5

8-9

8-7

9-39

9-8

26-28

26-25

28-29

28-26

19-16

27-17 27-26

17-16

17-27

17-1823-22

23-24

21-2221-16

22-23 22-21

NSubstation LAN

for bus N

r Gateway Router

A-B

ns-3 Smart Grid Application (protection relay) for end A of transmission line A to B

Point-to-Point Link (propagation delay

proportional to transmission line reactance)

CSMA Link (5µs propagation delay)

Total has about 100 communication nodes

Lawrence Livermore National Laboratory LLNL-PRES-673302 14

We could vary the line latency and the

throughput to assess different control

schemes. As the WAN latency

increases, trip times increase, which

affects system voltage recovery.

Supervisory (master agent) wide area control scenario:

fault at Bus 4 at t=0.2s and clear the fault at t=0.35s

Ad-hoc (peer to peer) protection relay systems scenario:

Bus fault at Bus 4 at t=0.2s and clear the fault at t=0.25s

Delayed Voltage

Recovery due to

long fault clear time

Lawrence Livermore National Laboratory LLNL-PRES-673302 15

Test Case – Coupled Transmission and

Distribution System Model

PG&E Feeder Model

IEEE 13 Feeder Model

WECC Transmission Model (180 buses)

• Assigned one distribution feeder simulation to one

core, the whole transmission simulation to one core.

• Increased load on Bus 140 by connecting more

distribution feeders to that transmission bus and

monitored what happens to the bus voltage.

• Goal is to run larger distribution problem in same

amount of time

Lawrence Livermore National Laboratory LLNL-PRES-673302 16

Test Case – Using scaled-up demand response

at the distribution level to offset the need for

load shedding to avoid voltage collapse

Background:

• As CAISO studied, after the SONGS retirement,

voltage stability collapse became the limiting

constraint in LA basin.

• The urgency to scale-up demand response is high

to maintain a reliable electric system, particularly

in Southern California, in the absence of the San

Onofre Nuclear Generating Station (SONGS).

1 T+ 1GridLab-D 1 T+ 63Gridlab-D

1 T+ 511Gridlab-D

2% DR was called to

offset the need of load

shedding to avoid

voltage collapse