+ All Categories
Home > Documents > Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of...

Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of...

Date post: 01-Sep-2019
Category:
Upload: others
View: 11 times
Download: 0 times
Share this document with a friend
14
1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Sch¨ afer, Christian Beck, and Vito Latora Abstract—As the energy transition transforms power grids across the globe, it poses several challenges regarding grid design and control. In particular, high levels of intermittent renewable generation complicate the task of continuously balancing power supply and demand, requiring sufficient control actions. Although there exist several proposals to control the grid, most of them have not demonstrated to be cost efficient in terms of optimal control theory. Here, we mathematically formulate an op- timal centralized (therefore non-local) control problem for stable operation of power grids and determine the minimal amount of active power necessary to guarantee a stable service within the operational constraints, minimizing a suitable cost function at the same time. This optimal control can be used to benchmark control proposals and we demonstrate this benchmarking process by investigating the performance of three distributed controllers, two of which are fully decentralized, that have been recently studied in the physics and power systems engineering literature. Our results show that cost efficient controllers distribute the controlled response amongst all nodes in the power grid. Additionally, superior performance can be achieved by incorporating sufficient information about the disturbance causing the instability. Overall, our results can help design and benchmark secure and cost-efficient controllers. Index terms— Optimal control, Power control, Power system control, Power system dynamics, Power system stability. I. I NTRODUCTION The electrical power grid is undergoing drastic changes due to the energy transition [1]–[3] and suitable Financial support received from the UK Engineering and Physical Sciences Research Council (EPSRC Reference: EP/N013492/1) and the German Federal Ministry of Education and Research (BMBF grant no. 03SF0472A-F). Randall Martyr, Christian Beck and Vito Latora are with the School of Mathematical Sciences, Queen Mary University of Lon- don, Mile End Road, London E1 4NS, United Kingdom (e-mail: [email protected]; [email protected]; [email protected]). Vito Latora is also with the Dipartimento di Fisica ed Astronomia, Universit` a di Catania and INFN, I-95123 Catania, Italy. Benjamin Sch¨ afer is with the Chair for Network Dynamics, Tech- nical University of Dresden and Max Planck Institute for Dynamics and Self-Organization (MPIDS), 37077 G¨ ottingen, Germany (e-mail: [email protected]). Table I NOMENCLATURE USED IN THIS PAPER.VECTORS AND MATRICES ARE DENOTED IN BOLDFACE. Notation Description Units Synchronous machine parameters N the set of nodes {1,...,N } where N 2 is the number of nodes in the network Ω synchronous angular velocity used as reference rad · s -1 B N × N -dimensional matrix of line sus- ceptances pu Mi inertia coefficient s 2 Di damping coefficient pu E f,i exciter voltage pu X d,i direct synchronous reactance pu X 0 d,i direct synchronous transient reactance pu T 0 do,i direct axis transient time constant s Pe,i electromagnetic air-gap power pu Pin,i net power injection, the difference be- tween mechanical power and aggregate load pu Synchronous machine state quantities θi rotor angle relative to the grid reference rad ωi angular velocity relative to the grid reference rad · s -1 Vi normalized machine voltage pu ξi disturbance to net power injection pu σ(ω) standard deviation of network angular velocities rad · s -1 hωi mean value of network angular veloci- ties rad · s -1 Optimization parameters and variables T control time horizon s x 3N -dimensional state vector u N -dimensional vector of controlled power injections pu U set of control variables J , Cη , εη cost functional, constraint functional, constraint tolerance arXiv:1802.06647v2 [math.OC] 6 Aug 2018
Transcript
Page 1: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

1

Benchmarking the performance of controllers forpower grid transient stability

Randall Martyr, Benjamin Schafer, Christian Beck, and Vito Latora

Abstract—As the energy transition transforms powergrids across the globe, it poses several challenges regardinggrid design and control. In particular, high levels ofintermittent renewable generation complicate the taskof continuously balancing power supply and demand,requiring sufficient control actions. Although there existseveral proposals to control the grid, most of them havenot demonstrated to be cost efficient in terms of optimalcontrol theory. Here, we mathematically formulate an op-timal centralized (therefore non-local) control problem forstable operation of power grids and determine the minimalamount of active power necessary to guarantee a stableservice within the operational constraints, minimizing asuitable cost function at the same time. This optimalcontrol can be used to benchmark control proposals and wedemonstrate this benchmarking process by investigatingthe performance of three distributed controllers, two ofwhich are fully decentralized, that have been recentlystudied in the physics and power systems engineeringliterature. Our results show that cost efficient controllersdistribute the controlled response amongst all nodes inthe power grid. Additionally, superior performance canbe achieved by incorporating sufficient information aboutthe disturbance causing the instability. Overall, our resultscan help design and benchmark secure and cost-efficientcontrollers.

Index terms— Optimal control, Power control, Powersystem control, Power system dynamics, Power systemstability.

I. INTRODUCTION

The electrical power grid is undergoing drasticchanges due to the energy transition [1]–[3] and suitable

Financial support received from the UK Engineering and PhysicalSciences Research Council (EPSRC Reference: EP/N013492/1) andthe German Federal Ministry of Education and Research (BMBFgrant no. 03SF0472A-F).

Randall Martyr, Christian Beck and Vito Latora are with theSchool of Mathematical Sciences, Queen Mary University of Lon-don, Mile End Road, London E1 4NS, United Kingdom (e-mail:[email protected]; [email protected]; [email protected]).

Vito Latora is also with the Dipartimento di Fisica ed Astronomia,Universita di Catania and INFN, I-95123 Catania, Italy.

Benjamin Schafer is with the Chair for Network Dynamics, Tech-nical University of Dresden and Max Planck Institute for Dynamicsand Self-Organization (MPIDS), 37077 Gottingen, Germany (e-mail:[email protected]).

Table INOMENCLATURE USED IN THIS PAPER. VECTORS AND MATRICES

ARE DENOTED IN BOLDFACE.

Notation Description Units

Synchronous machine parametersN the set of nodes 1, . . . , N where

N ≥ 2 is the number of nodes in thenetwork

Ω synchronous angular velocity used asreference

rad · s−1

B N ×N -dimensional matrix of line sus-ceptances

pu

Mi inertia coefficient s2

Di damping coefficient pu

Ef,i exciter voltage pu

Xd,i direct synchronous reactance pu

X ′d,i direct synchronous transient reactance pu

T ′do,i direct axis transient time constant s

Pe,i electromagnetic air-gap power pu

Pin,i net power injection, the difference be-tween mechanical power and aggregateload

pu

Synchronous machine statequantities

θi rotor angle relative to the grid reference rad

ωi angular velocity relative to the gridreference

rad · s−1

Vi normalized machine voltage pu

ξi disturbance to net power injection pu

σ(ω) standard deviation of network angularvelocities

rad · s−1

〈ω〉 mean value of network angular veloci-ties

rad · s−1

Optimization parameters andvariables

T control time horizon s

x 3N -dimensional state vector –

u N -dimensional vector of controlledpower injections

pu

U set of control variables –

J , Cη , εη cost functional, constraint functional,constraint tolerance

arX

iv:1

802.

0664

7v2

[m

ath.

OC

] 6

Aug

201

8

Page 2: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

2

control approaches are necessary to ensure a reliable andstable operation [4]. The generation side of the grid ischanging as additional renewable generators are installedto mitigate climate change, introducing fluctuations on atime scale of days [5] to sub-seconds [6]. In addition, thedemand side is changing due to the ongoing electrifica-tion of heating and transport [7] and the introductionof demand control [8]. Regardless of these changingconditions, the grid needs to stay within strict operationalboundaries to guarantee a stable electricity supply andto prevent damage to sensitive electronic devices [4].

A fundamental aspect of power system stability isthe ability of interconnected synchronous machines ofa power system to remain synchronized. Transient sta-bility describes the power system’s ability to maintainsynchronism in the face of severe transient disturbances[4], and is of great importance in preventing cascadingfailures [9]–[11]. Control mechanisms that balance activepower and regulate frequency in the grid are key tomaintaining these stability conditions. Primary controls[12] respond within a few seconds of an event to stabilizethe frequency within its permissible operating limits,after which secondary [13], [14] and tertiary controlsrestore the frequency to its nominal value [15].

In this paper we describe control algorithms fornetworked systems (such as the power grid) as beingcentralized if a central controller performs computationsand issues control actions for the entire network, dis-tributed if there are multiple autonomous controllers thatperform computations and can communicate with eachother, and decentralized if there are multiple autonomouscontrollers that perform computations but do not com-municate with each other. Our definition intentionallypermits distributed controllers that do not communicatewith each other, thus making decentralized controllersa special case, albeit degenerate. Distributed approachesare often supported via advanced power electronics [16]and economic considerations [17] to further improvethe grid’s stability. For large-scale networks, centralizedcontrol schemes can be computationally complex andimpractical, thereby making distributed control schemeswith low computation and communication complexitymore desirable [18]. Decentralized controllers are popu-lar choices since they rely only on local measurements,but they can have poor system-wide performance inpractice [18], [19]. For a discussion on the strengths andlimitations of centralized, decentralized and distributedcontrollers for power systems see [18].

In this paper we seek to answer the following ques-tion: What are the characteristics of a controller thatefficiently synchronizes the power grid in the presenceof known disturbances caused by changes in demand and

generation? We answer this question by investigating thesolution to an optimal control problem (see [20], [21])for synchronization of a power grid described by a net-work of control areas (nodes) N . Note that the optimalcontrol has complete information regarding the temporalevolution of the disturbance at all nodes in the network.Therefore, it constitutes the ideal controller in terms ofperformance and any realistic controller, centralized ordistributed, can be compared in its performance to theoptimal one. In this paper, we use the optimal control toexemplarily benchmark the following three distributedcontrol schemes, two of which are fully decentralized.

Schafer et al [22], [23] recently investigated a decen-tralized linear local frequency (LLF) controller, linkedto a patent [24], that can improve the grid’s transientstability by regulating electricity demand and supplythrough economic incentives. The control action at areai ∈ N is directly proportional to ωi, the local angularvelocity deviation relative to the grid reference,

ui(t) := −νiωi(t) i ∈ N , (1)

with νi > 0. The constant νi in (1) measures thewillingness at node i to change the active power leveland effectively increases the damping parameter from Di

to Di + νi in the grid dynamics (6) below.In [25], [26] the following integral local frequency

(ILF) control is studied,

ui(t) := − 1

κi

∫ t

0ωi(τ)dτ, i ∈ N , (2)

where κi > 0. The integral control (2) can improve thepower grid’s synchronization and stability, and can beeconomically efficient in a particular sense [25], [26].

Finally, we consider the following gather-and-broadcast (GAB) distributed controller which is a specialcase of the one defined in [27],

ui(t) := − 1

µi

∫ t

0

N∑j=1

Aijωj(τ)dτ, i ∈ N , (3)

where µi > 0 and A = (Aij)(i,j)∈N×N is an unweightedadjacency matrix, Aij ∈ 0, 1 and Aij = Aji, thatdefines a communication network between the controlareas. If Aij = 1 when i = j and Aij = 0 otherwise,then the GAB controller (3) reduces to the decentralizedintegral controller (2). In this paper we consider the spe-cial case of a fully connected communication network,Aij = 1 for all (i, j) ∈ N ×N , which leads to,

ui(t) := − 1

µi

∫ t

0

N∑j=1

ωj(τ)dτ

= −Nµi

∫ t

0

∑Nj=1 ωj(τ)

Ndτ, i ∈ N , (4)

Page 3: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

3

thereby making the GAB controller proportional to thetime integral of the mean angular velocity.

In the following section we present the optimal controlproblem for power grid synchronization. The power griddynamics are given by a system of ordinary differentialequations for a state vector x of phase angles, angularvelocity deviations (related to the grid frequency) andvoltage amplitudes. Let U be a suitable set of time-dependent control variables u. For a given u ∈ U ,we quantify its cost through a cost function J(u), andevaluate its performance with respect to various oper-ational constraints Cη(u) and their tolerances εη. Theoptimal control problem for power grid synchronizationis expressed mathematically as follows.

Problem:

minimize J(u) subject to:

i) x(t) = f(t,x(t),u(t)), x(0) = x0;

ii) u ∈ U ;

iii) Cη(u) ≤ εη for η = 1, . . . , N + 2,(5)

where f governs the intrinsic dynamics of thestate of the grid (see (6) below), and N ≥ 2 isthe number of nodes in its representation as anetwork.

Problem (5) is solved numerically using a controlparametrization method [28] that is outlined in the Ap-pendix. In Section III we illustrate the efficiency of theoptimal control compared to the three proposed controls,(1), (2) and (4), for a four-node network motif. Finally,in Section IV we close with a conclusion and outlook.

Our results show that the optimal control achieves su-perior performance with respect to cost whilst achievingcomparable and, in some respects, better performancewith respect to the operational constraints. However,this superiority is a consequence of the optimal controlutilizing its knowledge of the disturbance to form a pre-emptive response. Realistic controllers will not have thisinformation for random disturbances and will thereforerequire larger investments than the optimal control. Nev-ertheless, since the distributed controllers we investigatedo not explicitly incorporate any information about thedisturbance, we postulate that realistic controllers canachieve superior performance if they incorporate someof this information. Regularly occurring disturbances,for instance those caused by economic effects [29] orsteep gradients due to the sun rising (similar to therecent solar eclipse) [30], provide important examplesin which information about the disturbance may beobtained practically.

II. AN OPTIMAL CONTROL PROBLEM FOR POWER

GRID TRANSIENT STABILITY

This section details the optimal control problem (5)that we use to benchmark the distributed (including de-centralized) controllers’ performances. However, beforefocusing on optimal control we need to discuss the modelthat we use for the intrinsic dynamics of the power grid.

A. Dynamics for transient stability analysis

The rotor mechanical velocities of the interconnectedsynchronous machines in a power grid must be synchro-nized to the same frequency, else there can be deviationsin the rotor angles that lead to instabilities [4, p. 19]. Asevere transient disturbance can cause large deviations inthe rotor angles, which may lead to a progressive drop inthe nodal voltages [4, p. 27] and further affect the angularvelocities and rotor angle values. A realistic model ofthe power grid should therefore take the influence of therotor angles’ deviations on the voltage amplitudes intoaccount. This allows us to analyze slower phenomenasuch as large deviations in voltage or frequency, astypically done in mid-term stability studies [4, p. 34].Therefore, in this paper we use a third order model[31, p. 456], which describes the power grid as anetwork of N ≥ 2 control areas, each represented bya synchronous generator or motor and governed by a setof differential equations for the rotor angle θi, angularvelocity deviation ωi, and voltage Vi at each node,

(i) θi = ωi

(ii) Miωi = Pin,i − Pe,i + ui −Diωi

(iii) T ′do,iVi = Ef,i − Vi + Id,i(Xd,i −X ′d,i

),

for i = 1, 2, . . . , N,

(6)

where Pin,i is the net power injection, ui is the controlledactive power, Pe,i is the electrical power,

Pe,i =

N∑j=1

Bi,j sin(θi − θj)ViVj ,

Id,i is the armature current,

Id,i =

N∑j=1

Bi,j cos(θi − θj)Vj ,

and Mi, Di, T ′do,i, Xd,i, X ′d,i and Ef,i are parameters de-scribed in Table I. This model assumes a lossless networkand a constant exciter voltage (emf) Ef,i. It also neglectstransient saliency power and ignores damping effectsproduced by eddy currents. Note that ωi represents thedeviation of the rotor angle velocity from a synchronizedstate 2πF , where F is the reference frequency in Hertz.

Page 4: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

4

However, for brevity we will often say “angular velocity”instead of “angular velocity deviation”.

A positive value for Pin,i indicates net generationat node i and in this case we refer to this node asa generator. A negative value of Pin,i indicates netconsumption at node i and in this case we refer to thisnode as a consumer or motor. We refer to positive valuesfor the control variable ui as incremental actions [32]since they correspond to an increase in generation oran equivalent decrease in demand. Similarly, we referto negative values for ui as decremental actions [32]since they correspond to a decrease in generation or anequivalent increase in demand.

B. Operational constraints of the power grid

Let x = (x1, . . . , x3N ) denote the 3N -dimensionalcontrolled state variable obtained from (6) with compo-nents given by

xi = θi, xN+i = ωi, x2N+i = Vi for i ∈ N . (7)

The dynamics of x in (6) can be written compactly as

x(t) = f(t,x(t),u(t)), (8)

where expressions for the components of the intrinsicdynamics f = (f1, . . . , f3N ) are obtained from (6) usingthe assignment given in (7). Each component of thecontrol variable u = (u1, . . . , un) corresponds to theamount of additional active power injected or withdrawnat an individual node in the network. We assume thatcontrols are bounded: for each i ∈ N we have ui(t) ∈ Uiwhere:

Ui = [umini , umaxi ], −∞ < umini < umaxi <∞. (9)

Let U denote the set of all such control functions.Synchronization: In our model, synchronization of

the rotor angle velocities for the control areas meansωi = ωj for all i, j ∈ N . Letting ω = (ω1, . . . , ωN )denote the vector of angular velocities and 〈ω〉 =1N

∑Nj=1 ωj its arithmetic mean, we measure the lack

of synchronization using the standard deviation of ω,

σ(ω) =

(1

N

N∑i=1

(ωi − 〈ω〉)2) 1

2

. (10)

Let 0 < T <∞ denote the length of the control horizon[0, T ] in seconds. Define the synchronization constraintloss function by

ψ1(x) = −σ(ω), (11)

and the total synchronization loss on [0, T ] by

C1(u) =

∫ T

0(min(0, ψ1(x(t))))2 dt

+ λ1 min(0, ψ1(x(T )

)2=

∫ T

0σ(ω(t))2dt+ λ1σ(ω(T ))2, (12)

where λ1 ≥ 0 is a weight parameter which emphasizesthe relative importance of the constraint at the final timeT . Recalling the definition of σ(ω) in (10), the quadraticweighting given to it naturally defines the variance of ω.Other weighting schemes are also possible.

Mean angular velocity operational limits: Thevariable ωi quantifies the deviation of the angular veloc-ity at node i from the synchronous reference Ω (rad/s),where Ω is related to the nominal frequency F (Hz) ofthe power grid by Ω = 2π·F . In the United Kingdom andmany other countries the nominal frequency is F = 50Hz. For reasons related to the quality of electricitysupply, the frequency must respect certain operationallimits. In the United Kingdom, for example, the statutorylimits are ±0.5 Hz of the nominal value 50 Hz, and theoperational limits are set to the stricter range of ±0.2 Hz[33]. In our model, this implies the values of the meanangular velocity 〈ω〉 should be constrained,

ωmin ≤ 〈ω〉 ≤ ωmax. (13)

Define the mean angular velocity constraint loss functionby

ψ2(x) = (ωmax − 〈ω〉)(〈ω〉 − ωmin), (14)

and the total loss on [0, T ] for violating this constraintby

C2(u) =

∫ T

0(min(0, ψ2(x(t))))2 dt

+ λ2 min(0, ψ2(x(T ))

)2,

where λ2 ≥ 0 is a weight parameter. Note that only whenψ2(x) is negative in eq. (14) we get a contribution.

Voltage operational limits: Since the voltages inour model are also time dependent, it is important to alsotake into account appropriate operational constraints onthese variables. For example, regulations in the UnitedKingdom require that the steady state voltages shouldbe kept within ±6% of the nominal voltage for systemsbetween 1 and 132 (kV), or±10% of the nominal voltagefor systems above 132 (kV) [34]. In our model we cantake this into account with the following constraint,

V mini ≤ Vi ≤ V max

i , i ∈ N , (15)

Page 5: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

5

where V mini < V max

i . We define a loss function for thevoltage constraint at each node i ∈ N by

ψ2+i(x) = (V maxi − Vi)(Vi − V min

i ), (16)

and the total loss on [0, T ] for violating this constraintby

C2+i(u) =

∫ T

0(min(0, ψ2+i(x(t))))2 dt

+ λ2+i min(0, ψ2+i(x(T ))

)2,

where λ2+i ≥ 0 are weight parameters.

C. Formulation of the optimal control problem

For η = 1, . . . , N+2 the total loss Cη is non-negative,and is equal to zero if, equivalently, the η-th constraint issatisfied on [0, T ]. We relax this by introducing toleranceparameters εη ≥ 0, η ∈ 1, . . . , N + 2, and say that acontrol u ∈ U is feasible if it satisfies

Cη(u) ≤ εη for η = 1, . . . , N + 2. (17)

Below we define a cost objective J(u) which we usewith the constraint losses (17) to formulate the optimalcontrol problem (5).

At an initial time t = 0, the power grid is synchronizedand at a steady state, x = 0, in which various operationalconstraints are satisfied. Suppose the constant net injec-tion Pin,i corresponding to the steady state is perturbedaccording to an external disturbance ξi,

Pin,i → Pin,i + ξi(t), t ∈ [0, T ],

that causes the grid to become unsynchronized. Wewould like the control function u to return the gridclose to a synchronized state before T seconds, and witha “minimal cost” that ensures the constraint conditions(17) are satisfied. Let L(t,x,u) denote the value of acost rate function L that can generally depend on timeand the current value of the state and control vectors.Letting IN denote the N × N identity matrix and trdenote the transpose operator, we define the followingquadratic cost,

L(t,x,u) := utrINu =

N∑i=1

(ui)2, (18)

which is typical of those in the frequency control litera-ture [26], [35]. The rate function (18) is used to definethe following total cost for a control u ∈ U ,

J(u) =

∫ T

0L(t,x(t),u(t)

)dt. (19)

By the definition (18) of the cost rate, the cost ob-jective (19) assigns higher costs to control functions u

that exert large amounts of effort over time. Moreover,adjustments in demand and generation of the samemagnitude are penalized equally due to the symmetryutrINu = (−u)trIN (−u). If demand and generationshould be penalized differently then this can be achievedby adjusting (18). Note that by using the identity matrixIN we assume that the cost of control is independent ofthe node. If this is not the case, then we can replace INin (18) with another positive diagonal matrix. Finally,if we should also ensure that the system state does notdeviate too far from its initial value x0, then we canpenalize such deviations by adjusting the cost rate (18)or constraints Cη.

III. SIMULATIONS FOR A FOUR-NODE NETWORKED

POWER SYSTEM

For the numerical simulations we use the test systemshown in Fig. 1a. Note that such a network may beobtained as a reduction of a larger network, for examplethe IEEE 39-bus test system [36], [37]. We considertwo types of disturbance with each one altering thenet power injection at node 1 as shown in Fig. 1b.The temporary disturbance reflects a sudden but shortdoubling of demand, or equivalent loss of generation, atnode 1 from time t = 10 s that lasts for only twentyseconds. The persistent disturbance reflects a suddendoubling of demand at node 1 from time t = 10 sthat lasts for the remaining control horizon. Resultsfor the case with an analogous increase in generation,or equivalent loss of demand, are symmetric and thusomitted. In Appendix A we list the parameter values forthe model and control problem.

Upon representing the constraints by an appropriatelydefined vector of auxiliary state variables, we can applythe theoretical results in [21] or [38] to assert theexistence of a solution to the optimal control problem(5). Furthermore, Pontryagin’s Maximum Principle [20],[21] provides us with a set of mathematical conditionsthat a solution to the optimal control problem necessarilysatisfies. Instead of pursuing this mathematical formal-ism, however, we empirically investigate characteristicsof an optimal control by solving the optimal controlproblem numerically. The numerical solutions are ob-tained using the control parametrization method [28],which approximates the optimal control problem (5) bya constrained non-linear optimization problem over abounded (N × np)-dimensional space, where np is apositive integer, that parametrizes step control functionsas follows,

ui(t) =

np∑k=1

uki 1[tk−1,tk)(t), uki ∈ Ui, i ∈ N . (20)

Page 6: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

6

1

2

3

4

(a) Four-node network motif

0 10 20 30 40 50 60Time [s]

−2.00

−1.75

−1.50

−1.25

−1.00

−0.75

−0.50

−0.25

0.00

ξ 1[pu] temporary

persistent

(b) Power disturbance ξ1 to node 1

Figure 1. The first figure (a) illustrates the four-node motif network with ring topology. Parameters are given in the Appendix. The secondfigure (b) illustrates the types of power disturbance ξ1 applied at node 1. We consider a short temporary change (dash-dotted line) of powerand a persistent change (solid line). No disturbances are applied to the other nodes.

Further details of the algorithm are given in AppendixB, and the source code for the numerical experimentsis available online [39]. For the simulations we useequidistant partitioning points tk = k

npT , 0 ≤ k ≤ np,

with np = 1500, and the Sequential Least SquaresProgramming (SLSQP) routine in Python to solve thenon-linear optimization problem.

We compare the performance of the optimal control(OC) and three controllers, LLF (1), ILF (2) and GAB(4), restricting values of the latter controls to the setU =

∏i∈N Ui if necessary. We use the trapezoidal rule

to approximate the integrals in (2) and (4) and updatethe control ui incrementally in an online manner. Forsimplicity we suppose that νi = ν, κi = κ and µi = µfor all i ∈ N in (1) and (2) respectively.

The proposed distributed controllers are designed tokeep the system frequency close to the nominal value(and, therefore, the angular velocity close to 0). In orderto make the comparison fair we therefore choose theangular velocity constraints in (13) to reflect a maximumallowed deviation of 0.1% from the nominal value 50 Hz,which is ±0.05 Hz. Table II below shows the values ofν, κ and µ we used in the simulations.

The value for ν was chosen to be comparable to thedamping constants given in the Appendix. The valuefor µ was selected according to the simulations in [27,p. 303], whilst the value for κ was selected to satisfyµκ = N = 4, based on the relation in (4) above. Noticethat the synchronization total loss C1 (12) for the dis-tributed controls is larger for the temporary disturbancethan for the persistent one. This is because the temporarydisturbance causes two sudden changes to the net power

Table IIPARAMETER VALUES ν (s−1), κ (s−2) AND µ (s−2) SELECTED

FOR THE PROPOSED CONTROLLERS. ALSO INCLUDED IS THESYNCHRONIZATION CONSTRAINT TOTAL LOSS C1 FOR THE

TEMPORARY (T) AND PERSISTENT (P) DISTURBANCES AND THERESPECTIVE PERFORMANCE OF THE OPTIMAL CONTROL (OC).

Control Parameter Value C1 (T, P)LLF (1) ν = 1 3.6 · 10−3, 1.8 · 10−3

ILF (2) κ = 15 6.3 · 10−3, 3 · 10−3

GAB (4) µ = 60 6.3 · 10−3, 3 · 10−3

OC (5) – 10−4, 10−4

injection over the control horizon whereas the persistentdisturbance only causes one sudden change.

A. Simulated dynamics of the controlled power system

Even in the absence of control, the simulated systemgradually resynchronizes within the horizon [0, T ] withacceptable voltages and, except when the disturbancepersists, acceptable angular velocities. We show in Fig. 2trajectories for the controlled active power, angularvelocity and voltage under the temporary disturbance,and in Fig. 3 corresponding trajectories for the angularvelocity mean and standard deviation. Trajectories underthe persistent disturbance display analogous behaviourand are shown in Appendix C.

Linear local frequency (LLF) control: The LLFcontrol keeps the angular velocities within the givenbounds over the control horizon and also synchronizesthe system after each change in power by the disturbance.For the persistent disturbance, the angular velocities

Page 7: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

7

-0.21-0.16-0.10-0.050.01

ωLLF: Angular velocity [rad/s]

0.9920.9961.0001.0031.007

V

LLF: Voltage [pu]

0 10 20 30 40 50 60-0.010.050.100.160.21

u

LLF: Controlled active power [pu]

49.96649.97549.98349.99250.001

Hz

(a) LLF for temporary disturbance

-0.30-0.18-0.050.070.20

ω

ILF: Angular velocity [rad/s]

0.9920.9961.0001.0031.007

V

ILF: Voltage [pu]

0 10 20 30 40 50 60-0.000.080.160.240.31

u

ILF: Controlled active power [pu]

49.95249.97249.99150.01150.031

Hz

(b) ILF for temporary disturbance

-0.30-0.18-0.050.070.20

ω

GAB: Angular velocity [rad/s]

0.9920.9960.9991.0031.007

V

GAB: Voltage [pu]

0 10 20 30 40 50 60-0.000.080.160.240.31

u

GAB: Controlled active power [pu]

49.95249.97249.99150.01150.031

Hz

(c) GAB for temporary disturbance

-0.32-0.24-0.15-0.070.01

ωOC: Angular velocity [rad/s]

0.9930.9961.0001.0041.007

V

OC: Voltage [pu]

0 10 20 30 40 50 60-0.53-0.250.030.310.59

u

OC: Controlled active power [pu]

49.94949.96249.97549.98850.001

Hz

(d) OC for temporary disturbance

Figure 2. The angular velocity with corresponding frequency values, voltage and controlled power at each node in the test system under thetemporary disturbance. Solid, dashed, dash-dotted and dotted lines correspond to nodes 1, 2, 3 and 4 respectively. Each control graduallysynchronizes the angular velocities after each change in power by the disturbance. The ILF and GAB controls furthermore try to return theangular velocities to the initial synchronized value. Notice that OC also responds pre-emptively to the disturbance in a significant way.

synchronize near the nadir shown in Fig. 3a. Notethat the responses at the nodes become equal as thesystem synchronizes since the parameters for the control(1) satisfy νi = ν for all i ∈ N . The displayedcontrol trajectories are oscillatory and dampen while thedisturbance ξ1 remains constant. However, in separatesimulations with larger ν (not shown) we no longernotice these oscillations. Moreover, when ν is very large,say ν = 100, the LLF control has a much larger initial

response at node 1 that approximates the change inpower caused by the disturbance. In this case the angularvelocities are also kept much closer to 0.

Integral local frequency (ILF) control: The ILFcontrol also keeps the angular velocities within thebounds over the control horizon and synchronizes thesystem after each change in power by the disturbance.Moreover, ILF also returns the angular velocities to theinitial synchronized value, thereby performing a sec-

Page 8: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

8

−0.3142−0.15710.00000.15710.3142

⟨ω⟩

LLF:⟨Mean⟨angular⟨velocity⟨[rad/s]

0 10 20 30 40 50 600.00

0.02

0.04

σ⟩ω)

LLF:⟨Di per ion⟨of⟨angular⟨velocity⟨[rad/s]49.9549.97550.050.02550.05

Hz

(a) LLF for temporary disturbance

−0.3142−0.1571

0.00000.15710.3142

⟨ω⟩

ILF:⟨Mean⟨angula ⟨velocity⟨[rad/s]

0 10 20 30 40 50 600.00

0.02

0.04

σ(ω

)

ILF: Dispersion of angular velocity [rad/s]49.9549.97550.050.02550.05

Hz

(b) ILF for temporary disturbance

−0.3142−0.1571

0.00000.15710.3142

⟨ω⟩

GAB:⟨Mean⟨angula ⟨velocity⟨[rad/s]

0 10 20 30 40 50 600.00

0.02

0.04

σ(ω

)

GAB: Dispersion of angular velocity [rad/s]49.9549.97550.050.02550.05

Hz

(c) GAB for temporary disturbance

−0.3142−0.15710.00000.15710.3142

⟨ω⟩

OC:⟨Mean⟨angular⟨velocity⟨[rad/s]

0 10 20 30 40 50 600.0000

0.0025

0.0050

0.0075

σ⟩ω)

OC:⟨Di per ion⟨of⟨angular⟨velocity⟨[rad/s]49.9549.97550.050.02550.05

Hz

(d) OC for temporary disturbance

Figure 3. Angular velocity mean and deviation in the test system under the temporary disturbance. Red dotted lines show operational limits.Each control keeps the mean angular velocity 〈ω〉 within its bounds and gradually synchronizes the system after each change in power by thedisturbance. Notice that OC synchronizes the angular velocities to the boundary of its admissible set of values. Furthermore, its pre-emptiveresponses to the disturbance cause temporary losses of synchronization.

ondary control action. The displayed control trajectoriesdo not have the oscillations present for the LLF control.However, if κ is sufficiently small, then such oscillationscan appear, although the angular velocities are kept muchcloser to 0.

Gather-and-broadcast (GAB) control: The GABcontrol behaves and performs similarly to ILF as Fig. 3and results in Table II can attest. In particular, GABsynchronizes the system and performs the secondarycontrol action of returning the frequency to its nominalvalue.

Optimal control: The optimal control causes themean angular velocity 〈ω〉 to follow its natural directionof descent or ascent within the operational limits until aparticular level. The angular velocity is then kept at thislevel whilst the disturbance persists. Additionally, thecombined action at the unperturbed nodes is generally of

the opposite type to that taken at the perturbed node. Thatis, when there is an increase (respectively, decrease) inu1 there is typically a decrease (respectively, increase) in∑N

i=2 ui at the same time. We also notice the followingpre-emptive behaviour of the control: shortly before thesudden increase (resp. decrease) in demand at node 1,the optimal control decreases (resp. increases) the activepower at this node and simultaneously increases (resp.decreases) the active power at the remaining unperturbednodes. Consequently, the optimal control uses additionaland, in practice, uncertain information about the dis-turbance in its response that realistic controls may notbe able to use. Hence, the optimal controller shouldalways outperform any realistic controller. Finally, wenote that the results depend on the parameters selected.For example, if the synchronization loss tolerance isincreased from the value ε1 = 10−4 (used to generate

Page 9: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

9

temporary persistent0

5

10

15

20

J(u)

OCLLFILFGAB

Figure 4. Comparison of control costs for temporary and persistent disturbances (from left to right: LLF, ILF, GAB, OC). The optimalcontrol, OC, keeps the system within operational boundaries at the lowest costs whereas ILF and GAB have the highest costs. We alsoobserve near equal costs for ILF and GAB with other values for the coefficients µ and κ satisfying κ ≥ 1 and µ

κ= 4.

these results) to ε1 = 10−3 we observe oscillations inthe control trajectories.

B. Comparison of control costs

In Fig. 4 we show the cost J(u) for the controlsLLF, ILF, GAB and OC associated with the trajecto-ries displayed above. While it is clear that OC sat-isfies the constraints with smallest cost at the lowestsychronization loss (Table II), these costs can dependsignificantly on the simulation parameters. For example,the LLF cost increases with the coefficient ν and theOC cost increases as the synchronization loss toleranceε1 decreases. Notwithstanding this we can explain thedisparity between costs for LLF and ILF (or GAB) bythe additional secondary control action undertaken byILF (see Fig. 2). Also, the similarity in costs for thetemporary and persistent disturbances corresponding toOC can be attributed to the significant cost of respondingpre-emptively to the temporary disturbance in this case.

IV. CONCLUSION AND OUTLOOK

In summary, we have introduced and numericallysolved an optimal control problem to benchmark dif-ferent control schemes for power grid transient stabilityin terms of their economic effectiveness. We inves-tigated three distributed control schemes: linear localfrequency (1), integral local frequency (2), and gather-and-broadcast (4).

The linear local frequency control acts as a primaryresponse service to keep the grid frequency close to

its nominal value. If the control coefficient νi in (1) ischosen suitably, for example comparable to the dampingparameter at node i, then this control can be quite costeffective when compared to the integral frequency andgather-and-broadcast controls. However, we note thatthe latter controls can also provide secondary responseservice (see Fig. 2) which the linear local frequencycontrol is not designed for. If the coefficient νi forthe linear local frequency control is large, this leads tomore costly power response profiles that almost exactlycounteract the disturbance, at least in the initial responsephase. The linear local frequency, integral frequencyand gather-and-broadcast controllers can also producecontrol trajectories with oscillations depending on howtheir parameters are chosen.

Our results suggest that more efficient controllersdistribute the controlled response amongst all nodesin the power grid. Moreover, this response need notbe homogeneous throughout the network, but couldsimultaneously involve incremental actions (net increasein power) at some nodes and decremental ones (netdecrease in power) at others. Trajectories associated withthe optimal control show that as it changes the net activepower, the mean angular velocity follows its naturaldirection of descent, or ascent as appropriate, within theoperational limits until a point is reached, possibly at theboundary, at which the power grid is synchronized andactive power is balanced within the network.

A response like the one exhibited by the optimal con-trol apparently requires additional information about thedisturbance that is likely to be uncertain. Nevertheless,

Page 10: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

10

for events that are planned or will occur with very highprobability at an anticipated future time, informationabout the disturbance can be incorporated in the controlsystem’s initial response, and a simple distributed ordecentralized control such as those we investigated canbe used to smooth out additional unknown perturbations.Designing optimal distributed controllers is the subjectof ongoing work (see [18], [40], for instance) anddecentralized stochastic control (see [41]–[43]), whichgeneralizes our methodology by incorporating uncer-tainties and different information structures amongstmultiple controllers, is likely to become an importanttheoretical tool for understanding how these controllerswork. Finally, while the numerical results presented herewere obtained for a specific four-node network, theyprovide useful heuristics for more realistic and largernetworks. Overall, our results contribute insight into theprocess of designing and benchmarking secure and cost-efficient controllers for the power system.

REFERENCES

[1] J. A. Turner, “A Realizable Renewable Energy Future,” Science,vol. 285, no. 5428, pp. 687–689, Jul 1999.

[2] G. Boyle, Renewable Energy: Power for a Sustainable Future,2nd ed. Oxford, England: Oxford University Press, 2004.

[3] F. Ueckerdt, R. Brecha, and G. Luderer, “Analyzing majorchallenges of wind and solar variability in power systems,”Renewable Energy, vol. 81, pp. 1–10, Sep 2015.

[4] P. Kundur, Power System Stability and Control, N. J. Balu andM. G. Lauby, Eds. New York, NY, USA: McGraw-Hill, 1994.

[5] D. Heide, L. von Bremen, M. Greiner, C. Hoffmann, M. Speck-mann, and S. Bofinger, “Seasonal optimal mix of wind andsolar power in a future, highly renewable Europe,” RenewableEnergy, vol. 35, no. 11, pp. 2483–2489, Nov 2010.

[6] P. Milan, M. Wachter, and J. Peinke, “Turbulent Character ofWind Energy,” Physical Review Letters, vol. 110, no. 13, p.138701, Mar 2013.

[7] K. Dennis, K. Colburn, and J. Lazar, “Environmentally bene-ficial electrification: The dawn of ‘emissions efficiency’,” TheElectricity Journal, vol. 29, no. 6, pp. 52–58, Jul 2016.

[8] P. Palensky and D. Dietrich, “Demand Side Management: De-mand Response, Intelligent Energy Systems, and Smart Loads,”IEEE Transactions on Industrial Informatics, vol. 7, no. 3, pp.381–388, Aug 2011.

[9] A. E. Motter and Y.-C. Lai, “Cascade-based attacks on complexnetworks,” Physical Review E, vol. 66, no. 6, p. 065102, dec2002.

[10] Y. Yang, T. Nishikawa, and A. E. Motter, “Small vulnerable setsdetermine large network cascades in power grids,” Science, vol.358, no. 6365, 2017.

[11] B. Schafer, D. Witthaut, M. Timme, and V. Latora, “Dy-namically induced cascading failures in power grids,” NatureCommunications, vol. 9, no. 1, p. 1975, dec 2018.

[12] C. Zhao, U. Topcu, N. Li, and S. Low, “Design and stability ofload-side primary frequency control in power systems,” IEEETransactions on Automatic Control, vol. 59, no. 5, pp. 1177–1189, 2014.

[13] K. Xi, J. L. Dubbeldam, H. Lin, and J. H. van Schuppen,“Power-Imbalance Allocation Control for Secondary FrequencyControl of Power Systems,” IFAC-PapersOnLine, vol. 50, no. 1,pp. 4382–4387, jul 2017.

[14] E. B. T. Tchuisseu, D. Gomila, P. Colet, D. Witthaut, M. Timme,and B. Schafer, “Curing Braess’ Paradox by Secondary Controlin Power Grids,” arXiv preprint arXiv:1804.07518, 2018.

[15] D. S. Kirschen and G. Strbac, Fundamentals of Power SystemEconomics. Chicester, England: John Wiley & Sons, 2004.

[16] J. Carrasco, L. Franquelo, J. Bialasiewicz, E. Galvan, R. Por-tilloGuisado, M. Prats, J. Leon, and N. Moreno-Alfonso,“Power-Electronic Systems for the Grid Integration of Re-newable Energy Sources: A Survey,” IEEE Transactions onIndustrial Electronics, vol. 53, no. 4, pp. 1002–1016, jun 2006.

[17] N. Li, C. Zhao, and L. Chen, “Connecting Automatic Gener-ation Control and Economic Dispatch From an OptimizationView,” IEEE Transactions on Control of Network Systems,vol. 3, no. 3, pp. 254–264, sep 2016.

[18] D. K. Molzahn, F. Dorfler, H. Sandberg, S. H. Low,S. Chakrabarti, R. Baldick, and J. Lavaei, “A Survey ofDistributed Optimization and Control Algorithms for ElectricPower Systems,” IEEE Transactions on Smart Grid, vol. 8,no. 6, pp. 2941–2962, Nov 2017.

[19] A. Venkat, I. Hiskens, J. Rawlings, and S. Wright, “DistributedMPC strategies with application to power system automaticgeneration control,” IEEE Transactions on Control SystemsTechnology, vol. 16, no. 6, pp. 1192–1206, 2008.

[20] M. R. Hestenes, Calculus of variations and optimal controltheory. New York, NY, USA: John Wiley & Sons, 1966.

[21] F. Clarke, Functional Analysis, Calculus of Variations andOptimal Control, ser. Graduate Texts in Mathematics. London,England: Springer London, 2013, vol. 264.

[22] B. Schafer, M. Matthiae, M. Timme, and D. Witthaut, “Decen-tral Smart Grid Control,” New Journal of Physics, vol. 17, no. 1,Jan 2015.

[23] B. Schafer, C. Grabow, S. Auer, J. Kurths, D. Witthaut, andM. Timme, “Taming instabilities in power grid networks bydecentralized control,” The European Physical Journal SpecialTopics, vol. 225, no. 3, pp. 569–582, May 2016.

[24] T. Walter, “Method for controlling the ratio betweensupplied and drawn electric energy in an electric supplynetwork,” 2016, European patent 2875560. [Online]. Available:https://patents.google.com/patent/US9912153B2/en

[25] C. Zhao, E. Mallada, and F. Dorfler, “Distributed frequencycontrol for stability and economic dispatch in power networks,”in 2015 American Control Conference (ACC). Chicago, IL,USA: IEEE, Jul 2015, pp. 2359–2364.

[26] E. Weitenberg, Y. Jiang, C. Zhao, E. Mallada, C. De Persis, andF. Dorfler, “Robust Decentralized Secondary Frequency Controlin Power Systems: Merits and Trade-Offs,” arXiv preprintarXiv:1711.07332, Nov 2017.

[27] F. Dorfler and S. Grammatico, “Gather-and-broadcast frequencycontrol in power systems,” Automatica, vol. 79, pp. 296–305,may 2017.

[28] K. L. Teo and C. J. Goh, A unified computational approach tooptimal control problems. Essex, England: Longman Scientic& Technical, 1991.

[29] B. Schafer, C. Beck, K. Aihara, D. Witthaut, and M. Timme,“Non-Gaussian power grid frequency fluctuations characterizedby Levy-stable laws and superstatistics,” Nature Energy, vol. 3,no. 2, pp. 119–126, Feb 2018.

[30] R. G. Harrison and E. Hanna, “The solar eclipse: a natural mete-orological experiment,” Philosophical Transactions of the RoyalSociety A: Mathematical, Physical and Engineering Sciences,vol. 374, no. 2077, Sep 2016.

Page 11: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

11

[31] J. Machowski, J. Bialek, and J. Bumby, Power System Dynam-ics: Stability and Control, 2nd ed. Chicester, England: JohnWiley & Sons, Ltd, 2008.

[32] D. Z. Szabo and R. Martyr, “Real option valuation of adecremental regulation service provided by electricity storage,”Philosophical Transactions of the Royal Society A: Mathemat-ical, Physical and Engineering Sciences, vol. 375, no. 2100,Aug 2017.

[33] National Grid UK, “Electricity TransmissionSystem Operations,” 2017. [Online]. Avail-able: http://www2.nationalgrid.com/uk/industry-information/electricity-transmission-system-operations/

[34] The National Archives, “The Electricity Supply Regulations1988,” 2017. [Online]. Available: http://www.legislation.gov.uk/uksi/1988/1057/made/data.xht?wrap=true

[35] S. Trip, M. Burger, and C. De Persis, “An internal modelapproach to (optimal) frequency regulation in power grids withtime-varying voltages,” Automatica, vol. 64, pp. 240–253, Feb2016.

[36] M. Ourari, L.-A. Dessaint, and V.-Q. Do, “Dynamic EquivalentModeling of Large Power Systems Using Structure PreservationTechnique,” IEEE Transactions on Power Systems, vol. 21,no. 3, pp. 1284–1295, aug 2006.

[37] S. Nabavi and A. Chakrabortty, “Topology identification fordynamic equivalent models of large power system networks,”in 2013 American Control Conference. IEEE, jun 2013, pp.1138–1143.

[38] L. Cesari, Optimization—Theory and Applications. New York,NY, USA: Springer New York, 1983.

[39] R. Martyr, “Implementation of the control parametrizationmethod for optimal control of a simplified networkedpower system,” 2018. [Online]. Available: https://gitlab.com/networked-power-systems/power-grid-control

[40] T. Stegink, C. De Persis, and A. van der Schaft, “A UnifyingEnergy-Based Approach to Stability of Power Grids WithMarket Dynamics,” IEEE Transactions on Automatic Control,vol. 62, no. 6, pp. 2612–2622, Jun 2017.

[41] A. Mahajan and M. Mannan, “Decentralized stochastic control,”Annals of Operations Research, vol. 241, no. 1, pp. 109–126,Jun 2016.

[42] C. D. Charalambous and N. U. Ahmed, “Centralized Versus De-centralized Optimization of Distributed Stochastic DifferentialDecision Systems With Different Information Structures-Part I:A General Theory,” IEEE Transactions on Automatic Control,vol. 62, no. 3, pp. 1194–1209, Mar 2017.

[43] R. Singh, P. R. Kumar, and L. Xie, “Decentralized Control viaDynamic Stochastic Prices: The Independent System OperatorProblem,” IEEE Transactions on Automatic Control, pp. 1–1,2018.

[44] Q. Lin, R. Loxton, and K. L. Teo, “The control parameterizationmethod for nonlinear optimal control: A survey,” Journal ofIndustrial and Management Optimization, vol. 10, no. 1, pp.275–309, oct 2013.

APPENDIX ATABLES OF PARAMETER VALUES

Table IIISTEADY STATE VALUES AND PARAMETERS FOR THE POWER GRID

MODEL (6) USED IN THE SIMULATIONS, BASED ON [35, P. 251].THE NET INJECTION Pin,i IS OBTAINED FROM THE MECHANICALPOWER Pm,i AND AGGREGATE LOAD Pl,i BY Pin,i = Pm,i − Pl,i .

LINE SUSCEPTANCE VALUES Bi,j OTHER THAN THOSE LISTEDARE EQUAL TO 0 EXCEPT B1,2 = B2,1 = 34.13,

B1,4 = B4,1 = 28, B2,3 = B3,2 = 44.1 AND B3,4 = B4,3 = 22.1.

Parameter [units] Node 1 Node 2 Node 3 Node 4

Mi [s2] 5.22 3.98 4.49 4.22

Di [pu] 1.60 1.22 1.38 1.42

Ef,i [pu] 7.01 6.09 6.29 6.67

T ′do,i [s] 5.54 7.41 6.11 6.22

Xd,i [pu] 1.84 1.62 1.80 1.94

X ′d,i [pu] 0.25 0.17 0.36 0.44

Bi,i [pu] −66.1 −82.2 −69.6 −53.6

Pm,i [pu] 1.1 1.4 0.8 2.2

Pl,i [pu] 2.0 1.0 1.5 1.0

Pin,i [pu] −0.9 0.4 −0.7 1.2

θi [rad] 0.0911 0.0973 0.0930 0.115

ωi [rad · s−1] 0 0 0 0

Vi [pu] 0.998 0.997 1 1

Table IVPARAMETER VALUES FOR THE CONTROL PROBLEM. VECTORS

AND MATRICES ARE DENOTED IN BOLDFACE. THE TOLERANCE ε1FOR THE SYNCHRONIZATION CONSTRAINT IS SET LARGER THAN

THE OTHER TOLERANCES TO ALLOW FOR THE LOSS OFSYNCHRONIZATION AROUND THE OCCURRENCE OF A

DISTURBANCE.

Parameter Value Units

T 60 s

ωmin, ωmax − π10

, π10

rad · s−1

λ 1 1

ε1 10−4 1

ε2,. . . ,ε6 10−10 1

Umin, Umax −5, 5 pu

V min, V max 0.94, 1.06 pu

APPENDIX BTHE CONTROL PARAMETRIZATION METHOD

The following description of the control parametriza-tion method is summarized from the textbook [28].Further extensions to this method can be found in thesurvey [44]. Let Sp, where p ≥ 1 is an integer, denotea finite subset of the control horizon [0, T ] consisting ofnp + 1 partitioning points tp0, . . . , t

pnp ,

tp0 = 0, tpnp= T, and tpk−1 < tpk for k = 1, . . . , np.

Page 12: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

12

An increasing sequence of sets Sp∞p=1 is formed bytaking successive refinements of partitioning points, andthese sets should become dense in [0, T ] as p tends toinfinity,

limp→∞

maxk=1,...,np

|tpk − tpk−1| = 0.

For instance, we can use equidistant partitioning points,tpk = k

npT for k = 0, . . . , np, with the ratio np+1

np, p ≥ 1,

being a constant integer that is greater than 1 (a commonchoice is np+1

np= 2). We define Up as the subset of

control variables up ∈ U that are piecewise constantand consistent with Sp in the following sense,

upi (t) =

np∑k=1

up,ki 1[tpk−1,tpk)

(t), up,ki ∈ Ui, i ∈ N .

Each control up is parametrized by an element Up of the(N × np)-dimensional space Up =

∏np

k=1

(∏Ni=1 Ui

),

where Up = upknp

k=1 and upk = (up,k1 , . . . , up,kN ),This induces equivalent state dynamics f , costs J andconstraints Cη that are dependent on the parameter Up,

x(t) = f(t,x(t),Up) = f(t,x(t),up(t)),

J(Up) = J(up),

Cη(Up) = Cη(u

p).

An approximate solution to the infinite dimensionaloptimal control problem (5) is obtained by solvingthe following non-linear finite dimensional optimizationproblem.

Problem:

minimize J(Up) subject to:

i) x(t) = f(t,x(t),Up), x(0) = x0;

ii) Up ∈ Up;iii) Cη(U

p) ≤ εη for η = 1, . . . , N + 2.

An optimization algorithm such as sequential quadraticprogramming can be used to solve this approximateproblem. Such optimization algorithms are typically iter-ative, and the main computations carried out during eachiteration are outlined below (see Section 6.6 of [28] forfurther details and [39] for an implementation):

1) Obtain a trajectory for the state variable x bynumerically integrating its dynamics forward intime on the partitioning points Sp.

2) Evaluate the cost J(Up) and constraints Cη(Up)using numerical integration.

3) Compute the gradients of the cost J(Up) and con-straints Cη(Up) according to the formulas given inSection 6.6 of [28].

The gradient of the cost J(Up), for example, involvescomputation of the gradient of a Hamiltonian functionH with respect to the parameter Up,

∂J(Up)

∂Up =

∫ T

0

∂H(t,x(t),Up, z(t))

∂Up dt,

where z is the costate variable associated to the cost.The Hamiltonian is defined by,

H(t,x(t),Up, z(t)) = L(t,x(t),up(t))

+ z(t) · f(t,x(t),up(t)),

where L is the cost rate function in (19) and · is the dotproduct. Dynamics for this costate variable are given by,z(t) = −∂H(t,x(t),Up, z(t))

∂xz(T ) = 0,

and this differential equation is solved numerically back-wards in time given a trajectory for x. Costate vari-ables for the constraints are defined similarly, but theirboundary values at T are non-zero in general due to thepresence of terminal costs.

Page 13: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

13

APPENDIX CSIMULATIONS UNDER THE PERSISTENT DISTURBANCE

-0.21-0.16-0.11-0.050.00

ω

LLF: Angular velocity [rad/s]

0.9920.9961.0001.0031.007

V

LLF: Voltage [pu]

0 10 20 30 40 50 60-0.000.050.110.160.21

u

LLF: Controlled active power [pu]

49.96649.97449.98349.99150.000

Hz

(a) LLF for persistent disturbance

-0.30-0.23-0.15-0.080.00

ω

ILF: Angular velocity [rad/s]

0.9920.9960.9991.0031.007

V

ILF: Voltage [pu]

0 10 20 30 40 50 60-0.000.120.230.350.47

u

ILF: Controlled active power [pu]

49.95249.96449.97649.98850.000

Hz

(b) ILF for persistent disturbance

-0.30-0.23-0.15-0.080.00

ω

GAB: Angular velocity [rad/s]

0.9920.9960.9991.0031.007

V

GAB: Voltage [pu]

0 10 20 30 40 50 60-0.000.120.230.350.46

u

GAB: Controlled active power [pu]

49.95249.96449.97649.98850.000

Hz

(c) GAB for persistent disturbance

-0.31-0.23-0.15-0.070.01

ω

OC: Angular velocity [rad/s]

0.9930.9961.0001.0041.007

V

OC: Voltage [pu]

0 10 20 30 40 50 60-0.38-0.180.010.200.40

u

OC: Controlled active power [pu]

49.95049.96349.97649.98950.002

Hz

(d) OC for persistent disturbance

Figure 5. The angular velocity with corresponding frequency values, voltage and controlled power at each node in the test system underthe persistent disturbance. Solid, dashed, dash-dotted and dotted lines correspond to nodes 1, 2, 3 and 4 respectively. Each control graduallysynchronizes the angular velocities after each change in power by the disturbance. The ILF and GAB controls furthermore try to return theangular velocities to the initial synchronized value.

Page 14: Benchmarking the performance of controllers for power grid ... · 1 Benchmarking the performance of controllers for power grid transient stability Randall Martyr, Benjamin Schafer,

14

−0.3142−0.15710.00000.15710.3142

⟨ω⟩

LLF:⟨Mean⟨angular⟨velocity⟨[rad/s]

0 10 20 30 40 50 600.00

0.02

σ⟩ω)

LLF:⟨Di per ion⟨of⟨angular⟨velocity⟨[rad/s]49.9549.97550.050.02550.05

Hz

(a) LLF for persistent disturbance

−0.3142−0.1571

0.00000.15710.3142

⟨ω⟩

ILF:⟨Mean⟨angula ⟨velocity⟨[rad/s]

0 10 20 30 40 50 600.00

0.02

0.04

σ(ω

)

ILF: Dispersion of angular velocity [rad/s]49.9549.97550.050.02550.05

Hz

(b) ILF for persistent disturbance

−0.3142−0.1571

0.00000.15710.3142

⟨ω⟩

GAB:⟨Mean⟨angula ⟨velocity⟨[rad/s]

0 10 20 30 40 50 600.00

0.02

0.04

σ(ω

)

GAB: Dispersion of angular velocity [rad/s]49.9549.97550.050.02550.05

Hz

(c) GAB for persistent disturbance

−0.3142−0.15710.00000.15710.3142

⟨ω⟩

OC:⟨Mean⟨angular⟨velocity⟨[rad/s]

0 10 20 30 40 50 600.000

0.005

0.010

σ⟩ω)

OC:⟨Di per ion⟨of⟨angular⟨velocity⟨[rad/s]49.9549.97550.050.02550.05

Hz

(d) OC for persistent disturbance

Figure 6. Angular velocity mean and deviation in the test system under the persistent disturbance. Red dotted lines show operational limits.Angular velocity mean and deviation in the test system under the temporary disturbance. Red dotted lines show operational limits. Eachcontrol keeps the mean angular velocity 〈ω〉 within its bounds and gradually synchronizes the system after each change in power by thedisturbance. Notice that OC synchronizes the angular velocities to the boundary of its admissible set of values.


Recommended