EV Charging Scheduling Under Demand Charge A Block Model Predictive Control Approach
EV Charging Scheduling Under Demand Charge A Block Model Predictive Control Approach
Abstract— This paper studies the online scheduling of electric the charging scheduling under demand charge over multiple
vehicle charging by a service provider subject to a demand charge charging stations.
in a distribution system. Demand charge imposes a penalty on the
peak power consumption over each billing period, representing a Index Terms— Demand charge, demand side management,
substantial cost for the service provider with a large number of online scheduling, charging of electric vehicles, model predictive
clients. Because the demand charge is calculated at the end of the control (MPC).
billing period, it poses challenges in real-time scheduling when
energy demand forecasts are inaccurate, resulting in either overly
conservative power consumption or substantial demand charge. I. I NTRODUCTION
We propose a block model predictive control approach that
decomposes the demand charge into a sequence of stage costs.
Optimality conditions on demand patterns are also presented and
analyzed. Numerical simulations demonstrate the efficacy of the
W E CONSIDER the problem of scheduling electric vehi-
cle (EV) charging in an EV charging facility by a
commercial service provider. The EV charging model accounts
proposed approach. for the stochastic arrival of EVs and their charging demands,
the need to constrain total charging power imposed by the
Note to Practitioners—This paper addresses a significant prac-
tical problem of minimizing the demand charge on the real-time distribution grid, and the costs of EV charging arising from
scheduling of deferrable demands. In particular, we consider a the energy and the demand charge set by the tariff of a local
setting where a commercial electric vehicle (EV) charging service utility. At a higher level, such a scheduling problem falls in
provider has to manage the online scheduling of a large number the category of stochastic dynamic programming, for which
of arriving EVs at a charging facility subject to a maximum the optimal solution suffers from the curse of dimensionality,
charging power constraint and a tariff with the demand charge.
A major practical challenge is to balance the tradeoff between making it unrealistic for practical implementations.
maximizing profit in scheduling as much EV charging as possible The importance of a carefully designed EV charging sched-
and the need to minimize penalty on the peak charging power. ule is well understood, and there is extensive literature on
We propose a model predictive control strategy that decomposes various approaches, each capturing certain aspects of the
the overall demand charge into a sequence of terminal costs. Also EV charging problem; see a brief review in Section I-A.
addressed is the practical constraint arising from the mismatched
EV charging decision period and the power measurement period Among the most significant factors are the need to exploit
used to compute the demand charge. Using real data collected the flexibility of charging demands, avoid peak-demand hours
at the Adaptive Charging Network (ACN) testbed in simulations, during which the energy cost is high, incorporate colocated
the proposed approach yields 8-12% improvement in operational renewables, and deal with dynamically varying electricity
profit over existing benchmarks, while it has yet been tested in prices.
actual charging systems. In the future research, we will address
This paper focuses on two nontrivial but less studied
aspects of centralized EV charging in a distribution system
Manuscript received 16 December 2022; accepted 20 February 2023. Date by a profit-seeking service provider: the stochastic arrival of
of publication 31 March 2023; date of current version 9 April 2024. This
article was recommended for publication by Associate Editor H.-J. Kim and charging demands and the high cost of the demand charge.
Editor L. Moench upon evaluation of the reviewers’ comments. The work of Without a computationally tractable optimal scheduling solu-
Lei Yang and Xiaohong Guan was supported by the National Key Research tion, we aim to develop a suboptimal model predictive control
and Development Program of China under Grant 2016YFB0901900. The
work of Xinbo Geng and Lang Tong was supported in part by the U.S. (MPC) strategy that exploits the structure of EV charging char-
National Science Foundation under Award 1816397 and Award 1809830. acteristics and incorporates the demand charge as a sequence
(Corresponding author: Lei Yang.) terminal cost associated with the optimization at each stage.
Lei Yang is with the Faculty of Electronic and Information Engineer-
ing, Xi’an Jiaotong University, Xi’an 710049, China, and also with the The centralized EV charging in a distribution system allows
School of Electrical and Computer Engineering, Cornell University, Ithaca, us to remove or deemphasize some of the complications
NY 14850 USA (e-mail: [email protected]). commonly considered in the literature, some of which can be
Xinbo Geng and Lang Tong are with the School of Electrical and
Computer Engineering, Cornell University, Ithaca, NY 14850 USA (e-mail: incorporated under the general MPC framework, while others
[email protected]; [email protected]). become unnecessary for the problem at hand. Specifically,
Xiaohong Guan is with the Faculty of Electronic and Information we assume that the marginal cost of electricity is deterministic
Engineering, Xi’an Jiaotong University, Xi’an 710049, China (e-mail:
[email protected]). and the demand charge price fixed as part of a long-term
Digital Object Identifier 10.1109/TASE.2023.3260804 contract with the distribution utility. The behind-the-meter
1545-5955 © 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
2126 IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, VOL. 21, NO. 2, APRIL 2024
renewable is not considered. While such resources can be objective. EMPC has been applied to centralized EV charging
incorporated in the MPC-based dynamic optimization, their problem in [29] and [30]. The EMPC models considered
significance rests primarily in the scheduling performance in these contributions differ considerably from our paper’s
rather than in developing an MPC-based solution. approach. Halvgaard et al. [29] formulated one of the earliest
EMPC approaches to EV charging that minimizes charging
costs involving a fixed set of EVs over a scheduling interval.
A. Related Work
More recent work of Engel et al. [30] considers the cen-
The literature on EV charging scheduling is vast. Here we tralized co-optimization of EV charging and building energy
restrict our review to centralized scheduling of a large number management systems. Missing in these formulations are the
EV chargings by a profit-seeking operator. arrival and departure dynamics of EV demands and stochastic
A significant line of contributions to the EV charging lit- charging completion deadlines.
erature follows a baseline of charging optimizations involving Demand charge can be a significant part of its cost for
a fixed set of EVs [1], [2], [3], [4], [5], [6], [7], [8], [9]. a profit-maximizing operator of a large EV charging ser-
Most work under such formulations applies naturally to the vice. Because demand charge is determined by the maximum
residential EV charging problems, where distributed imple- power consumption (typically measured over multiple charg-
mentations are often important. While these approaches can ing periods), it is nontrivial to capture such cost within each
be adapted to the centralized EV charging problem considered receding-horizon MPC optimization. In [8], Lee et al. proposed
in this paper, they have very different objectives from that an MPC method that decomposed the demand charge into
of a commercial EV charging service provider. Some of multiple convex problems, where heuristics were introduced
the missing ingredients in these models are the stochastic to weight the demand charge to influence the performance on
arrival/departure of charging requests, charging demands, and the overall profit. Although not designed for the EV charging
charging completion deadlines. problem, the work of Kumar et al. [31] and the recent paper of
Our approach presented in this paper follows the online Risbeck and Rawlings [32] also bear significant relevance to
job-scheduling formulation where charging demands (jobs) our work. Similarly to [8], the approach of Kumar et al. [31]
arrive and depart sequentially with uncertainty. One line of to incorporating the demand charge in MPC is heuristic by
approaches is to cast the problem as the classical (deter- setting a time-varying weight at each optimization problem.
ministic) deadline scheduling problem [10], [11], [12], [13], Risbeck and Rawlings, on the other hand, proposed a princi-
[14], [15] where jobs with completion deadlines are centrally pled approach that explicitly incorporated the demand charge
scheduled in real-time. In the context of EV charging, jobs as a terminal cost of each EMPC optimization in [32]. Their
are EVs with stochastic demands, processors are EV charging approach, however, is designed with respect to a reference tra-
connecting ports, and the operator is the scheduler. The simple jectory that can only be derived from perfect demand forecasts,
and sometimes optimal deterministic scheduling schemes such and the maximum consumption that sets the demand charge
as the earliest deadline first (EDF) and the least-laxity-first must be computed within a single decision interval. In practice,
(LLF) algorithms remain to be the benchmarks for compar- the EV charging decision interval can be significantly shorter
isons. These approaches treat job arrivals as deterministic and than the period over which the maximum demand charge is
arbitrary. computed, for which no existing techniques explicitly account,
The scheduling of EV charging under stochastic arrivals to our best knowledge.
starts with a Markov decision process (MDP) formulation of
the scheduling problem [16], [17], [18], [19], [20], [21], [22],
[23], [24], [25]. The approach presented in this paper follows
B. Summary of Results and Contributions
the problem formulation of these approaches. Recognizing that
the MDP solutions are intractable in practice, efforts have We formulate a centralized EV charging problem as an
been made to discover and exploit the structural properties of MDP where our model captures the arrival dynamics of EVs,
the problem to achieve suboptimal (sometimes asymptotically stochastic charging demands, and stochastic completion dead-
optimal) performance [21], [22], [23], [24], [25]. In partic- lines. A significant contribution is incorporating the demand
ular, when the charging demand arrival is light relative to charge in the MDP formulation and deriving a novel block
overall system charging capacity, it is shown in [23] that, economic MPC solution, referred to as BMPC, to deal with
without the demand charge, the Whittle’s index policy [26] the demand charge that must be computed over multiple
is asymptotically optimal. Outside the light traffic regime scheduling intervals. A key ingredient of BMPC is to trans-
and without demand charge, the Less Laxity First with Later form the terminal demand charge into a sequence of stage
Deadline (LLF-LD) scheduling algorithm proposed in [27] terminal costs of each BMPC optimization by tracking the
exhibits near-optimal performance in simulations. peak consumption and assessing the impact of the demand
MPC, more precisely receding-horizon economic MPC charge in each stage. Although the idea of tracking the peak
(EMPC) [28], is a computationally tractable solution that often demand was considered in [33], [34], and [32], BMPC differs
performs well in practice when dealing with optimization from existing techniques in terms of the specific stage costs
problems involving dynamic systems and economic objectives. used in the BMPC optimization and how the peak consumption
Such a model fits naturally to the large-scale EV charging is computed over multiple scheduling intervals. To support an
problem for a service provider with a profit-maximizing MPC approach for EV charging applications, we show that the
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
YANG et al.: EV CHARGING SCHEDULING UNDER DEMAND CHARGE: A BLOCK MPC APPROACH 2127
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
2128 IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, VOL. 21, NO. 2, APRIL 2024
B. Problem Formulation
4) Demand Charge: Based on the pricing of the demand
EV loads are flexible demands such that their services can
charge, the average power consumption over ℓ consecutive
be delayed. By shifting part or all of the demands, EV-DC
scheduling intervals is calculated for each non-overlapping
has strong inter-temporal dependencies. We present in section
measurement window.5 The maximum value among these
a Markov decision process (MDP) model for EV-DC [21],
measurement windows for the demand charge is represented
[27], subject to various constraints including the maximum
by variable ψ and calculated as follows:
charging rate, time-varying electricity price and a monthly
demand charge. t+ℓ−1 N
1) Exogenous Stochastic Input ξ : The input of EV-DC R X X
ψ = max′ u i,τ , (4)
model is a vector random process that models the arrivals of t∈T ℓ τ =t i=1
EV demands at individual chargers. The occupancy of each
charger is an on-off process with the charger being occupied
where T ′ = {0, ℓ, 2ℓ, . . . , T − ℓ} denotes the set of the
for the duration of the EV charging deadline and being idle for
beginning interval of each measurement window. Thus the
the duration of a Bernoulli process based on with parameter
demand charge is computed as C(ψ) = π d ψ, where π d is
αi set by the overall arrival rate of the EV demands.4 At
the unit price of the demand charge.
the beginning of an occupied period of charger i, say at t0 ,
Remark 2: For the computation of the demand charge,
an EV arrives with random energy demand Di,t0 and random
practically the length of a measurement window may not
deadline Ti,t0 . Thus the input process at charger i is given by
match the control resolutions, e.g., operating a charger at every
ξi,t = (Di,t0 , Ti,t0 ) for t = t0 , . . . , Ti,t0 . When the charger is
1-5 minutes for fast charging rather than 15 minutes [45].
idle, ξi,t = (0, 0). With probability αi , ξi,t = (0, 0) transitions
Therefore, we introduces an integral parameter ℓ representing
to ξi,t+1 = (Di,t+1 , Ti,t+1 ).
the total number of scheduling intervals contained in a mea-
2) System State and State Evolution: The state of charger
surement window, i.e., the length of a measurement window
i at interval t is given by a tuple xi,t = (ri,t , τi,t ), where ri,t
is identical to ℓ intervals, and its value obviously relies on the
represents the remaining demand to be served by deadline Ti,t
specific application settings, as shown in Fig. 2.
at charger i and τi,t = Ti,t − t the lead time to the EV’s
5) Reward: The reward collected from all the EVs at
deadline at interval t. Hence, the system state is modeled as
( interval t is given by
xi,t − (u i,t , 1) if τi,t ) > 1,
xi,t+1 = (1)
ξi,t if τi,t ≤ 1.
N
X X
G(xt , ut , ξ t ) = R1(π r − πte ) u i,t − q (ri,t − u i,t )
Note that when the charger is free, its state is (0, 0). When
i=1 i∈Jt
there is no EV arriving at charger i, the state of the charger
remains at (0, 0). (5)
3) Constraints: The total amount of power used for charg-
ing at one interval is limited by where 1 denotes the length of a scheduling interval and Jt
N the set of EVs that will leave at interval t + 1, i.e., Jt := {i :
τi,t = 1}.
X
u i,t ≤ M, t ∈ T , (2)
i=1 6) MDP Formulation: The objective of EV scheduling is
where M denotes the maximum number of simultaneous to find the optimal control policy {µ∗t }t∈T to maximize the
chargers allowed by the maximum power constraint of the expected total reward in the presence of the demand charge.
local transformer (M < N ). The charger cannot be activated At each interval t, a control law maps states to controls:
when no EV is connected:
ut = µt (xt , ξ t ). (6)
u i,t ≤ xi,t , i ∈ {1, . . . , N }, t ∈ T . (3)
4 The assumption on the Bernoulli process is made for the theoretical
analysis shown in Section III-C, whereas the algorithm proposed in this paper 5 For demand side management applications of power systems, the length
does not require specific EV arrival process. Thus ACN dataset can be used of a measurement window is often 15 or 30 minutes. In this paper we fix the
for the numerical tests shown in Section IV. value at 15 minutes.
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
YANG et al.: EV CHARGING SCHEDULING UNDER DEMAND CHARGE: A BLOCK MPC APPROACH 2129
Remark 3: The model defined in (7) can be easily extended With the amended state, it is much easier to apply the
to a much broader class of deferrable load scheduling under idea of MPC-based approaches on the reformulated problem
demand charge problems beyond EV-DC, such as applications (9). Generally, MPC considers the optimization problem of
mentioned in [46] and [33]. The main difficulties of dealing a shorter horizon {t, · · · , t + W } and utilizes a predicted
with the demand charge in the MDP framework come from the trajectory {ξ̂ k }t+W
k=t
−1
. As a result, BMPC solves the following
mismatch of different timescales. In particular, three timescales deterministic problem for a forecast window of length W with
coexist in the formulated model (See Fig. 2): the current state xt and φt at t ∈ T ′ :
III. B LOCK M ODEL P REDICTIVE C ONTROL where H(φt+W ) is the BMPC end-of-horizon cost (to be spec-
ified in Section III-B). The main difference between BMPC
We present a variation of the standard MPC scheduling to and the nominal MPC is the block structure. Instead of moving
address two demand charge related issues. The first arises from from t to t + 1, BMPC moves one block (ℓ intervals) at each
the mismatch between the EV charging control intervals and stage, i.e., from t to t + ℓ. The optimal controls of (10) in
the demand charge measurement periods. Instead of realizing a the first block {u∗t , · · · , u∗t+ℓ−1 } will be implemented. Others
single decision in each decision epoch in the traditional MPC, {u∗t+ℓ , · · · , u∗t+W −1 } are only advisory.
BMPC realizes a block of decisions. The second arises from Remark 4: Different from those EMPC methods [28] that
the need of appropriating the terminal demand charge cost to aim to minimize the gap between a controlled system and
each stage decision. The proposed framework is termed Block a reference in process control engineering, BMPC aims to
MPC because the rolling window moves a block of ℓ intervals maximize total reward for EV charging applications where
at a time. stability and tracking error are not of concern.
Remark 5: Generally, the complexity of BMPC grows
exponentially with the number of unfinished jobs, since the
A. Block Model Predictive Control Under Demand Charge decision variables are integers. However, the state-of-art com-
mercial solvers such as Gurobi and CPLEX work efficiently
To address the timescale mismatch issues arising from the to handle integer programs with over thousands of variables
demand charge (see Remark 2), we introduce an additional [47], [48], and the computation time of the proposed approach
system state φt at every interval t, which represents the highest is in an acceptable range, as shown in Section IV.
average consumption over an ℓ-sized measurement window The BMPC approach is summarized as Algorithm 1. Two
until interval t. The new state variable φt evolves according factors affect the performance of BMPC: an end-of-horizon
to cost H(φt+W ), and an initial guess on the maximum aver-
( Pt PN ) age consumption φ0 . The choice of the end-of-horizon cost
max φ , τ =t−ℓ+1 i=1 u i,τ
if t + 1 ∈ T ′ H(φt+W ) lies at the heart of BMPC solution to EV-DC.
t
φt+1 = ℓ Detailed discussions and comparisons are in Section III-B. The
φt initial guess φ0 can be derived by the mainstream techniques
otherwise,
(8) for load forecasting at the distribution level [49], [50], such as
regression or neural networks by using the historical demands
Note that φt+1 ≥ φt for every t ∈ T . Therefore, given the as the training samples. The influence on this value is also
system state x0 and φ0 , the EV-DC (7) can be equivalently discussed in Section III-C.
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
2130 IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, VOL. 21, NO. 2, APRIL 2024
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
YANG et al.: EV CHARGING SCHEDULING UNDER DEMAND CHARGE: A BLOCK MPC APPROACH 2131
TABLE I
PARAMETER S ETTINGS
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
2132 IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, VOL. 21, NO. 2, APRIL 2024
TABLE II larger gaps (near 40% at most) and showed better performance
AGGREGATION OF EV L OADS when the aggregation level increased. This was due to the less
flexibility of scheduling so that the demand charge tended to
be close to each other.
Another factor that affects the performance of BMPC is
the parameter M that limits the number of simultaneously
$/kW to 0.6 $/kW, where the length of a measurement window activated charging. According to (16), decreasing the value of
was still fixed at 15 minutes. M is equivalent to increasing the traffic intensity. In Fig. 4b,
we showed that the variation of M had the minimal influence
on the gap to optimality of BMPC.
B. On Gap to Optimality
Then we fixed the traffic intensity at 17% and demonstrated
For the optimal offline charging solution, an integer program the average performance gaps of BMPC and other methods
that defined the deterministic EV-DC was solved to compute with the variation of the demand charge prices, as shown in
the upper bound of the total reward by using realizations of Fig. 4b. EMPC [32] obtained the optimal reward over all the
the EV loads from each arrival trajectory ξ , as shown below: demand charge prices, while the results of BMPC were also
T −1
X close, showing only 1% gap when the demand charge price
J (ξ ) = max
∗
G(xt , ut , ξ t ) − C(ψξ ) reached 0.6 $/kW. The gap produced by MPC-scaled had a
{ut }t∈T
t=0 steady growth from 0 to 35% since its fixed weight of the
s.t. (1)(2)(3)(4). (17) demand charge could not accommodate high demand charge
prices. For the methods that do not consider demand charge,
By solving (17), we also obtained the optimal demand charge.
MPC-w/o and LLF-LD both experienced rapid increase as the
Furthermore, three related MPC approaches and one index
demand charge price was over 0.4 $/kW, hitting over 100%
rule were included as benchmarks in our comparison studies:
due to the large demand charge costs.
MPC with scaled demand charge (MPC-scaled), EMPC [32],
2) Multi-Resolution Case (ℓ = 3): In practice, the reso-
MPC without demand charge (MPC-w/o) and LLF-LD [27]
lution of control can be significantly finer than that of the
(see Appendix B). Then we ran each algorithm and computed
demand charge measurement. For example, the measurement
its total reward gap to the upper bound (in percentage) as
window size can be 15 minutes whereas the EV charging
the performance measure. For a given scenario, we simulated
decisions can be made at the one to five minute resolution,
all the methods over 30 trajectories and reported the average
i.e., ℓ = 3-15. The results presented in this section are from
performance.
simulations with ℓ = 3, i.e., 1 = 5 minutes.
Fig. 5a illustrated the performance of BMPC with the
C. Performance Under Perfect Forecast benchmarks over varied intensity of EV loads at a fixed
This section validates the performance of BMPC and other demand charge price 0.3 $/kW. Although Proposition 1 did
benchmarks under the ideal scenario, where we assume all the not hold when ℓ = 3, the average gap produced by BMPC
clients use reservation apps to offer accurate information on was close to the optimal at light traffic regime and less than
EV arrivals, charging demands and deadlines. 1% even the traffic level reached 29%-intensity. On the other
1) Single-Resolution Case (ℓ = 1): We first considered the hand, EMPC [32] showed sub-optimal solutions (between 2%
case when the resolution of measurement window matched and 10%) compared to the ℓ = 1 case, which resulted from the
that of the decision, i.e. ℓ = 1 (1 = 15 minutes). In this mismatching of the timescales of peak consumption from
case, BMPC operated at the same timescales as the other the reference trajectory (see (31) and (32) in Appendix B).
MPC-based benchmarks and the forecast window length was The performance of the rest of the methods, MPC-scaled,
set to W = 4 hours. MPC-w/o and LLF-LD, all had improvements when the EV
Fig. 4a showed the performance of BMPC with other loads became heavier. Due to the consideration of the demand
methods under different intensities of EV loads (x-axis) at charge, MPC-scaled outperformed MPC-w/o and LLF-LD by
a fixed demand charge price 0.3 $/kW, where the average 4% and 2% on average, respectively.
gaps to the upper bound over all the sampled trajectories The influence of the demand charge prices was also com-
(y-axis) were compared. The best method was EMPC [32], pared in Fig. 5b, where the traffic intensity was also fixed at
which actually reached the upper bound (0% gaps at all 17% as the previous section. BMPC was the best method to
traffic levels) because it tracked the optimal reference tra- handle the increase of the demand charge price, making only
jectory. BMPC also produced the optimal solutions before 1.5% gap at 0.6 $/kW. The performance of EMPC gradually
the intensity of the EV loads reached 17%, where all the deviated from the optimum compared to the ℓ = 1 case and
optimality conditions of BMPC could be met and therefore peaked at 6%. MPC-scaled had less than 2% performance gap
validated Proposition 1. Then slightly bigger gaps were shown when the demand charge price was below 0.2 $/kW, whereas
when the EV loads went more intensive, since the number it caused larger gaps (over 10%) as the demand charge was
of the decoupling intervals became less and the optimality more expensive. As for MPC-w/o and LLF-LD, they both
conditions could not be held at 17%-intensity and the above. showed a fast degradation on the total reward (at around 30%),
Consequently, a 0.6% gap rose up at 29%-intensity. The other resulting from the ignorance of the increasing demand charge
methods (MPC-scaled, MPC-w/o and LLF-LD) had much costs.
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
YANG et al.: EV CHARGING SCHEDULING UNDER DEMAND CHARGE: A BLOCK MPC APPROACH 2133
Fig. 4. Average performance gap to the upper bound under perfect forecast Fig. 5. Average performance gap to the upper bound under perfect forecast
with the system setting ℓ = 1. The average computation time of the BMPC with the system setting ℓ = 3. The average computation time of the BMPC
problems is 0.66s. problems is 0.86s.
TABLE III
C ASES FOR S IMULATIONS U NDER F ORECAST E RRORS
D. Performance Under Forecast Errors
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
2134 IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, VOL. 21, NO. 2, APRIL 2024
TABLE IV
AVERAGE P ERFORMANCE OF BMPC AND B ENCHMARKS U NDER 10% F ORECAST E RRORS (δr = δa = δe = δm = 0.1)
TABLE V
AVERAGE P ERFORMANCE OF BMPC AND B ENCHMARKS U NDER 20% F ORECAST E RRORS (δr = δa = δe = δm = 0.2)
the EVs. However, LLF-LD outperformed MPC-scaled by W/T on the demand charge was only able to handle low
around 1% when more demands were involved (see Case III) demand charge prices. EMPC [32], however, was dramatically
since more EVs would be reported inaccurately. When the affected by the increase of the forecast error in both reward and
demand charge price was high, i.e., Case II and Case IV, demand charge, causing nearly 20% reward gap in Case IV.
EMPC [32] was the second best method (6.69% and 12.51% Although MPC-w/o still produced the same demand charge as
reward gap respectively) with around 22% demand charge LLF-LD, their reward gap was getting larger to over 10% since
gap. It was found that the reward from EMPC [32] was more forecast errors were imposed to the forecast window.
more sensitive to the intensity levels rather than demand
charge prices, which might result from the predictions over the V. C ONCLUSION
entire trajectories (see Appendix C). It was also worth noting
We consider the problem of EV-DC to maximize the reward
that the demand charge was the major factor to determine
from charging services at a charging station. Due to the
the performance of MPC-w/o and LLF-LD, where MPC-w/o
difficulties of multiple timescales posed by the demand charge
showed the least performance in each case and could reach
pricing, we propose the BMPC algorithm with a special end-
over 18% reward gap.
of-horizon cost to incorporate the demand charge at each stage
Table V reported the performance of all the methods when
optimization, and the optimality conditions of the proposed
all the forecast errors increased to 0.2. Generally, the reward
method are presented and analyzed based on characterized
gaps from MPC-based methods became larger than the previ-
demand patterns. Through the simulations on the ACN testbed,
ous case, while LLF-LD was not affected since its performance
our proposed approach shows advantageous performances
did not depend on any predictions. BMPC continued to be the
compared to the benchmark methods, highlighting the signifi-
best method in all the cases except 1.33% more reward gap
cant impact of demand charge on the EV charging scheduling.
than LLF-LD in Case III. This would result from the fact
that BMPC took a block of controls based on the inaccurate
information for the near future. To be more specific, BMPC A PPENDIX A
committed to the charging actions {u∗t , u∗t+1 , · · · , u∗t+ℓ−1 } after P ROOF OF P ROPOSITION 1
solving (10) at t. The subsequent actions from u∗t , which Proof: We first show that the original EV-DC problem
were optimal for the predicted EV trajectory, would become (7) can be decomposed by t d . For a given trajectory ξ and x0 ,
sub-optimal for the realized EV profile. Such impact to lose We rewrite (7) in the deterministic form:
the schedule revenue would become more dominant when the T −1
forecast error was larger under heavier traffics. On the other
X
max Jξ (x0 ) = G(xt , ut , ξ t ) − C(ψξ )
hand, although BMPC did not follow the optimal demand {ut }t∈T
t=0
charge when φ0 was 20% less than the optimal peak, it pro- s.t. (1)(2)(3)(4) (18)
duced the closest gap between 7.69% and 25.00% among all
the benchmarks. We denote T d = {t pd , p = 1, . . . , P} as the set of the
Similarly to Table IV, MPC-scaled had good performance decoupling intervals over trajectory ξ . For each t pd where
with just 0.08% and 3.02% less reward than BMPC in Case I (xt pd , ξ t pd ) = (0, 0), the system state at t pd + 1 is not relevant
and Case III, respectively, and thus showed that the fix weight to the previous states, i.e., (1) is decoupled. Since the energy
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
YANG et al.: EV CHARGING SCHEDULING UNDER DEMAND CHARGE: A BLOCK MPC APPROACH 2135
requests before t pd cannot be deferred to intervals after t pd + 1, SP(BMPC) − S ′ (0) = {t1d , . . . , W − 1}:
the EV-DC problem (7) can be decomposed into P + 1 seg-
ments: S(0) = {0, . . . , t1d −1}, S( p) = {t pd , . . . , t p+1
d
−1} (1 ≤ W
X −1
of (7) be Jξ∗ (x0 ) and the optimal solution u∗ , then we have: k=t1d
− C(φt+W − φt1d )
P−1
X s.t. (10b)(10c)(10d)(10e) (22b)
Jξ∗ (x0 ) =Jξ∗,S(0) (x0 ) + Jξ∗,S( p) (xt pd ) + Jξ∗,S(P) (xt Pd )
p=1 td td
According to A8, {ξ̂ k }k=0
1 1
= {ξ t }t=0 , i.e., the scheduler knows
− C max ψξ ,S(0) , max ψξ ,S( p) , ψξ ,S(P) ,
∗ ∗ ∗ the accurate information to solve (21). The second optimality
1≤ p<P condition shows that φ0 = ψξ∗ , which indicates that φ0 ≥
(19) ψξ∗,S(0) . Without loss of generality, two cases are discussed.
1) ψξ∗ Happens in S(0): We have φt∗d = φ0 = ψξ∗ = ψξ∗,S(0)
where 1
since the scheduler would not necessarily rise the consumption
t1d −1 level beyond the optimal one. Otherwise, more penalty from
demand charge would reduce the total reward of the segment
X
Jξ∗,S(0) (x0 ) = G(xt , u∗t , ξ t ), (20a)
t=0 S(0). In other words, the optimal reward of (21) is the identical
d
t p+1 −1 to Jξ∗,S(0) (x0 ).
Jξ∗,S( p) (xt pd ) =
X
G(xt , u∗t , ξ t ), 1 ≤ p < P, (20b) 2) ψξ∗ Happens Out of S(0): It is obvious that φ0 >
ψξ ,S(0) . This provides a higher threshold on the maximum
∗
t=t pd
consumption of the segment S(0), and indicates that the last
T −1
X term of (21a) is not effective. Hence, the scheduler would
Jξ∗,S(P) (xt P ) = G(xt , u∗t , ξ t ), (20c) not take demand charge into consideration so that the optimal
t=t P
reward of (21) is also identical to the Jξ∗,S(0) (x0 ), where the
N
X latter also ignores the demand charge in the one-shot solution.
ψξ∗,S(0) = max ∗
u i,t , (20d)
t∈S(0) Consequently, for both cases shown above, we have the
i=1
N
optimal reward of (21) Jξ∗,S(0) (x′0 , φ0 ) = Jξ∗,S(0) (x0 ), and the
ψξ∗,S( p) = max
X
∗
u i,t , 1 ≤ p < P, (20e) optimal solution u′∗ 0 of (21) must be within the optimal set
t∈S( p)
i=1
U ∗ , i.e., u′∗
0 ∈U .
∗
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
2136 IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, VOL. 21, NO. 2, APRIL 2024
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
YANG et al.: EV CHARGING SCHEDULING UNDER DEMAND CHARGE: A BLOCK MPC APPROACH 2137
i.e., from t = 0 to T − 1. We denote {ξ ref t }t∈T as the forecast [18] Q. Huang, Q. S. Jia, Z. Qiu, X. Guan, and G. Deconinck, “Matching EV
EV loads, then the reference trajectory can be computed by charging load with uncertain wind: A simulation-based policy improve-
ment approach,” IEEE Trans. Smart Grid, vol. 6, no. 3, pp. 1425–1433,
the following deterministic EV-DC problem: May 2015.
X [19] Q. Huang, Q.-S. Jia, and X. Guan, “A multi-timescale and bilevel
max Gt (xt , ut , ξ ref
t ) − C(ψ) coordination approach for matching uncertain wind supply with EV
{ut }t∈T charging demand,” IEEE Trans. Autom. Sci. Eng., vol. 14, no. 2,
t∈T
( pp. 694–704, Apr. 2016.
xi,t − (u i,t , 1) if τi,t > 1, (35) [20] Z. Jiang, Q. Jia, and X. Guan, “A computing budget allocation method
s.t. xi,t+1 =
ξi,t
ref
if τi,t ≤ 1, for minimizing EV charging cost using uncertain wind power,” IEEE
Trans. Autom. Sci. Eng., vol. 18, no. 2, pp. 681–692, Apr. 2021.
and (2)(3)(4), [21] Y. Xu, F. Pan, and L. Tong, “Dynamic scheduling for charging electric
vehicles: A priority rule,” IEEE Trans. Autom. Control, vol. 61, no. 12,
By denoting (xref , uref ) as the optimal solution of (35), the pp. 4094–4099, Dec. 2016.
[22] J. Jin and Y. Xu, “Joint scheduling of electric vehicle charging and
reference trajectory can be obtained as (xref , uref , ξ ref ). energy storage operation,” in Proc. IEEE Conf. Decis. Control (CDC),
Dec. 2018, pp. 4103–4109.
[23] Z. Yu, Y. Xu, and L. Tong, “Deadline scheduling as restless ban-
R EFERENCES dits,” IEEE Trans. Autom. Control, vol. 63, no. 8, pp. 2343–2358,
Aug. 2018.
[1] K. Clement-Nyns, E. Haesen, and J. Driesen, “The impact of charging
plug-in hybrid electric vehicles on a residential distribution grid,” IEEE [24] L. Hao and Y. Xu, “Index policies for stochastic deadline scheduling
Trans. Power Syst., vol. 25, no. 1, pp. 371–380, Feb. 2009. with time-varying processing rate limits,” in Proc. Amer. Control Conf.
(ACC), Jul. 2020, pp. 204–210.
[2] Z. Ma, D. S. Callaway, and I. A. Hiskens, “Decentralized charging
control of large populations of plug-in electric vehicles,” IEEE Trans. [25] J. Jin and Y. Xu, “Optimal policy characterization enhanced actor-critic
Control Syst. Technol., vol. 21, no. 1, pp. 67–78, Dec. 2012. approach for electric vehicle charging scheduling in a power distribution
network,” IEEE Trans. Smart Grid, vol. 12, no. 2, pp. 1416–1428,
[3] L. Gan, U. Topcu, and S. H. Low, “Optimal decentralized protocol
Mar. 2021.
for electric vehicle charging,” IEEE Trans. Power Syst., vol. 28, no. 2,
pp. 940–951, May 2013. [26] P. Whittle, “Restless bandits: Activity allocation in a changing world,”
J. Appl. Probab., vol. 25, pp. 287–298, Jan. 1988.
[4] J. Rivera, C. Goebel, and H.-A. Jacobsen, “Distributed convex optimiza-
tion for electric vehicle aggregators,” IEEE Trans. Smart Grid, vol. 8, [27] J. Jin, L. Hao, Y. Xu, J. Wu, and Q.-S. Jia, “Joint scheduling of deferrable
no. 4, pp. 1852–1863, Jul. 2017. demand and storage with random supply and processing rate limits,”
IEEE Trans. Autom. Control, vol. 66, no. 11, pp. 5506–5513, Nov. 2021.
[5] C. Le Floch, S. Bansal, C. J. Tomlin, S. J. Moura, and M. N. Zeilinger,
“Plug-and-play model predictive control for load shaping and voltage [28] M. Ellis, H. Durand, and P. D. Christofides, “A tutorial review of
control in smart grids,” IEEE Trans. Smart Grid, vol. 10, no. 3, economic model predictive control methods,” J. Process Control, vol. 24,
pp. 2334–2344, May 2019. no. 8, pp. 1156–1178, Aug. 2014.
[6] Y. Yang, Q.-S. Jia, X. Guan, X. Zhang, Z. Qiu, and G. Deconinck, [29] R. Halvgaard, N. K. Poulsen, H. Madsen, J. B. Jorgensen, F. Marra,
“Decentralized EV-based charging optimization with building inte- and D. E. M. Bondy, “Electric vehicle charge planning using economic
grated wind energy,” IEEE Trans. Autom. Sci. Eng., vol. 16, no. 3, model predictive control,” in Proc. IEEE Int. Electr. Vehicle Conf.,
pp. 1002–1017, Jul. 2019. Mar. 2012, pp. 1–6.
[7] K. Ojand and H. Dagdougui, “Q-learning-based model predictive control [30] J. Engel, T. Schmitt, T. Rodemann, and J. Adamy, “Hierarchical
for energy management in residential aggregator,” IEEE Trans. Autom. economic model predictive control approach for a building energy
Sci. Eng., vol. 19, no. 1, pp. 70–81, Jan. 2022. management system with scenario-driven EV charging,” IEEE Trans.
[8] Z. J. Lee et al., “Adaptive charging networks: A framework for smart Smart Grid, vol. 13, no. 4, pp. 3082–3093, Jul. 2022.
electric vehicle charging,” IEEE Trans. Smart Grid, vol. 12, no. 5, [31] R. Kumar, M. J. Wenzel, M. J. Ellis, M. N. ElBsat, K. H. Drees, and
pp. 4339–4350, Sep. 2021. V. M. Zavala, “A stochastic model predictive control framework for
[9] Z. J. Lee, S. Sharma, D. Johansson, and S. H. Low, “ACN-Sim: stationary battery systems,” IEEE Trans. Power Syst., vol. 33, no. 4,
An open-source simulator for data-driven electric vehicle charging pp. 4397–4406, Jul. 2018.
research,” IEEE Trans. Smart Grid, vol. 12, no. 6, pp. 5113–5123, [32] M. J. Risbeck and J. B. Rawlings, “Economic model predictive control
Nov. 2021. for time-varying cost and peak demand charge optimization,” IEEE
[10] C. L. Liu and J. W. Layland, “Scheduling algorithms for multipro- Trans. Autom. Control, vol. 65, no. 7, pp. 2957–2968, Jul. 2020.
gramming in a hard-real-time environment,” J. ACM, vol. 20, no. 1, [33] M. Dabbagh, B. Hamdaoui, A. Rayes, and M. Guizani, “Shaving data
pp. 46–61, 1973. center power demand peaks through energy storage and workload shift-
[11] A. K.-L. Mok, “Fundamental design problems of distributed systems for ing control,” IEEE Trans. Cloud Comput., vol. 7, no. 4, pp. 1095–1108,
the hard-real-time environment,” Ph.D. dissertation, Massachusetts Inst. Oct. 2019.
Technol., Cambridge, MA, USA, 1983. [34] J. Jin and Y. Xu, “Optimal storage operation under demand charge,”
[12] S. S. Panwar, D. Towsley, and J. K. Wolf, “Optimal scheduling policies IEEE Trans. Power Syst., vol. 32, no. 1, pp. 795–808, Jan. 2017.
for a class of queues with customer deadlines to the beginning of [35] S. Chen and L. Tong, “IEMS for large scale charging of electric
service,” J. ACM, vol. 35, no. 4, pp. 832–844, 1988. vehicles: Architecture and optimal online scheduling,” in Proc. IEEE
[13] S. Chen, L. Tong, and T. He, “Optimal deadline scheduling with 3rd Int. Conf. Smart Grid Commun. (SmartGridComm), Nov. 2012,
commitment,” in Proc. 49th Annu. Allerton Conf. Commun., Control, pp. 629–634.
Comput. (Allerton), Sep. 2011, pp. 111–118. [36] Z. Yu, S. Chen, and L. Tong, “An intelligent energy management system
[14] A. Subramanian, M. J. Garcia, D. S. Callaway, K. Poolla, and P. Varaiya, for large-scale charging of electric vehicles,” CSEE J. Power Energy
“Real-time scheduling of distributed resources,” IEEE Trans. Smart Syst., vol. 2, no. 1, pp. 47–53, Mar. 2016.
Grid, vol. 4, no. 4, pp. 2122–2130, Dec. 2013. [37] Y. Qin, Z. Bei, and M. Kezunovic, “Optimized operational cost reduction
[15] N. Chen, C. Kurniawan, Y. Nakahira, L. Chen, and S. H. Low, for an EV charging station integrated with battery energy storage and
“Smoothed least-laxity-first algorithm for electric vehicle charging: PV generation,” IEEE Trans. Smart Grid, vol. 10, no. 2, pp. 2096–2106,
Online decision and performance analysis with resource augmentation,” Mar. 2018.
IEEE Trans. Smart Grid, vol. 13, no. 3, pp. 2209–2217, May 2022. [38] M. S. Athulya, A. Visakh, and M. P. Selvan, “Electric vehicle recharge
[16] Y. Xu and F. Pan, “Scheduling for charging plug-in hybrid electric scheduling in a shopping mall charging station,” in Proc. 21st Nat. Power
vehicles,” in Proc. IEEE 51st IEEE Conf. Decis. Control (CDC), Syst. Conf. (NPSC), Dec. 2020, pp. 1–6.
Dec. 2012, pp. 2495–2501. [39] H. Zhang, Z. Hu, Z. Xu, and Y. Song, “Optimal planning of
[17] Z. Yu, Y. Xu, and L. Tong, “Large scale charging of electric vehicles: PEV charging station with single output multiple cables charging
A multi-armed bandit approach,” in Proc. 53rd Annu. Allerton Conf. spots,” IEEE Trans. Smart Grid, vol. 8, no. 5, pp. 2119–2128,
Commun., Control, Comput. (Allerton), Sep. 2015, pp. 389–395. Sep. 2017.
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.
2138 IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, VOL. 21, NO. 2, APRIL 2024
[40] M. Yilmaz and P. T. Krein, “Review of battery charger topologies, Xinbo Geng (Member, IEEE) received the B.E.
charging power levels, and infrastructure for plug-in electric and hybrid degree in electrical engineering from Tsinghua Uni-
vehicles,” IEEE Trans. Power Electron., vol. 28, no. 5, pp. 2151–2169, versity, Beijing, China, in 2013, and the M.S. and
May 2013. Ph.D. degrees in electrical engineering from the
[41] L. Zhang, M. Yang, and Z. Zhao, “Game analysis of charging service Department of Electrical and Computer Engineering,
fee based on benefit of multi-party participants: A case study analysis Texas A&M University, College Station, TX, USA,
in China,” Sustain. Cities Soc., vol. 48, Jan. 2019, Art. no. 101528. in 2015 and 2019, respectively.
[42] E. Bitar and Y. Xu, “Deadline differentiated pricing of deferrable electric He was a Power System Design and Studies Intern
loads,” IEEE Trans. Smart Grid, vol. 8, no. 1, pp. 13–25, Jan. 2017. with the National Renewable Energy Laboratory in
[43] Y. Kim, J. Kwak, and S. Chong, “Dynamic pricing, scheduling, and 2016; a Data Analyst Intern with ISO New England
energy management for profit maximization in PHEV charging stations,” in 2017; a Visiting Student with the University
IEEE Trans. Veh. Technol., vol. 66, no. 2, pp. 1011–1026, Feb. 2017. of California at Berkeley and the Massachusetts Institute of Technology,
[44] H. Chen, Z. Hu, H. Luo, J. Qin, R. Rajagopal, and H. Zhang, “Design Cambridge, MA, USA, in 2018; a Visiting Student with the University
and planning of a multiple-charger multiple-port charging system for of Wisconsin–Madison, Madison, WI, USA, in 2019; and a Post-Doctoral
PEV charging station,” IEEE Trans. Smart Grid, vol. 10, no. 1, Researcher jointly affiliated with Cornell University, Ithaca, NY, USA, and
pp. 173–183, Jan. 2017. Texas A&M University from 2020 to 2021. His research interests include
[45] N. Machiels, N. Leemput, F. Geth, J. Van Roy, J. Büscher, and J. Driesen, decision-making under uncertainties.
“Design criteria for electric vehicle fast charge infrastructure based on
flemish mobility behavior,” IEEE Trans. Smart Grid, vol. 5, no. 1,
pp. 320–327, Jan. 2014.
[46] M. Rahmani-Andebili, “Scheduling deferrable appliances and energy
resources of a smart home applying multi-time scale stochastic model Xiaohong Guan (Life Fellow, IEEE) received the
predictive control,” Sustain. Cities Soc., vol. 32, pp. 338–347, Jul. 2017. B.S. and M.S. degrees in control engineering from
Tsinghua University, Beijing, China, in 1982 and
[47] Gurobi. Gurobi 9.5 Performance Benchmarks. Accessed: Nov. 1, 2022.
1985, respectively, and the Ph.D. degree in electrical
[Online]. Available: https://www.gurobi.com/features/gurobi-optimizer-
and systems engineering from the University of
delivers-unmatched-performance
Connecticut, Storrs, in 1993.
[48] CPLEX Optimization Studio 12.10 Performance Improvements. He was a Senior Consulting Engineer with Pacific
Accessed: Nov. 1, 2022. [Online]. Available: https://www.ibm.com/ Gas and Electric from 1993 to 1995. He visited the
products/ilog-cplex-optimization-studio/cplex-optimizer Division of Engineering and Applied Science, Har-
[49] W. Charytoniuk, M. S. Chen, P. Kotas, and P. V. Olinda, “Demand vard University, from 1999 to 2000. From 1985 to
forecasting in power distribution systems using nonparametric prob- 1988 and since 1995, he has been with Xi’an Jiao-
ability density estimation,” IEEE Trans. Power Syst., vol. 14, no. 4, tong University, Xi’an, China. He has been the Cheung Kong Professor
pp. 1200–1206, Nov. 1999. of Systems Engineering since 1999. He was the Director of the State Key
[50] A. K. Singh, S. Khatoon, M. Muazzam, and D. K. Chaturvedi, “Load Laboratory for Manufacturing Systems from 1999 to 2009 and the Dean of
forecasting techniques and methodologies: A review,” in Proc. 2nd Int. the School of Electronic and Information Engineering from 2008 to 2018.
Conf. Power, Control Embedded Syst., Dec. 2012, pp. 1–10. Since 2001, he has also been with the Center for Intelligent and Networked
[51] V. Jain, A. Sharma, and L. Subramanian, “Road traffic congestion in Systems, Tsinghua University, where was the Head of the Department of
the developing world,” in Proc. 2nd ACM Symp. Comput. Develop., Automation from 2003 to 2008. He has been the Dean of the Faculty of
Mar. 2012, pp. 1–10. Electronic and Information Engineering since 2019. His research interests
[52] Z. J. Lee, T. Li, and S. H. Low, “ACN-Data: Analysis and applications include economics and security of networked systems, including power and
of an open EV charging dataset,” in Proc. 10th ACM Int. Conf. Future energy systems, manufacturing systems, and cyber-physical systems. He is a
Energy Syst., Jun. 2019, pp. 139–149. member of the Chinese Academy of Sciences.
Authorized licensed use limited to: National Institute of Technology - Jamshedpur. Downloaded on March 08,2025 at 11:53:06 UTC from IEEE Xplore. Restrictions apply.