An approximate dynamic programming algorithm for short-term electric vehicle fleet operation under uncertainty

This paper considers the dynamic problem of optimally operating a fleet of plug-in hybrid electric vehicles in a market environment. With uncertainty in future electricity prices and driving demands, we formulate a Markov decision process and determine a cost-minimizing policy for using the engine a...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Applied energy Ročník 325; s. 119793
Hlavní autoři: Lee, Sangmin, Boomsma, Trine Krogh
Médium: Journal Article
Jazyk:angličtina
Vydáno: Elsevier Ltd 01.11.2022
Témata:
algorithms
Approximate dynamic programming
batteries
electric vehicles
electricity
energy
gasoline
issues and policy
Least squares Monte Carlo
markets
Monte Carlo method
Plug-in hybrid vehicles
regression analysis
uncertainty
Plug-in hybrid vehicles
Approximate dynamic programming
Least squares Monte Carlo
ISSN:0306-2619, 1872-9118
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:This paper considers the dynamic problem of optimally operating a fleet of plug-in hybrid electric vehicles in a market environment. With uncertainty in future electricity prices and driving demands, we formulate a Markov decision process and determine a cost-minimizing policy for using the engine and charging and discharging the battery. As such, the policy is based on the trade-off between the costs of gasoline and electricity and between current and future power prices. To accommodate an inhomogeneous fleet composition and overcome the computational challenges of stochastic and dynamic optimization, including large-scale state and action spaces, we adopt the methodology of approximate dynamic programming. More specifically, using simulation and value function approximation by linear regression, we apply a least squares Monte Carlo method. This methodology allows for scaling with respect to fleet size and we are able to establish convergence of our algorithm for 100 vehicles by using 5000 samples in the simulation. Our results show that the vehicles should generally discharge the battery rather than using the engine unless battery capacity is insufficient to fully cover driving demand, but the timing of battery charging should be according to power prices. When comparing our policy to the simple policy of immediate charging, we demonstrate superiority for small and medium-sized fleets, with 2%–4% cost differences. •Short-term electric vehicle fleet operation under uncertainty is considered.•Least squares Monte Carlo is used to handle scalability and short-term dynamics.•For small and medium-sized fleets, the proposed policy outperforms a simple policy.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:0306-2619
1872-9118
DOI:10.1016/j.apenergy.2022.119793