Parallel and distributed computing for stochastic dual dynamic programming

We study different parallelization schemes for the stochastic dual dynamic programming (SDDP) algorithm. We propose a taxonomy for these parallel algorithms, which is based on the concept of parallelizing by scenario and parallelizing by node of the underlying stochastic process. We develop a synchr...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Computational management science Ročník 19; číslo 2; s. 199 - 226
Hlavní autori: Ávila, D., Papavasiliou, A., Löhndorf, N.
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Berlin/Heidelberg Springer Berlin Heidelberg 01.06.2022
Springer Nature B.V
Predmet:
Algorithms
Business and Management
Computer networks
Configurations
Distributed processing
Dynamic programming
Hyperplanes
Nodes
Operations Research/Decision Theory
Optimization
Original Paper
Stochastic processes
Taxonomy
Parallel computing
Stochastic dual dynamic programming
Multistage stochastic programming
High performance computing
Distributed computing
ISSN:1619-697X, 1619-6988
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:We study different parallelization schemes for the stochastic dual dynamic programming (SDDP) algorithm. We propose a taxonomy for these parallel algorithms, which is based on the concept of parallelizing by scenario and parallelizing by node of the underlying stochastic process. We develop a synchronous and asynchronous version for each configuration. The parallelization strategy in the parallelscenario configuration aims at parallelizing the Monte Carlo sampling procedure in the forward pass of the SDDP algorithm, and thus generates a large number of supporting hyperplanes in parallel. On the other hand, the parallel-node strategy aims at building a single hyperplane of the dynamic programming value function in parallel. The considered algorithms are implemented using Julia and JuMP on a high performance computing cluster. We study the effectiveness of the methods in terms of achieving tight optimality gaps, as well as the scalability properties of the algorithms with respect to an increasing number of CPUs. In particular, we study the effects of the different parallelization strategies on performance when increasing the number of Monte Carlo samples in the forward pass, and demonstrate through numerical experiments that such an increase may be harmful. Our results indicate that a parallel-node strategy presents certain benefits as compared to a parallel-scenario configuration.
Bibliografia:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1619-697X
1619-6988
DOI:10.1007/s10287-021-00411-x