Multidimensional Parallel Dynamic Programming Algorithm Based on Spark for Large-Scale Hydropower Systems

The “curse of dimensionality” is a major problem in dynamic programming (DP) algorithms for large-scale hydropower systems. This study proposes a parallel DP algorithm based on Spark (PDPoS) to alleviate the “curse of dimensionality”. Parallel computing experiments are formulated by varying the numb...

Full description

Saved in:

Bibliographic Details
Published in:	Water resources management Vol. 34; no. 11; pp. 3427 - 3444
Main Authors:	Ma, Yufei, Zhong, Ping-an, Xu, Bin, Zhu, Feilin, Xiao, Yao, Lu, Qingwen
Format:	Journal Article
Language:	English
Published:	Dordrecht Springer Netherlands 01.09.2020 Springer Nature B.V
Subjects:	administrative management Algorithms Atmospheric Sciences China Civil Engineering Cores Dynamic programming Earth and Environmental Science Earth Sciences Efficiency Environment Geotechnical Engineering & Applied Earth Sciences Hydroelectric power Hydrogeology Hydrology/Water Resources Mathematical analysis Reservoirs River basins Run time (computers) water Water levels water power watersheds China Hydropower operation Curse of dimensionality Multidimensional dynamic programming Parallel computing Spark
ISSN:	0920-4741, 1573-1650
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Abstract	The “curse of dimensionality” is a major problem in dynamic programming (DP) algorithms for large-scale hydropower systems. This study proposes a parallel DP algorithm based on Spark (PDPoS) to alleviate the “curse of dimensionality”. Parallel computing experiments are formulated by varying the number of reservoirs, the number of discrete water levels and the number of CPU cores to analyze the quality and efficiency of PDPoS. The methodologies were applied to a cascade reservoir system made up of eight reservoirs in the Yuanshui River Basin in China. The results are as follows. (1) The number of discrete water levels is the dominant factor in the solution quality, while the number of reservoirs is the dominant factor in the solving efficiency. (2) The runtime of PDPoS is markedly affected by the calculational scale (determined by the number of reservoirs and discrete water levels), and the relationship between the number of CPU cores and the runtime is triphasic with increasing calculational scale. (3) The larger the calculational scale is, the better the parallel performance (i.e., the parallel speedup and parallel efficiency). The proposed PDPoS method has strong generality, high parallel performance, and high practical value.
AbstractList	The “curse of dimensionality” is a major problem in dynamic programming (DP) algorithms for large-scale hydropower systems. This study proposes a parallel DP algorithm based on Spark (PDPoS) to alleviate the “curse of dimensionality”. Parallel computing experiments are formulated by varying the number of reservoirs, the number of discrete water levels and the number of CPU cores to analyze the quality and efficiency of PDPoS. The methodologies were applied to a cascade reservoir system made up of eight reservoirs in the Yuanshui River Basin in China. The results are as follows. (1) The number of discrete water levels is the dominant factor in the solution quality, while the number of reservoirs is the dominant factor in the solving efficiency. (2) The runtime of PDPoS is markedly affected by the calculational scale (determined by the number of reservoirs and discrete water levels), and the relationship between the number of CPU cores and the runtime is triphasic with increasing calculational scale. (3) The larger the calculational scale is, the better the parallel performance (i.e., the parallel speedup and parallel efficiency). The proposed PDPoS method has strong generality, high parallel performance, and high practical value.
Author	Xu, Bin Zhu, Feilin Lu, Qingwen Zhong, Ping-an Ma, Yufei Xiao, Yao
Author_xml	– sequence: 1 givenname: Yufei surname: Ma fullname: Ma, Yufei organization: College of Hydrology and Water Resources, Hohai University – sequence: 2 givenname: Ping-an surname: Zhong fullname: Zhong, Ping-an email: pazhong@hhu.edu.cn organization: College of Hydrology and Water Resources, Hohai University – sequence: 3 givenname: Bin orcidid: 0000-0002-1281-5560 surname: Xu fullname: Xu, Bin email: xubin_hhu@hhu.edu.cn organization: College of Hydrology and Water Resources, Hohai University, State Key Laboratory of Hydrology-Water Resources and Hydraulic Engineering, Nanjing Hydraulic Research Institute – sequence: 4 givenname: Feilin surname: Zhu fullname: Zhu, Feilin organization: College of Hydrology and Water Resources, Hohai University – sequence: 5 givenname: Yao surname: Xiao fullname: Xiao, Yao organization: College of Hydrology and Water Resources, Hohai University – sequence: 6 givenname: Qingwen surname: Lu fullname: Lu, Qingwen organization: College of Hydrology and Water Resources, Hohai University
BookMark	eNp9kE1rFDEYgINUcFv9A54CXryMTTL5PNZarbDSwrbnkM28M6ZmkjWZRfbfN3YFoYceQg55nvcNzyk6STkBQu8p-UQJUeeVUiZNRxhpR0jZmVdoRYXqOyoFOUErYtoTV5y-Qae1PhDSNENWKPzYxyUMYYZUQ04u4ltXXIwQ8ZdDcnPw-Lbkqbh5DmnCF3HKJSw_Z_zZVRhwTnizc-UXHnPBa1cm6DbeRcDXh6HkXf4DBW8OdYG5vkWvRxcrvPt3n6H7r1d3l9fd-ubb98uLded7wZYOBDOCaeKUGb0kwIjkQismqCGUDkoJ7fkwGr_d6tGzXjkpPeMMhkFvNdf9Gfp4nLsr-fce6mLnUD3E6BLkfbXMaCGNoD1t6Idn6EPelxahUbxXkktJeKPYkfIl11pgtLsSZlcOlhL7t7491retvn2qb02T9DPJh8UtLfFSXIgvq_1RrW1PmqD8_9UL1iOa7JsS
CitedBy_id	crossref_primary_10_2166_ws_2021_236 crossref_primary_10_1007_s11269_020_02751_w crossref_primary_10_1016_j_renene_2023_04_069 crossref_primary_10_1007_s11269_022_03141_0 crossref_primary_10_1007_s11269_021_02859_7 crossref_primary_10_1016_j_jhydrol_2021_126444 crossref_primary_10_1016_j_energy_2023_129834 crossref_primary_10_1007_s11269_021_02842_2 crossref_primary_10_1016_j_jhydrol_2025_133967
Cites_doi	10.3354/cr00999 10.1007/BF00940421 10.1016/j.energy.2017.03.069 10.3880/j.issn.1006-7647.2017.02.009 10.1016/j.apenergy.2019.113535 10.1016/j.cie.2013.02.003 10.1145/1327452.1327492 10.1016/j.future.2008.07.009 10.1145/1629175.1629198 10.1061/(ASCE)0733-9496(2004)130:2(93 10.1061/(ASCE)0733-9496(2007)133:3(192 10.1016/S0045-7906(01)00039-8 10.1007/s11269-015-1208-3 10.1007/s11269-018-1945-1 10.1002/2014WR016828 10.1016/0005-1098(70)90095-6 10.2166/hydro.2018.116 10.1029/WR007i002p00273 10.1016/j.advwatres.2014.01.002 10.1007/s11269-017-1662-1 10.1029/WR004i003p00471 10.1061/(ASCE)WR.1943-5452.0000205 10.1098/rsta.2009.0053 10.1007/s00500-019-04188-9 10.1109/PAAP.2015.41
ContentType	Journal Article
Copyright	Springer Nature B.V. 2020 Springer Nature B.V. 2020.
Copyright_xml	– notice: Springer Nature B.V. 2020 – notice: Springer Nature B.V. 2020.
DBID	AAYXX CITATION 3V. 7QH 7ST 7UA 7WY 7WZ 7XB 87Z 88I 8FD 8FE 8FG 8FH 8FK 8FL ABJCF ABUWG AEUYN AFKRA ATCPS AZQEC BBNVY BENPR BEZIV BGLVJ BHPHI BKSAR C1K CCPQU DWQXO F1W FR3 FRNLG F~G GNUQQ H97 HCIFZ K60 K6~ KR7 L.- L.G L6V LK8 M0C M2P M7P M7S PATMY PCBAR PHGZM PHGZT PKEHL PQBIZ PQBZA PQEST PQGLB PQQKQ PQUKI PTHSS PYCSY Q9U SOI 7S9 L.6
DOI	10.1007/s11269-020-02566-9
DatabaseName	CrossRef ProQuest Central (Corporate) Aqualine Environment Abstracts Water Resources Abstracts ABI/INFORM Collection ABI/INFORM Global (PDF only) ProQuest Central (purchase pre-March 2016) ABI/INFORM Global (Alumni Edition) Science Database (Alumni Edition) Technology Research Database ProQuest SciTech Collection ProQuest Technology Collection ProQuest Natural Science Collection ProQuest Central (Alumni) (purchase pre-March 2016) ABI/INFORM Collection (Alumni) Materials Science & Engineering Collection ProQuest Central (Alumni) ProQuest One Sustainability ProQuest Central UK/Ireland Agricultural & Environmental Science Collection ProQuest Central Essentials Biological Science Collection ProQuest Central Business Premium Collection Technology Collection Natural Science Collection Earth, Atmospheric & Aquatic Science Collection Environmental Sciences and Pollution Management ProQuest One ProQuest Central Korea ASFA: Aquatic Sciences and Fisheries Abstracts Engineering Research Database Business Premium Collection (Alumni) ABI/INFORM Global (Corporate) ProQuest Central Student Aquatic Science & Fisheries Abstracts (ASFA) 3: Aquatic Pollution & Environmental Quality SciTech Premium Collection ProQuest Business Collection (Alumni Edition) ProQuest Business Collection Civil Engineering Abstracts ABI/INFORM Professional Advanced Aquatic Science & Fisheries Abstracts (ASFA) Professional ProQuest Engineering Collection ProQuest Biological Science Collection ABI/INFORM Global Science Database (ProQuest) Biological Science Database Engineering Database Environmental Science Database Earth, Atmospheric & Aquatic Science Database ProQuest Central Premium ProQuest One Academic (New) ProQuest One Academic Middle East (New) ProQuest One Business ProQuest One Business (Alumni) ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition Engineering Collection Environmental Science Collection ProQuest Central Basic Environment Abstracts AGRICOLA AGRICOLA - Academic
DatabaseTitle	CrossRef ProQuest Business Collection (Alumni Edition) ProQuest Central Student ProQuest Central Essentials SciTech Premium Collection ABI/INFORM Complete Aquatic Science & Fisheries Abstracts (ASFA) 3: Aquatic Pollution & Environmental Quality Water Resources Abstracts Environmental Sciences and Pollution Management ProQuest One Applied & Life Sciences ProQuest One Sustainability Natural Science Collection Biological Science Collection ProQuest Central (New) Engineering Collection Business Premium Collection ABI/INFORM Global Engineering Database ProQuest Science Journals (Alumni Edition) ProQuest Biological Science Collection ProQuest One Academic Eastern Edition Earth, Atmospheric & Aquatic Science Database ProQuest Technology Collection Biological Science Database ProQuest Business Collection Aqualine Environmental Science Collection ProQuest One Academic UKI Edition Environmental Science Database Engineering Research Database ProQuest One Academic ProQuest One Academic (New) ABI/INFORM Global (Corporate) ProQuest One Business Aquatic Science & Fisheries Abstracts (ASFA) Professional Technology Collection Technology Research Database ProQuest One Academic Middle East (New) ProQuest Central (Alumni Edition) ProQuest One Community College ProQuest Natural Science Collection ProQuest Central Earth, Atmospheric & Aquatic Science Collection ABI/INFORM Professional Advanced ProQuest Engineering Collection ProQuest Central Korea Agricultural & Environmental Science Collection ABI/INFORM Complete (Alumni Edition) Civil Engineering Abstracts ABI/INFORM Global (Alumni Edition) ProQuest Central Basic ProQuest Science Journals ProQuest SciTech Collection ASFA: Aquatic Sciences and Fisheries Abstracts Materials Science & Engineering Collection ProQuest One Business (Alumni) Environment Abstracts ProQuest Central (Alumni) Business Premium Collection (Alumni) AGRICOLA AGRICOLA - Academic
DatabaseTitleList	ProQuest Business Collection (Alumni Edition) AGRICOLA
Database_xml	– sequence: 1 dbid: BENPR name: ProQuest Central url: https://www.proquest.com/central sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Engineering
EISSN	1573-1650
EndPage	3444
ExternalDocumentID	10_1007_s11269_020_02566_9
GeographicLocations	China
GeographicLocations_xml	– name: China
GrantInformation_xml	– fundername: Key Technologies Research and Development Program grantid: Grant No. 2017YFC0405606 funderid: http://dx.doi.org/10.13039/501100012165
GroupedDBID	-5A -5G -5~ -BR -EM -Y2 -~C .86 .VR 06D 0R~ 0VY 123 1N0 1SB 2.D 203 28- 29R 2J2 2JN 2JY 2KG 2KM 2LR 2P1 2VQ 2~H 30V 3V. 4.4 406 408 409 40D 40E 4P2 5QI 5VS 67M 67Z 6NX 78A 7WY 7XC 88I 8CJ 8FE 8FG 8FH 8FL 8TC 8UJ 95- 95. 95~ 96X AAAVM AABHQ AACDK AAHBH AAHNG AAIAL AAJBT AAJKR AANZL AARHV AARTL AASML AATNV AATVU AAUYE AAWCG AAYIU AAYQN AAYTO AAYZH ABAKF ABBBX ABBXA ABDZT ABECU ABFTD ABFTV ABHLI ABHQN ABJCF ABJNI ABJOX ABKCH ABKTR ABMNI ABMQK ABNWP ABQBU ABQSL ABSXP ABTEG ABTHY ABTKH ABTMW ABULA ABUWG ABWNU ABXPI ACAOD ACBXY ACDTI ACGFS ACGOD ACHSB ACHXU ACIWK ACKNC ACMDZ ACMLO ACOKC ACOMO ACPIV ACPRK ACSNA ACZOJ ADBBV ADHHG ADHIR ADIMF ADINQ ADKNI ADKPE ADRFC ADTPH ADURQ ADYFF ADZKW AEBTG AEFIE AEFQL AEGAL AEGNC AEJHL AEJRE AEKMD AEMSY AENEX AEOHA AEPYU AESKC AETLH AEUYN AEVLU AEXYK AFBBN AFEXP AFGCZ AFKRA AFLOW AFQWF AFRAH AFWTZ AFZKB AGAYW AGDGC AGGDS AGJBK AGMZJ AGQEE AGQMX AGRTI AGWIL AGWZB AGYKE AHAVH AHBYD AHSBF AHYZX AIAKS AIGIU AIIXL AILAN AITGF AJBLW AJRNO AJZVZ ALMA_UNASSIGNED_HOLDINGS ALWAN AMKLP AMXSW AMYLF AMYQR AOCGG ARMRJ ASPBG ATCPS AVWKF AXYYD AYJHY AZFZN AZQEC B-. BA0 BBNVY BBWZM BDATZ BENPR BEZIV BGLVJ BGNMA BHPHI BKSAR BPHCQ BSONS CAG CCPQU COF CS3 CSCUP D1J DDRTE DL5 DNIVK DPUIP DU5 DWQXO EBLON EBS ECGQY EDH EIOEI EJD ESBYG FEDTE FERAY FFXSO FIGPU FINBP FNLPD FRNLG FRRFC FSGXE FWDCC GGCAI GGRSB GJIRD GNUQQ GNWQR GQ6 GQ7 GQ8 GROUPED_ABI_INFORM_COMPLETE GXS H13 HCIFZ HF~ HG5 HG6 HMJXF HQYDN HRMNR HVGLF HZ~ I09 IHE IJ- IKXTQ ITM IWAJR IXC IZIGR IZQ I~X I~Z J-C J0Z JBSCW JCJTX JZLTJ K60 K6~ KDC KOV KOW L6V L8X LAK LK5 LK8 LLZTM M0C M2P M4Y M7P M7R M7S MA- N2Q NB0 NDZJH NPVJJ NQJWS NU0 O9- O93 O9G O9I O9J OAM OVD P19 P2P PATMY PCBAR PF0 PQBIZ PQBZA PQQKQ PROAC PT4 PT5 PTHSS PYCSY Q2X QOK QOS R4E R89 R9I RHV RIG RNI ROL RPX RSV RZC RZE RZK S16 S1Z S26 S27 S28 S3B SAP SCK SCLPG SDH SDM SEV SHX SISQX SJYHP SNE SNPRN SNX SOHCF SOJ SPISZ SRMVM SSLCW STPWE SZN T13 T16 TEORI TH9 TSG TSK TSV TUC U2A UG4 UOJIU UTJUX UZXMN VC2 VFIZW W23 W48 WK6 WK8 YLTOR Z45 Z5O Z7R Z7X Z7Y Z7Z Z81 Z83 Z86 Z88 Z8M Z8S Z8T Z8U Z8W Z8Z Z92 ZMTXR ~02 ~A9 ~EX ~KM AAPKM AAYXX ABBRH ABDBE ABFSG ABRTQ ACSTC ADHKG AEZWR AFDZB AFFHD AFHIU AFOHR AGQPQ AHPBZ AHWEU AIXLP ATHPR AYFIA BANNL CITATION PHGZM PHGZT PQGLB 7QH 7ST 7UA 7XB 8FD 8FK C1K F1W FR3 H97 KR7 L.- L.G PKEHL PQEST PQUKI Q9U SOI 7S9 L.6 PUEGO
ID	FETCH-LOGICAL-c352t-e5295280a79fc60e20645872519011d7758c4df9cbb8fc237a66c242edd8b8483
IEDL.DBID	RSV
ISICitedReferencesCount	11
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000551042100001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	0920-4741
IngestDate	Fri Sep 05 14:17:23 EDT 2025 Tue Nov 04 23:03:55 EST 2025 Tue Nov 18 21:33:21 EST 2025 Sat Nov 29 02:11:50 EST 2025 Fri Feb 21 02:26:42 EST 2025
IsPeerReviewed	true
IsScholarly	true
Issue	11
Keywords	Hydropower operation Curse of dimensionality Multidimensional dynamic programming Parallel computing Spark
Language	English
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c352t-e5295280a79fc60e20645872519011d7758c4df9cbb8fc237a66c242edd8b8483
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 content type line 23
ORCID	0000-0002-1281-5560
PQID	2437646604
PQPubID	54174
PageCount	18
ParticipantIDs	proquest_miscellaneous_2985695131 proquest_journals_2437646604 crossref_primary_10_1007_s11269_020_02566_9 crossref_citationtrail_10_1007_s11269_020_02566_9 springer_journals_10_1007_s11269_020_02566_9
PublicationCentury	2000
PublicationDate	20200900 2020-09-00 20200901
PublicationDateYYYYMMDD	2020-09-01
PublicationDate_xml	– month: 9 year: 2020 text: 20200900
PublicationDecade	2020
PublicationPlace	Dordrecht
PublicationPlace_xml	– name: Dordrecht
PublicationSubtitle	An International Journal - Published for the European Water Resources Association (EWRA)
PublicationTitle	Water resources management
PublicationTitleAbbrev	Water Resour Manage
PublicationYear	2020
Publisher	Springer Netherlands Springer Nature B.V
Publisher_xml	– name: Springer Netherlands – name: Springer Nature B.V
References	Grossman, Gu, Sabala (CR7) 2009; 25 Wan, Wang (CR18) 2013; 30 Zhao, Cai, Lei, Wang (CR27) 2011; 138 Zaharia, Chowdhury, Franklin (CR23) 2010; 10 CR10 Casti, Richardson, Larson (CR2) 1973; 12 Kumar, Reddy (CR12) 2007; 133 Feng, Niu, Cheng, Liao (CR6) 2017; 126 Baskar, Subbaraj, Rao (CR1) 2003; 29 Sun, Jiang, Wang, Zhang (CR17) 2016; 30 Dean, Ghemawat (CR3) 2008; 51 Dean, Ghemawat (CR4) 2010; 53 Xu, Yao, Zhong (CR21) 2018; 20 Wang, Ma, Li (CR19) 2017; 37 Li, Wei, Li, Wang, Yeh (CR15) 2014; 67 CR8 Zhang, Zhang, Wang, Jiang, Wang (CR26) 2013; 65 Ehteram, Karami, Farzin (CR5) 2018; 32 Zaharia, Chowdhury, Das (CR24) 2012; 2012 Labadie (CR13) 2004; 130 Xu, Zhong, Zambon (CR20) 2015; 51 CR25 Liao, Liu, Cheng, Li, Wu (CR16) 2017; 31 Hall, Butcher, Esogbue (CR9) 1968; 4 Larson, Korsak (CR14) 1970; 6 Xu, Zhu, Zhong, Chen, Liu, Ma, Guo, Deng (CR22) 2019; 253 Heidari, Chow, Kokotović (CR11) 1971; 7 2566_CR8 2566_CR10 P Sun (2566_CR17) 2016; 30 M Zaharia (2566_CR23) 2010; 10 R Grossman (2566_CR7) 2009; 25 B Xu (2566_CR20) 2015; 51 B Xu (2566_CR22) 2019; 253 R Larson (2566_CR14) 1970; 6 T Zhao (2566_CR27) 2011; 138 D Kumar (2566_CR12) 2007; 133 J Casti (2566_CR2) 1973; 12 Z Feng (2566_CR6) 2017; 126 X Wan (2566_CR18) 2013; 30 2566_CR25 M Heidari (2566_CR11) 1971; 7 J Labadie (2566_CR13) 2004; 130 Z Zhang (2566_CR26) 2013; 65 X Li (2566_CR15) 2014; 67 S Baskar (2566_CR1) 2003; 29 M Ehteram (2566_CR5) 2018; 32 J Dean (2566_CR4) 2010; 53 S Liao (2566_CR16) 2017; 31 J Dean (2566_CR3) 2008; 51 W Hall (2566_CR9) 1968; 4 M Zaharia (2566_CR24) 2012; 2012 B Xu (2566_CR21) 2018; 20 S Wang (2566_CR19) 2017; 37
References_xml	– volume: 30 start-page: 166 issue: 6 year: 2013 end-page: 170 ident: CR18 article-title: Parallel dynamic programming for hydropower generation optimization publication-title: Journal of Hydroelectric Engineering doi: 10.3354/cr00999 – volume: 12 start-page: 423 issue: 4 year: 1973 end-page: 438 ident: CR2 article-title: Dynamic programming and parallel computers publication-title: J Optimiz Theory App doi: 10.1007/BF00940421 – volume: 126 start-page: 720 year: 2017 end-page: 732 ident: CR6 article-title: Hydropower system operation optimization by discrete differential dynamic programming based on orthogonal experiment design publication-title: Energy doi: 10.1016/j.energy.2017.03.069 – volume: 37 start-page: 48 issue: 2 year: 2017 end-page: 54 ident: CR19 article-title: Optimal operation of cascaded reservoirs based on fork / join multi-core parallel framework publication-title: Advances in Science and Technology of Water Resources doi: 10.3880/j.issn.1006-7647.2017.02.009 – volume: 253 start-page: 113535 year: 2019 ident: CR22 article-title: Identifying long-term effects of using hydropower to complement wind power uncertainty through stochastic programming publication-title: Appl Energy doi: 10.1016/j.apenergy.2019.113535 – volume: 65 start-page: 310 issue: 2 year: 2013 end-page: 321 ident: CR26 article-title: Use of parallel deterministic dynamic programming and hierarchical adaptive genetic algorithm for reservoir operation optimization publication-title: Comput Ind Eng doi: 10.1016/j.cie.2013.02.003 – volume: 51 start-page: 107 issue: 1 year: 2008 end-page: 113 ident: CR3 article-title: MapReduce: simplified data processing on large clusters publication-title: Commun ACM doi: 10.1145/1327452.1327492 – volume: 25 start-page: 179 issue: 2 year: 2009 end-page: 183 ident: CR7 article-title: Compute and storage clouds using wide area high performance networks publication-title: Futur Gener Comput Syst doi: 10.1016/j.future.2008.07.009 – volume: 53 start-page: 72 issue: 1 year: 2010 end-page: 77 ident: CR4 article-title: MapReduce: a flexible data processing tool publication-title: Commun ACM doi: 10.1145/1629175.1629198 – ident: CR10 – volume: 130 start-page: 93 issue: 2 year: 2004 end-page: 111 ident: CR13 article-title: Optimal operation of multireservoir systems: state-of-the-art review publication-title: J Water Resour Plan Manag doi: 10.1061/(ASCE)0733-9496(2004)130:2(93 – volume: 133 start-page: 192 issue: 3 year: 2007 end-page: 201 ident: CR12 article-title: Multipurpose reservoir operation using particle swarm optimization publication-title: J Water Resour Plan Manag doi: 10.1061/(ASCE)0733-9496(2007)133:3(192 – volume: 2012 start-page: 2 year: 2012 end-page: 2 ident: CR24 article-title: Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing publication-title: Networked Systems Design and Implementation – volume: 10 start-page: 95 issue: 10–10 year: 2010 ident: CR23 article-title: Spark: cluster computing with working sets publication-title: HotCloud – volume: 29 start-page: 407 issue: 3 year: 2003 end-page: 419 ident: CR1 article-title: Hybrid real coded genetic algorithm solution to economic dispatch problem publication-title: Comput Electr Eng doi: 10.1016/S0045-7906(01)00039-8 – ident: CR8 – ident: CR25 – volume: 30 start-page: 1019 issue: 3 year: 2016 end-page: 1035 ident: CR17 article-title: Research and application of parallel normal cloud mutation shuffled frog leaping algorithm in cascade reservoirs optimal operation publication-title: Water Resour Manag doi: 10.1007/s11269-015-1208-3 – volume: 32 start-page: 2539 issue: 7 year: 2018 end-page: 2560 ident: CR5 article-title: Reservoir optimization for energy production using a new evolutionary algorithm based on multi-criteria decision-making models publication-title: Water Resour Manag doi: 10.1007/s11269-018-1945-1 – volume: 51 start-page: 6359 issue: 8 year: 2015 end-page: 6380 ident: CR20 article-title: Scenario tree reduction in stochastic programming with recourse for hydropower operations publication-title: Water Resour Res doi: 10.1002/2014WR016828 – volume: 6 start-page: 245 issue: 2 year: 1970 end-page: 252 ident: CR14 article-title: A dynamic programming successive approximations technique with convergence proofs publication-title: Automatica doi: 10.1016/0005-1098(70)90095-6 – volume: 20 start-page: 1042 issue: 5 year: 2018 end-page: 1057 ident: CR21 article-title: Exploration and attribution of synergistic gains from joint optimal operation of downstream Jinsha River cascade and three gorges cascade reservoirs for hydropower generation publication-title: J Hydroinf doi: 10.2166/hydro.2018.116 – volume: 7 start-page: 273 issue: 2 year: 1971 end-page: 282 ident: CR11 article-title: Discrete differential dynamic programing approach to water resources systems optimization publication-title: Water Resour Res doi: 10.1029/WR007i002p00273 – volume: 67 start-page: 1 year: 2014 end-page: 15 ident: CR15 article-title: A parallel dynamic programming algorithm for multi-reservoir system optimization publication-title: Adv Water Resour doi: 10.1016/j.advwatres.2014.01.002 – volume: 31 start-page: 2791 issue: 9 year: 2017 end-page: 2807 ident: CR16 article-title: Long-term generation scheduling of hydropower system using multi-core parallelization of particle swarm optimization publication-title: Water Resour Manag doi: 10.1007/s11269-017-1662-1 – volume: 4 start-page: 471 issue: 3 year: 1968 end-page: 477 ident: CR9 article-title: Optimization of the operation of a multiple-purpose reservoir by dynamic programming publication-title: Water Resour Res doi: 10.1029/WR004i003p00471 – volume: 138 start-page: 590 issue: 6 year: 2011 end-page: 596 ident: CR27 article-title: Improved dynamic programming for reservoir operation optimization with a concave objective function publication-title: J Water Resour Plan Manag doi: 10.1061/(ASCE)WR.1943-5452.0000205 – volume: 25 start-page: 179 issue: 2 year: 2009 ident: 2566_CR7 publication-title: Futur Gener Comput Syst doi: 10.1016/j.future.2008.07.009 – volume: 30 start-page: 166 issue: 6 year: 2013 ident: 2566_CR18 publication-title: Journal of Hydroelectric Engineering doi: 10.3354/cr00999 – volume: 138 start-page: 590 issue: 6 year: 2011 ident: 2566_CR27 publication-title: J Water Resour Plan Manag doi: 10.1061/(ASCE)WR.1943-5452.0000205 – volume: 29 start-page: 407 issue: 3 year: 2003 ident: 2566_CR1 publication-title: Comput Electr Eng doi: 10.1016/S0045-7906(01)00039-8 – ident: 2566_CR8 doi: 10.1098/rsta.2009.0053 – volume: 65 start-page: 310 issue: 2 year: 2013 ident: 2566_CR26 publication-title: Comput Ind Eng doi: 10.1016/j.cie.2013.02.003 – volume: 32 start-page: 2539 issue: 7 year: 2018 ident: 2566_CR5 publication-title: Water Resour Manag doi: 10.1007/s11269-018-1945-1 – volume: 126 start-page: 720 year: 2017 ident: 2566_CR6 publication-title: Energy doi: 10.1016/j.energy.2017.03.069 – ident: 2566_CR25 doi: 10.1007/s00500-019-04188-9 – volume: 37 start-page: 48 issue: 2 year: 2017 ident: 2566_CR19 publication-title: Advances in Science and Technology of Water Resources doi: 10.3880/j.issn.1006-7647.2017.02.009 – volume: 51 start-page: 107 issue: 1 year: 2008 ident: 2566_CR3 publication-title: Commun ACM doi: 10.1145/1327452.1327492 – volume: 4 start-page: 471 issue: 3 year: 1968 ident: 2566_CR9 publication-title: Water Resour Res doi: 10.1029/WR004i003p00471 – volume: 130 start-page: 93 issue: 2 year: 2004 ident: 2566_CR13 publication-title: J Water Resour Plan Manag doi: 10.1061/(ASCE)0733-9496(2004)130:2(93 – volume: 2012 start-page: 2 year: 2012 ident: 2566_CR24 publication-title: Networked Systems Design and Implementation – volume: 53 start-page: 72 issue: 1 year: 2010 ident: 2566_CR4 publication-title: Commun ACM doi: 10.1145/1629175.1629198 – volume: 253 start-page: 113535 year: 2019 ident: 2566_CR22 publication-title: Appl Energy doi: 10.1016/j.apenergy.2019.113535 – volume: 7 start-page: 273 issue: 2 year: 1971 ident: 2566_CR11 publication-title: Water Resour Res doi: 10.1029/WR007i002p00273 – volume: 30 start-page: 1019 issue: 3 year: 2016 ident: 2566_CR17 publication-title: Water Resour Manag doi: 10.1007/s11269-015-1208-3 – volume: 51 start-page: 6359 issue: 8 year: 2015 ident: 2566_CR20 publication-title: Water Resour Res doi: 10.1002/2014WR016828 – volume: 12 start-page: 423 issue: 4 year: 1973 ident: 2566_CR2 publication-title: J Optimiz Theory App doi: 10.1007/BF00940421 – volume: 31 start-page: 2791 issue: 9 year: 2017 ident: 2566_CR16 publication-title: Water Resour Manag doi: 10.1007/s11269-017-1662-1 – volume: 6 start-page: 245 issue: 2 year: 1970 ident: 2566_CR14 publication-title: Automatica doi: 10.1016/0005-1098(70)90095-6 – volume: 67 start-page: 1 year: 2014 ident: 2566_CR15 publication-title: Adv Water Resour doi: 10.1016/j.advwatres.2014.01.002 – volume: 133 start-page: 192 issue: 3 year: 2007 ident: 2566_CR12 publication-title: J Water Resour Plan Manag doi: 10.1061/(ASCE)0733-9496(2007)133:3(192 – volume: 10 start-page: 95 issue: 10–10 year: 2010 ident: 2566_CR23 publication-title: HotCloud – ident: 2566_CR10 doi: 10.1109/PAAP.2015.41 – volume: 20 start-page: 1042 issue: 5 year: 2018 ident: 2566_CR21 publication-title: J Hydroinf doi: 10.2166/hydro.2018.116
SSID	ssj0010090
Score	2.3289578
Snippet	The “curse of dimensionality” is a major problem in dynamic programming (DP) algorithms for large-scale hydropower systems. This study proposes a parallel DP...
SourceID	proquest crossref springer
SourceType	Aggregation Database Enrichment Source Index Database Publisher
StartPage	3427
SubjectTerms	administrative management Algorithms Atmospheric Sciences China Civil Engineering Cores Dynamic programming Earth and Environmental Science Earth Sciences Efficiency Environment Geotechnical Engineering & Applied Earth Sciences Hydroelectric power Hydrogeology Hydrology/Water Resources Mathematical analysis Reservoirs River basins Run time (computers) water Water levels water power watersheds
SummonAdditionalLinks	– databaseName: Science Database (ProQuest) dbid: M2P link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LT8MwDLZ4HeDAGzEYKEjcIGJ9LE1OaLzEAdAkQOJWtUkKiNGNboD499httgESXDgnbSLZiT_H9meAXfIiZEMqroxBBwUBBEcUrnhktM6ESsOoWTWbiK6u5N2darsHt75LqxzeieVFbbqa3sgPiDhPhEI0wsPeC6euURRddS00JmEakY1HKV2XfnsURUD8UL6xKHSRQjSdrmimKp3zfNwSOU9k9QVX3w3TGG3-CJCWduds4b87XoR5hzhZq1KRJZiw-TLMfeEhXIHHsgzXENF_RdLB2klBTVY67KTqWM_aVR7XM85nrc49rjN4eGZHaAMN6-bsupcUTwwBMLug1HJ-jaK37PzDUBOGd1swx4y-CrdnpzfH59z1YOAaodmAWwoEojSTSGVaNKxP_HYyonpXvBlMhO6GDk2mdJrKTPtBlAih0exbY2QqQxmswVTeze06sAQHgqZFn5sKqGyQInprWJMJ36RNEwU18IYCiLUjKKc-GZ14TK1MQotRaHEptFjVYG_0Ta-i5_hzdn0oqdgd1X48FlMNdkbDeMgocpLktvuKc5REBW56gVeD_aE-jH_x-4obf6-4CbN-qYKUs1aHqUHxardgRr8NHvvFdqnMnyX39-c priority: 102 providerName: ProQuest
Title	Multidimensional Parallel Dynamic Programming Algorithm Based on Spark for Large-Scale Hydropower Systems
URI	https://link.springer.com/article/10.1007/s11269-020-02566-9 https://www.proquest.com/docview/2437646604 https://www.proquest.com/docview/2985695131
Volume	34
WOSCitedRecordID	wos000551042100001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAVX databaseName: Springer Nature Link customDbUrl: eissn: 1573-1650 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0010090 issn: 0920-4741 databaseCode: RSV dateStart: 19970101 isFulltext: true titleUrlDefault: https://link.springer.com/search?facet-content-type=%22Journal%22 providerName: Springer Nature
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LT9tAEB7x6KEcKH2gBkK0lbi1lhzb2ccR0kQcILIIbenJsnfXEDWxIydQ9d8z40dCq1KpXFayPF5bM7M7M56dbwCOKYqQrlSOMgYDFHQgHPTClSOM1ilXSSB6VbMJMRrJ62sV1kVhi-a0e5OSLHfqdbFb18NJKNwhO80dtQnbaO4kNWy4HH9d5Q7Qayj_rCikDNBg1qUyf5_jd3O09jH_SIuW1mb46nnfuQe7tXfJTip1eA0bNnsDO48wB9_CpCy5NQTqXwFysDAuqKHKlH2uutOzsDqzNUN6djK9yYvJ8nbGTtHeGZZnbDyPix8MnV12TsfInTGK2bKzX4YaLvy0BatR0N_Bl-Hgqn_m1P0WHI1u2NKxlPRDycVCpZq71iMsOymothV3ASMwtNCBSZVOEplqzxcx5xpNvDVGJjKQ_j5sZXlm3wOL8YbfsxhfU7GU9RP01FxrUu6ZpGeE34Juw_ZI12Dk1BNjGq1hlImNEbIxKtkYqRZ8XD0zr6A4_kndbqQZ1ctyERH6Ig84d4MWfFjdxgVFWZI4s_kd0iiJytrr-t0WfGokvJ7i6Tce_B_5Ibz0SiWh82pt2FoWd_YIXuj75WRRdGBTfPvege3TwSi8xKsLt0-jF9IoqnHcKRX_AYmr9FY
linkProvider	Springer Nature
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1LT9tAEB7xqAQcaEtBhNJ2K7WndtXEdvZxQBWFoiDSKBJU4ubau2uISJzghKL8KX4jM34kbSW4cejZ6_e3O9_szHwD8IG8CFVXmmtr0UFBAsGRhWsurTGJ0HEgm0WzCdnpqPNz3V2Au6oWhtIqqzUxX6jt0NAe-RcSzhOBEPXg6-iaU9coiq5WLTQKWJy46S26bOO940P8vx897-j72UGLl10FuEGyMeGOQlv4fJHUiRF155Fim5JUwYlYtxIJtAlsok0cq8R4voyEMGjInLUqVoHy8bqLsByQshilCnrdWdQC-Uq-p6PRJQvQVJdFOkWpXsPDT0DOGrEMwfXfhnDObv8JyOZ27uj5__aFXsB6yajZfjEFXsKCSzdg7Q-dxVfQy8uMLTUyKERIWDfKqIlMnx1O02jQM6xb5KkNcDzb71_ge00uB-wb2njLhik7HUXZFUOCz9qUOs9PEdqOtaaWmkzcuoyVyu-b8PNJ3nULltJh6raBRXjAbzqpFBWIOT9Gdlp3NhGejZtW-jVoVD88NKUAO_UB6Ydz6WgCSYggCXOQhLoGn2bnjAr5kUdH71bICMulaBzOYVGD97PDuIhQZChK3fAGx2iFE7TZ8Bs1-Fzhb36Jh--48_gd38FK6-xHO2wfd05ew6qXw5_y83ZhaZLduDfwzPye9MbZ23wiMfj11Li8Bxe7Uo8
linkToPdf	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1bTxNBFD5BNEYeVBRiEXVI9AknbHe3c3kgBikNBNI0QRPelt2ZWWhst3VbIP1r_DrO2UurJvLGA887e5v5zpzvzLkBfCYrQnlKc20tGihIIDiycM2lNSYVOgllq2w2IbtddXame0twW-fCUFhlvScWG7UdGToj36HCeSIUwgt30iosotfufBv_5tRBijytdTuNEiLHbnaD5ttk96iNa_3F9zsHP_YPedVhgBskHlPuyM2F3xpLnRrhOZ-qtylJ2ZyIeyuRTJvQptokiUqNH8hYCINKzVmrEhWqAJ_7BJ7KENUmhQ16-3MPBnKX4nxHo3kWotquEnbKtL2mj9NBhhsxDsH130pxwXT_cc4WOq_z6jHP1mt4WTFttleKxiosuewNrPxRf_Et9Iv0Y0sNDsriJKwX59RcZsDasywe9g3rlfFrQxzP9gYX-F_TyyH7jrrfslHGTsdx_osh8WcnFFLPTxHyjh3OLDWfuHE5qyrCr8HPB_nXdVjORpl7ByzGC0HLSaUoccwFCbJWz9lU-DZpWRk0oFkvfmSqwuzUH2QQLUpKE2AiBExUACbSDdie3zMuy5LcO3qzRklUbVGTaAGRBmzNL-PmQh6jOHOjKxyjFQpuqxk0G_C1xuLiEf9_48b9b_wEzxGO0clR9_g9vPALSaCwvU1YnuZX7gM8M9fT_iT_WMgUg_OHhuUdf8xbMQ
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Multidimensional+Parallel+Dynamic+Programming+Algorithm+Based+on+Spark+for+Large-Scale+Hydropower+Systems&rft.jtitle=Water+resources+management&rft.au=Ma%2C+Yufei&rft.au=Zhong%2C+Ping%27an&rft.au=Xu%2C+Bin&rft.au=Zhu%2C+Feilin&rft.date=2020-09-01&rft.issn=0920-4741&rft.volume=34&rft.issue=11+p.3427-3444&rft.spage=3427&rft.epage=3444&rft_id=info:doi/10.1007%2Fs11269-020-02566-9&rft.externalDBID=NO_FULL_TEXT
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0920-4741&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0920-4741&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0920-4741&client=summon