SunwayLB: Enabling Extreme-Scale Lattice Boltzmann Method Based Computing Fluid Dynamics Simulations on Advanced Heterogeneous Supercomputers

The Lattice Boltzmann Method (LBM) is a class of Computational Fluid Dynamics methods which models the fluid as fictive particles. In this paper, we report our work on SunwayLB, which enables LBM based solutions aiming for industrial applications using advanced heterogeneous systems such as the Sunw...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on parallel and distributed systems Jg. 35; H. 2; S. 324 - 337
Hauptverfasser: Liu, Zhao, Chu, Xuesen, Lv, Xiaojing, Meng, Hongsong, Liu, Hanyue, Zhu, Guanghui, Fu, Haohuan, Yang, Guangwen
Format: Journal Article
Sprache:Englisch
Veröffentlicht: New York IEEE 01.02.2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:
ISSN:1045-9219, 1558-2183
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract The Lattice Boltzmann Method (LBM) is a class of Computational Fluid Dynamics methods which models the fluid as fictive particles. In this paper, we report our work on SunwayLB, which enables LBM based solutions aiming for industrial applications using advanced heterogeneous systems such as the Sunway supercomputers. We propose several techniques to boost the simulation speed and improve the scalability of SunwayLB, including a customized multi-level domain decomposition and data sharing scheme, a carefully orchestrated strategy to fuse kernels with different performance constraints for a more balanced workload, and optimization strategies for assembly code. Based on these optimization schemes, we manage to scale SunwayLB on three advanced supercomputers: Sunway TaihuLight, the new Sunway Supercomputer and a GPU cluster. On Sunway TaihuLight, our largest simulation involves up to 5.6 trillion lattice cells, achieving 11,245 billion cell updates per second (GLUPS), 77% memory bandwidth utilization and a sustained performance of 4.7 PFlops. We further improve the memory bandwidth utilization and computational efficiency using the unique features of a new generation of Sunway supercomputer. On the new Sunway Supercomputer, the largest simulation contains over 4.2 trillion lattice cells, resulting in 6,583 GLUPS, 81% memory bandwidth utilization and a sustained performance of 2.76 PFlops. To evaluate the portability of our code, we also adapt our code to a GPU cluster with tailored optimization techniques, resulting in 191x speedup and 83.8% memory bandwidth utilization. We demonstrate a series of computational experiments for extreme-large scale fluid flow, as examples of real-world applications, to check the validity and performance of our work. The results show that our implementation is competent to be a highly scalable and efficient solution for large-scale CFD problems on heterogeneous systems.
AbstractList The Lattice Boltzmann Method (LBM) is a class of Computational Fluid Dynamics methods which models the fluid as fictive particles. In this paper, we report our work on SunwayLB, which enables LBM based solutions aiming for industrial applications using advanced heterogeneous systems such as the Sunway supercomputers. We propose several techniques to boost the simulation speed and improve the scalability of SunwayLB, including a customized multi-level domain decomposition and data sharing scheme, a carefully orchestrated strategy to fuse kernels with different performance constraints for a more balanced workload, and optimization strategies for assembly code. Based on these optimization schemes, we manage to scale SunwayLB on three advanced supercomputers: Sunway TaihuLight, the new Sunway Supercomputer and a GPU cluster. On Sunway TaihuLight, our largest simulation involves up to 5.6 trillion lattice cells, achieving 11,245 billion cell updates per second (GLUPS), 77% memory bandwidth utilization and a sustained performance of 4.7 PFlops. We further improve the memory bandwidth utilization and computational efficiency using the unique features of a new generation of Sunway supercomputer. On the new Sunway Supercomputer, the largest simulation contains over 4.2 trillion lattice cells, resulting in 6,583 GLUPS, 81% memory bandwidth utilization and a sustained performance of 2.76 PFlops. To evaluate the portability of our code, we also adapt our code to a GPU cluster with tailored optimization techniques, resulting in 191x speedup and 83.8% memory bandwidth utilization. We demonstrate a series of computational experiments for extreme-large scale fluid flow, as examples of real-world applications, to check the validity and performance of our work. The results show that our implementation is competent to be a highly scalable and efficient solution for large-scale CFD problems on heterogeneous systems.
Author Liu, Zhao
Yang, Guangwen
Zhu, Guanghui
Chu, Xuesen
Meng, Hongsong
Lv, Xiaojing
Fu, Haohuan
Liu, Hanyue
Author_xml – sequence: 1
  givenname: Zhao
  orcidid: 0000-0002-5259-4504
  surname: Liu
  fullname: Liu, Zhao
  email: liuz18@mails.tsinghua.edu.cn
  organization: Department of Computer Science and Technology, Tsinghua University, Beijing, China
– sequence: 2
  givenname: Xuesen
  orcidid: 0000-0002-9540-5961
  surname: Chu
  fullname: Chu, Xuesen
  email: chuxs@cssrc.com.cn
  organization: Department of Computer Science and Technology, Tsinghua University, Beijing, China
– sequence: 3
  givenname: Xiaojing
  orcidid: 0000-0003-1557-7550
  surname: Lv
  fullname: Lv, Xiaojing
  email: jing3704@126.com
  organization: Department of Software Engineering and Technology, China Ship Scientific Research Center, Wuxi, China
– sequence: 4
  givenname: Hongsong
  orcidid: 0009-0007-7899-7807
  surname: Meng
  fullname: Meng, Hongsong
  email: 1061851143@qq.com
  organization: Department of Parallel Optimization, National Supercomputing Center in Wuxi, Wuxi, China
– sequence: 5
  givenname: Hanyue
  orcidid: 0009-0009-5724-2821
  surname: Liu
  fullname: Liu, Hanyue
  email: liuhanyue15@lzu.edu.cn
  organization: Department of Parallel Optimization, National Supercomputing Center in Wuxi, Wuxi, China
– sequence: 6
  givenname: Guanghui
  orcidid: 0009-0006-4901-8131
  surname: Zhu
  fullname: Zhu, Guanghui
  email: jn_zgh@126.com
  organization: Institute of Electronics and Information Technology, Zhengzhou University of Technology, Zhengzhou, China
– sequence: 7
  givenname: Haohuan
  orcidid: 0000-0002-6982-2235
  surname: Fu
  fullname: Fu, Haohuan
  email: haohuan@tsinghua.edu.cn
  organization: Department of Earth System Science, Tsinghua University, Beijing, China
– sequence: 8
  givenname: Guangwen
  orcidid: 0000-0002-8673-8254
  surname: Yang
  fullname: Yang, Guangwen
  email: ygw@tsinghua.edu.cn
  organization: Department of Computer Science and Technology, Tsinghua University, Beijing, China
BookMark eNp9kMtOwzAQRS0EEs8PQGJhiXWKHTsPs6OlPKQikArryHEmYJTYxXaA8g_8My5lgViwGHkW98yVzy7aNNYAQoeUjCgl4uT-7nw-SknKRoxxVpB8A-3QLCuTlJZsM-6EZ4lIqdhGu94_E0J5RvgO-pwP5k0uZ-NTPDWy7rR5xNP34KCHZK5kB3gmQ9AK8Nh24aOXxuAbCE-2wWPpocET2y-GsMIuukE3-HxpZK-Vx3PdD50M2hqPrcFnzas0KgJXEMDZRzBgh5gaFuDU9w1wfh9ttbLzcPDz7qGHi-n95CqZ3V5eT85miUoFD0mbkYKRsgYCcZqW00IWWU1aUTIhJKtlxtvYVeac1apJeStA5E38clHWinK2h47XdxfOvgzgQ_VsB2diZZUKSnkp0jKPKbpOKWe9d9BWC6d76ZYVJdXKerWyXq2sVz_WI1P8YZQO3xaCk7r7lzxakxoAfjWxnOUFYV-DM5SB
CODEN ITDSEO
CitedBy_id crossref_primary_10_1016_j_oceaneng_2024_118599
crossref_primary_10_1016_j_oceaneng_2025_122125
Cites_doi 10.1109/sc.2010.20
10.1103/PhysRevE.61.6546
10.1007/s11432-016-5588-7
10.1080/10618560802238275
10.1109/IPDPS.2019.00065
10.1016/j.jocs.2013.11.001
10.1109/MCSE.2014.51
10.1109/SC41404.2022.00010
10.1007/978-3-319-49583-5_31
10.1016/j.procs.2013.05.219
10.1007/978-3-319-93698-7_37
10.1016/j.rser.2014.05.053
10.1145/2503210.2503298
10.3390/computation5040048
10.1137/15M1035240
10.1016/j.jocs.2013.03.002
10.1109/FPL.2012.6339275
10.1002/cpe.4221
10.1175/1520-0493(1963)091<0099:GCEWTP>2.3.CO;2
10.1109/ICPP.2009.38
10.1209/0295-5075/17/6/001
10.1016/j.compfluid.2005.02.008
10.1145/1498765.1498785
10.1103/PhysRevLett.81.1618
10.1007/978-3-642-32820-6_81
10.1103/PhysRevLett.61.2332
10.1016/j.cpc.2013.09.013
10.1145/2503210.2503273
10.1186/2251-6832-4-43
10.1145/3458817.3487399
10.1145/3295500.3356190
10.1007/978-3-642-21878-1_26
10.1109/SC.2016.82
10.1109/IPDPS.2017.20
10.1016/j.parco.2014.12.003
10.1145/3126908.3126910
10.17077/etd.ypvf3i4w
10.1109/TPDS.2021.3098456
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/TPDS.2023.3343706
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList
Technology Research Database
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE/IET Electronic Library
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Computer Science
EISSN 1558-2183
EndPage 337
ExternalDocumentID 10_1109_TPDS_2023_3343706
10363670
Genre orig-research
GrantInformation_xml – fundername: Laoshan Laboratory Science and Technology Innovation Program
  grantid: LSKJ202202204
– fundername: Jiangsu Innovation Capacity Building Program
  grantid: BM2022028
– fundername: National Natural Science Foundation of China
  grantid: T2125006
  funderid: 10.13039/501100001809
GroupedDBID --Z
-~X
.DC
0R~
29I
4.4
5GY
5VS
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABFSI
ABQJQ
ABVLG
ACGFO
ACIWK
AENEX
AETIX
AGQYO
AGSQL
AHBIQ
AI.
AIBXA
AKJIK
AKQYR
ALLEH
ALMA_UNASSIGNED_HOLDINGS
ASUFR
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
E.L
EBS
EJD
HZ~
H~9
ICLAB
IEDLZ
IFIPE
IFJZH
IPLJI
JAVBF
LAI
M43
MS~
O9-
OCL
P2P
PQQKQ
RIA
RIE
RNI
RNS
RZB
TN5
TWZ
UHB
VH1
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c294t-f507308be0ebe0df417a75b0f98399a3ba54fced8643bcd24f9e96d14578bc143
IEDL.DBID RIE
ISICitedReferencesCount 5
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001138668000001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1045-9219
IngestDate Mon Jun 30 04:28:43 EDT 2025
Sat Nov 29 06:06:50 EST 2025
Tue Nov 18 21:21:28 EST 2025
Wed Aug 27 02:00:17 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 2
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c294t-f507308be0ebe0df417a75b0f98399a3ba54fced8643bcd24f9e96d14578bc143
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-1557-7550
0000-0002-5259-4504
0009-0006-4901-8131
0009-0009-5724-2821
0000-0002-8673-8254
0000-0002-6982-2235
0009-0007-7899-7807
0000-0002-9540-5961
PQID 2911489286
PQPubID 85437
PageCount 14
ParticipantIDs ieee_primary_10363670
crossref_primary_10_1109_TPDS_2023_3343706
crossref_citationtrail_10_1109_TPDS_2023_3343706
proquest_journals_2911489286
PublicationCentury 2000
PublicationDate 2024-02-01
PublicationDateYYYYMMDD 2024-02-01
PublicationDate_xml – month: 02
  year: 2024
  text: 2024-02-01
  day: 01
PublicationDecade 2020
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle IEEE transactions on parallel and distributed systems
PublicationTitleAbbrev TPDS
PublicationYear 2024
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref35
ref12
ref34
ref15
ref37
ref14
ref36
ref31
ref11
ref33
ref10
ref32
ref2
ref1
ref17
ref39
ref16
ref38
ref18
ref24
ref23
ref26
ref25
ref20
ref22
ref21
Onodera (ref19) 2013; 9
ref28
ref27
ref29
ref8
ref7
Fu (ref30)
ref9
ref4
ref3
ref6
ref5
ref40
References_xml – ident: ref18
  doi: 10.1109/sc.2010.20
– ident: ref3
  doi: 10.1103/PhysRevE.61.6546
– ident: ref35
  doi: 10.1007/s11432-016-5588-7
– ident: ref26
  doi: 10.1080/10618560802238275
– ident: ref36
  doi: 10.1109/IPDPS.2019.00065
– ident: ref6
  doi: 10.1016/j.jocs.2013.11.001
– ident: ref23
  doi: 10.1109/MCSE.2014.51
– ident: ref34
  doi: 10.1109/SC41404.2022.00010
– ident: ref38
  doi: 10.1007/978-3-319-49583-5_31
– ident: ref25
  doi: 10.1016/j.procs.2013.05.219
– ident: ref31
  doi: 10.1007/978-3-319-93698-7_37
– ident: ref20
  doi: 10.1016/j.rser.2014.05.053
– ident: ref13
  doi: 10.1145/2503210.2503298
– ident: ref9
  doi: 10.3390/computation5040048
– ident: ref10
  doi: 10.1137/15M1035240
– ident: ref12
  doi: 10.1016/j.jocs.2013.03.002
– ident: ref24
  doi: 10.1109/FPL.2012.6339275
– ident: ref39
  doi: 10.1002/cpe.4221
– ident: ref5
  doi: 10.1175/1520-0493(1963)091<0099:GCEWTP>2.3.CO;2
– ident: ref22
  doi: 10.1109/ICPP.2009.38
– ident: ref2
  doi: 10.1209/0295-5075/17/6/001
– ident: ref40
  doi: 10.1016/j.compfluid.2005.02.008
– ident: ref17
  doi: 10.1145/1498765.1498785
– ident: ref4
  doi: 10.1103/PhysRevLett.81.1618
– ident: ref15
  doi: 10.1007/978-3-642-32820-6_81
– ident: ref1
  doi: 10.1103/PhysRevLett.61.2332
– ident: ref8
  doi: 10.1016/j.cpc.2013.09.013
– ident: ref11
  doi: 10.1145/2503210.2503273
– ident: ref21
  doi: 10.1186/2251-6832-4-43
– ident: ref33
  doi: 10.1145/3458817.3487399
– ident: ref32
  doi: 10.1145/3295500.3356190
– ident: ref14
  doi: 10.1007/978-3-642-21878-1_26
– ident: ref29
  doi: 10.1109/SC.2016.82
– ident: ref16
  doi: 10.1109/IPDPS.2017.20
– volume: 9
  start-page: 1
  year: 2013
  ident: ref19
  article-title: Large-scale LES wind simulation using lattice Boltzmann method for a 10 km× 10 km area in metropolitan Tokyo
  publication-title: TSUBAME e-Sci. J. Glob. Sci. Inf. Comput. Center
– ident: ref7
  doi: 10.1016/j.parco.2014.12.003
– volume-title: Proc. Int. Conf. High Perform. Comput. Netw. Storage Anal.
  ident: ref30
  article-title: 18.9-pflops nonlinear earthquake simulation on sunway taihulight: Enabling depiction of 18-hz and 8-meter scenarios
  doi: 10.1145/3126908.3126910
– ident: ref27
  doi: 10.17077/etd.ypvf3i4w
– ident: ref28
  doi: 10.1109/IPDPS.2019.00065
– ident: ref37
  doi: 10.1109/TPDS.2021.3098456
SSID ssj0014504
Score 2.4398446
Snippet The Lattice Boltzmann Method (LBM) is a class of Computational Fluid Dynamics methods which models the fluid as fictive particles. In this paper, we report our...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 324
SubjectTerms Bandwidth
Bandwidths
Clusters
Codes
Computational fluid dynamics
Computational modeling
Domain decomposition methods
Fluid dynamics
Fluid flow
Graphics processing units
heterogeneous (hybrid) systems
Industrial applications
lattice boltzmann method
Lattice Boltzmann methods
Mathematical models
Modeling
numerical algorithms and problems
Optimization
Optimization techniques
Simulation
Sunway supercomputers
Supercomputers
Utilization
Workload
Title SunwayLB: Enabling Extreme-Scale Lattice Boltzmann Method Based Computing Fluid Dynamics Simulations on Advanced Heterogeneous Supercomputers
URI https://ieeexplore.ieee.org/document/10363670
https://www.proquest.com/docview/2911489286
Volume 35
WOSCitedRecordID wos001138668000001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE/IET Electronic Library
  customDbUrl:
  eissn: 1558-2183
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0014504
  issn: 1045-9219
  databaseCode: RIE
  dateStart: 19900101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NT9wwELUK6qE9FEqpunxUPnCq5K03cRKbGwu74gAIaanELYrtibTSkqBN0gL_gf_M2PGilVAr9RZZtmPpzdgz9sw8Qo60jtPEQMSEAc6EBMmKOAGG0qNHsjQatPBkE9nVlby9VdchWd3nwgCADz6Dofv0b_m2Np27KkMNj1NXcGyDbGRZ1idrvT4ZiMRzBaJ7kTCFehieMEdc_by5PpsNHU_4MI5FnDl2o7VDyLOqvNmK_fky3frPlW2TT8GQpCc98p_JO6h2yNaKpIEGnd0hH9cqDn4hz7Ou-lM8XoyP6cRlTWEjnTy07pKQzRAuoBdF6-Lh6LhetE93RVXRS08yTcd43lna_8ANmy66uaVnPaN9Q2fzu8AE1tC6oichtoCeu3ibGsUU6g57dfewNGGRzS75NZ3cnJ6zwMjATKREy8rE7QhSA0fsuS3FKCuyRPNSoZ2lilgXiShxbol2jjY2EqUClVrEJpPaoGn2lWxWdQXfCNVppDTucJHUFq0EKzU6yNxoG5VclUIOCF9BlJtQrtyxZixy77ZwlTtUc4dqHlAdkB-vQ-77Wh3_6rzrYFzr2CM4IAcrQciDOjd5pJzbqCKZ7v1l2D75gLOLPp77gGy2yw4OyXvzu503y-9eUl8AXG_ogg
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3db9MwED_BQAIeGIxNFAb4gSckFzdxEpu3lbUqoqsmtUh7i-KPSJW6ZGoSvv4H_mfOjjtVQiDxFkX-kn539p19dz-At0rFaaJtRLm2jHJhBS3ixFKUHjUSpVZWcU82kS0W4upKXoZkdZ8LY631wWd26D79W76pdeeuylDD49QVHLsL9xLOo1GfrnX7aMATzxaIDkZCJWpieMQcMfl-dXm-HDqm8GEc8zhz_EZ7x5DnVfljM_YnzPTwP9f2BB4HU5Kc9dg_hTu2OoLDHU0DCVp7BI_2ag4-g1_LrvpW_JiPP5CJy5vCn2TyvXXXhHSJgFkyL1oXEUfG9ab9eV1UFbnwNNNkjCeeIf0Ertt0060NOe857RuyXF8HLrCG1BU5C9EFZOYibmoUVFt32Kq7sVsdFtkcw5fpZPVxRgMnA9WR5C0tE7cnCGUZos9MyUdZkSWKlRItLVnEqkh4iWMLtHSUNhEvpZWpQWwyoTQaZydwUNWVfQ5EpZFUuMdFQhm0E4xQ6CIzrUxUMllyMQC2gyjXoWC5483Y5N5xYTJ3qOYO1TygOoB3t11u-mod_2p87GDca9gjOIDTnSDkQaGbPJLOcZSRSF_8pdsbeDBbXczz-afF55fwEGfifXT3KRy0286-gvv6a7tutq-91P4GlsHryQ
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=SunwayLB%3A+Enabling+Extreme-Scale+Lattice+Boltzmann+Method+Based+Computing+Fluid+Dynamics+Simulations+on+Advanced+Heterogeneous+Supercomputers&rft.jtitle=IEEE+transactions+on+parallel+and+distributed+systems&rft.au=Liu%2C+Zhao&rft.au=Chu%2C+Xuesen&rft.au=Lv%2C+Xiaojing&rft.au=Meng%2C+Hongsong&rft.date=2024-02-01&rft.pub=IEEE&rft.issn=1045-9219&rft.volume=35&rft.issue=2&rft.spage=324&rft.epage=337&rft_id=info:doi/10.1109%2FTPDS.2023.3343706&rft.externalDocID=10363670
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1045-9219&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1045-9219&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1045-9219&client=summon