Reducing the memory usage of Lattice-Boltzmann schemes with a DWT-based compression

This paper presents a new solution to address the challenge of increasing memory usage in high-performance computing simulations of Lattice-Bolzmann or Finite-Volume schemes.Our approach utilises a lossy compression scheme based on the Discrete Wavelet Transform (DWT) to achieve high compression rat...

Full description

Saved in:
Bibliographic Details
Published in:ESAIM. Proceedings and surveys Vol. 77; pp. 79 - 99
Main Authors: Flint, Clément, Helluy, Philippe
Format: Journal Article
Language:English
Published: EDP Sciences 18.11.2024
Subjects:
Cognitive science
Computer science
Distributed, Parallel, and Cluster Computing
Hardware Architecture
Mathematical Physics
Mathematics
DWT
HPC
GPU Graphic Processor
Stencil computation
LBM algorithm
Data Compression
ISSN:2267-3059, 2267-3059
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract This paper presents a new solution to address the challenge of increasing memory usage in high-performance computing simulations of Lattice-Bolzmann or Finite-Volume schemes.Our approach utilises a lossy compression scheme based on the Discrete Wavelet Transform (DWT) to achieve high compression ratios while preserving the accuracy of the simulation.Our evaluation on two different FV/LBM schemes demonstrates that the approach can reduce memory usage by several orders of magnitude. Ce papier présente une nouvelle solution pour faire face à l'augmentation de l'utilisation de la mémoire dans les simulations haute performance basées sur les méthodes Lattice-Bolzmann ou Volumes Finis.Notre approche utilise un schéma de compression avec perte basé sur la transformée par ondelettes discrète (DWT) pour obtenir des taux de compression élevés tout en préservant la précision de la simulation.Notre évaluation sur deux différents schémas VF/LBM démontre que l'approche peut réduire l'utilisation de la mémoire de plusieurs ordres de grandeur.
AbstractList This paper presents a new solution to address the challenge of increasing memory usage in high-performance computing simulations of Lattice-Bolzmann or Finite-Volume schemes.Our approach utilises a lossy compression scheme based on the Discrete Wavelet Transform (DWT) to achieve high compression ratios while preserving the accuracy of the simulation.Our evaluation on two different FV/LBM schemes demonstrates that the approach can reduce memory usage by several orders of magnitude. Ce papier présente une nouvelle solution pour faire face à l'augmentation de l'utilisation de la mémoire dans les simulations haute performance basées sur les méthodes Lattice-Bolzmann ou Volumes Finis.Notre approche utilise un schéma de compression avec perte basé sur la transformée par ondelettes discrète (DWT) pour obtenir des taux de compression élevés tout en préservant la précision de la simulation.Notre évaluation sur deux différents schémas VF/LBM démontre que l'approche peut réduire l'utilisation de la mémoire de plusieurs ordres de grandeur.
Author Flint, Clément
Helluy, Philippe
Author_xml – sequence: 1
  givenname: Clément
  orcidid: 0009-0006-8397-3124
  surname: Flint
  fullname: Flint, Clément
  organization: Laboratoire des sciences de l'ingénieur, de l'informatique et de l'imagerie
– sequence: 2
  givenname: Philippe
  orcidid: 0000-0002-1077-1867
  surname: Helluy
  fullname: Helluy, Philippe
  organization: Institut de Recherche Mathématique Avancée
BackLink https://inria.hal.science/hal-03990880$$DView record in HAL
BookMark eNpNjM1Kw0AURgepYK19AHezdZF4ZyaTzCxr_akQELSgu3CTuWlGmqRk0kp9ehVduPoOB853ziZd3xFjlwLixGgN1zi8-UMsFcgYrDHqhE2lTLNIgbaTf3zG5iG8A4BIsjRN7JS9PJPbV77b8LEh3lLbD0e-D7gh3tc8x3H0FUU3_Xb8bLHreKgaainwDz82HPnt6zoqMZDjVd_uBgrB990FO61xG2j-tzO2vr9bL1dR_vTwuFzkEWojokw7WafgMluTogyFKBNFAoV0ihJLxklTagvGalBGWEi1KktnZV2Rw6RUM3b1e9vgttgNvsXhWPToi9UiL34cKPudGzgI9QUd61bi
ContentType Journal Article
Copyright Attribution
Copyright_xml – notice: Attribution
DBID 1XC
VOOES
DOI 10.48550/arXiv.2302.09883
DatabaseName Hyper Article en Ligne (HAL)
Hyper Article en Ligne (HAL) (Open Access)
DatabaseTitleList
DeliveryMethod fulltext_linktorsrc
Discipline Mathematics
Computer Science
EISSN 2267-3059
EndPage 99
ExternalDocumentID oai:HAL:hal-03990880v1
GroupedDBID 1XC
8FE
8FG
AAFWJ
ABJCF
ABUWG
ACIWK
AFKRA
AFPKN
ALMA_UNASSIGNED_HOLDINGS
ARAPS
AZQEC
BENPR
BGLVJ
BPHCQ
CCPQU
DWQXO
EBS
GI~
GNUQQ
GROUPED_DOAJ
HCIFZ
K6V
K7-
L6V
M7S
M~E
PHGZM
PHGZT
PIMPY
PQGLB
PQQKQ
PROAC
PTHSS
VOOES
ID FETCH-LOGICAL-a581-75d2f60d79fe3e7a11b43e1a12d3e49e8d28b590895038190653bbd92fceda4b3
ISSN 2267-3059
IngestDate Sat Oct 25 11:23:38 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Keywords DWT
HPC
GPU Graphic Processor
Stencil computation
LBM algorithm
Data Compression
Language English
License Attribution: http://creativecommons.org/licenses/by
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-a581-75d2f60d79fe3e7a11b43e1a12d3e49e8d28b590895038190653bbd92fceda4b3
ORCID 0009-0006-8397-3124
0000-0002-1077-1867
OpenAccessLink http://dx.doi.org/10.48550/arXiv.2302.09883
PageCount 21
ParticipantIDs hal_primary_oai_HAL_hal_03990880v1
PublicationCentury 2000
PublicationDate 2024-11-18
PublicationDateYYYYMMDD 2024-11-18
PublicationDate_xml – month: 11
  year: 2024
  text: 2024-11-18
  day: 18
PublicationDecade 2020
PublicationTitle ESAIM. Proceedings and surveys
PublicationYear 2024
Publisher EDP Sciences
Publisher_xml – name: EDP Sciences
SSID ssj0001476649
Score 2.2740285
SecondaryResourceType preprint
Snippet This paper presents a new solution to address the challenge of increasing memory usage in high-performance computing simulations of Lattice-Bolzmann or...
SourceID hal
SourceType Open Access Repository
StartPage 79
SubjectTerms Cognitive science
Computer science
Distributed, Parallel, and Cluster Computing
Hardware Architecture
Mathematical Physics
Mathematics
Title Reducing the memory usage of Lattice-Boltzmann schemes with a DWT-based compression
URI https://inria.hal.science/hal-03990880
Volume 77
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 2267-3059
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001476649
  issn: 2267-3059
  databaseCode: DOA
  dateStart: 20010101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2267-3059
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001476649
  issn: 2267-3059
  databaseCode: M~E
  dateStart: 20140101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
– providerCode: PRVPQU
  databaseName: Computer Science Database
  customDbUrl:
  eissn: 2267-3059
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001476649
  issn: 2267-3059
  databaseCode: K7-
  dateStart: 20230101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/compscijour
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Engineering Database
  customDbUrl:
  eissn: 2267-3059
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001476649
  issn: 2267-3059
  databaseCode: M7S
  dateStart: 20230101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: ProQuest Central
  customDbUrl:
  eissn: 2267-3059
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001476649
  issn: 2267-3059
  databaseCode: BENPR
  dateStart: 20230101
  isFulltext: true
  titleUrlDefault: https://www.proquest.com/central
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Publicly Available Content Database
  customDbUrl:
  eissn: 2267-3059
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001476649
  issn: 2267-3059
  databaseCode: PIMPY
  dateStart: 20230101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/publiccontent
  providerName: ProQuest
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1La9tAEF6M00N7aNq0pc-wlN6MUj1WWu3RiRMcmhgTG-qb0Fq7xKDIxg-R9A_kb3f2IUtOckgPvSxibYSk-ZiZncc3CP2QcIwgARGOG1DuEJ0kBD_diQPhCi_iNHXNsAk6GMSTCRu2WvdVL0yZ06KIb2_Z4r-KGvZA2Kp19h_Evb0pbMA1CB1WEDuszxL8lSJjrZqgblQh7V1no8rHTDpgrardnON5vv5zkxZFB063QhE2mSa3Tu_32FGWTTe72SLZYid8P-qeXx6ZBgNt-AzJ82qzLAEUNRxmhtDgJDep-GaBDZi6fHNXh3MWohl78IlqwrPqUgfEesNKBTUii-DQgd5yLdG3eGLPKl47v8VoTsoaNtjMTHqo3TX5mrJdy8msVBXs_pHLYjMHZ5dJu98dJcPeWXJxPvi1-2uj_LDfvYD1Os0Bp0yVe7klHKP3fBqyuI32jk8Hw6s6XEdoFOnD1PZVTI5cP9TPh48Ensp1FZnXnsr4DXptjxi4a6DxFrVEcYD2q_Ed2H7KA_TqckvZu3qHRhVuMGxigxuscYPnEj_CDba4wQo3OMVb3OAGbt6j8dnp-KTv2IkbThrGnkPDzJeRm1EmRSBo6nmcBMJLPT8LBGEizvyYhypTrEiEwJWMwoDzjPlyKrKU8OADahfzQnxEWIZZyKaepIoxTkrCZUi5S8GeUPDxo-gT-g4fKFkYSpVEkZyDPBK1V0vj83P-9AW9rKH5FbXXy434hl5My_VstTy0cjzUsZa_MNVq9w
linkProvider ProQuest
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Reducing+the+memory+usage+of+Lattice-Boltzmann+schemes+with+a+DWT-based+compression&rft.jtitle=ESAIM.+Proceedings+and+surveys&rft.au=Flint%2C+Cl%C3%A9ment&rft.au=Helluy%2C+Philippe&rft.date=2024-11-18&rft.pub=EDP+Sciences&rft.issn=2267-3059&rft.eissn=2267-3059&rft.volume=77&rft.spage=79&rft.epage=99&rft_id=info:doi/10.48550%2FarXiv.2302.09883&rft.externalDBID=HAS_PDF_LINK&rft.externalDocID=oai%3AHAL%3Ahal-03990880v1
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2267-3059&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2267-3059&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2267-3059&client=summon