In EDS ansehen

Aion: Live Migration for In-Memory Databases with Zero Downtime and Reduced Redundant Data Transfer

Gespeichert in:
Bibliographische Detailangaben
Titel: Aion: Live Migration for In-Memory Databases with Zero Downtime and Reduced Redundant Data Transfer
Autoren: Huijie Cao, Chenfeng Huang, Shengchi Liu, Huiqi Hu, Minghao Zhao, Xuan Zhou, Yaofeng Tu, Weining Qian
Quelle: Data Science and Engineering, Vol 10, Iss 2, Pp 212-229 (2025)
Verlagsinformationen: Springer Science and Business Media LLC, 2025.
Publikationsjahr: 2025
Schlagwörter: Electronic computers. Computer science, Distributed database, Information technology, QA75.5-76.95, Live migration, In-memory database, T58.5-58.64, Concurrency control
Beschreibung: Distributed in-memory databases are widely adopted to achieve low latency and high bandwidth for data-intensive applications. They support scale-out by sharding and distributing data across multiple nodes. To efficiently adapt to various workloads, distributed in-memory databases must be capable of migrating shards across nodes. In this paper, we demonstrate that state-of-the-art approaches experience significant performance degradation during migration due to service downtime and redundant data transfer. Furthermore, our findings indicate that the presence of service downtime constrains the scalability of migration strategies, while the transfer of redundant data during the snapshot transfer phase limits their adaptability to dynamic workloads. To this end, this paper proposes Aion, a live migration strategy designed for distributed in-memory databases. Aion eliminates any potential service downtime by immediately switching transaction routing to the destination node. To ensure data consistency between the source and destination nodes, as well as serializable execution during migration, Aion proposes the mutual validation phase. Moreover, Aion introduces an analysis phase before the snapshot transfer phase to identify dynamically changing hotspots in workloads. The analysis phase identifies and transfers tuples and versions accessed less frequently to the destination node, reducing the amount of data transferred. Aion is implemented on a distributed in-memory database and evaluated using various OLTP workloads. The results demonstrate that Aion can fundamentally eliminate service downtime, adapt effectively to various workloads and exhibit robust scalability. Compared to state-of-the-art approaches, Aion achieves up to 2.25x–6.57x higher throughput during migration and shortens the migration duration by 53.7–68.2%.
Publikationsart: Article
Sprache: English
ISSN: 2364-1541
2364-1185
DOI: 10.1007/s41019-024-00276-5
Zugangs-URL: https://doaj.org/article/86845ebd676e4146bf8ce977048d26e0
Rights: CC BY
Dokumentencode: edsair.doi.dedup.....58cb50e2bdd414b691cf739c9d7e6768
Datenbank: OpenAIRE
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://explore.openaire.eu/search/publication?articleId=doi_dedup___%3A%3A58cb50e2bdd414b691cf739c9d7e6768
    Name: EDS - OpenAIRE (s4221598)
    Category: fullText
    Text: View record at OpenAIRE
  – Url: https://resolver.ebscohost.com/openurl?sid=EBSCO:edsair&genre=article&issn=23641541&ISBN=&volume=10&issue=&date=20250115&spage=212&pages=212-229&title=Data Science and Engineering&atitle=Aion%3A%20Live%20Migration%20for%20In-Memory%20Databases%20with%20Zero%20Downtime%20and%20Reduced%20Redundant%20Data%20Transfer&aulast=Huijie%20Cao&id=DOI:10.1007/s41019-024-00276-5
    Name: Full Text Finder
    Category: fullText
    Text: Full Text Finder
    Icon: https://imageserver.ebscohost.com/branding/images/FTF.gif
    MouseOverText: Full Text Finder
  – Url: https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=EBSCO&SrcAuth=EBSCO&DestApp=WOS&ServiceName=TransferToWoS&DestLinkType=GeneralSearchSummary&Func=Links&author=Cao%20H
    Name: ISI
    Category: fullText
    Text: Nájsť tento článok vo Web of Science
    Icon: https://imagesrvr.epnet.com/ls/20docs.gif
    MouseOverText: Nájsť tento článok vo Web of Science
Header DbId: edsair
DbLabel: OpenAIRE
An: edsair.doi.dedup.....58cb50e2bdd414b691cf739c9d7e6768
RelevancyScore: 1015
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 1014.73791503906
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Aion: Live Migration for In-Memory Databases with Zero Downtime and Reduced Redundant Data Transfer
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Huijie+Cao%22">Huijie Cao</searchLink><br /><searchLink fieldCode="AR" term="%22Chenfeng+Huang%22">Chenfeng Huang</searchLink><br /><searchLink fieldCode="AR" term="%22Shengchi+Liu%22">Shengchi Liu</searchLink><br /><searchLink fieldCode="AR" term="%22Huiqi+Hu%22">Huiqi Hu</searchLink><br /><searchLink fieldCode="AR" term="%22Minghao+Zhao%22">Minghao Zhao</searchLink><br /><searchLink fieldCode="AR" term="%22Xuan+Zhou%22">Xuan Zhou</searchLink><br /><searchLink fieldCode="AR" term="%22Yaofeng+Tu%22">Yaofeng Tu</searchLink><br /><searchLink fieldCode="AR" term="%22Weining+Qian%22">Weining Qian</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: Data Science and Engineering, Vol 10, Iss 2, Pp 212-229 (2025)
– Name: Publisher
  Label: Publisher Information
  Group: PubInfo
  Data: Springer Science and Business Media LLC, 2025.
– Name: DatePubCY
  Label: Publication Year
  Group: Date
  Data: 2025
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Electronic+computers%2E+Computer+science%22">Electronic computers. Computer science</searchLink><br /><searchLink fieldCode="DE" term="%22Distributed+database%22">Distributed database</searchLink><br /><searchLink fieldCode="DE" term="%22Information+technology%22">Information technology</searchLink><br /><searchLink fieldCode="DE" term="%22QA75%2E5-76%2E95%22">QA75.5-76.95</searchLink><br /><searchLink fieldCode="DE" term="%22Live+migration%22">Live migration</searchLink><br /><searchLink fieldCode="DE" term="%22In-memory+database%22">In-memory database</searchLink><br /><searchLink fieldCode="DE" term="%22T58%2E5-58%2E64%22">T58.5-58.64</searchLink><br /><searchLink fieldCode="DE" term="%22Concurrency+control%22">Concurrency control</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: Distributed in-memory databases are widely adopted to achieve low latency and high bandwidth for data-intensive applications. They support scale-out by sharding and distributing data across multiple nodes. To efficiently adapt to various workloads, distributed in-memory databases must be capable of migrating shards across nodes. In this paper, we demonstrate that state-of-the-art approaches experience significant performance degradation during migration due to service downtime and redundant data transfer. Furthermore, our findings indicate that the presence of service downtime constrains the scalability of migration strategies, while the transfer of redundant data during the snapshot transfer phase limits their adaptability to dynamic workloads. To this end, this paper proposes Aion, a live migration strategy designed for distributed in-memory databases. Aion eliminates any potential service downtime by immediately switching transaction routing to the destination node. To ensure data consistency between the source and destination nodes, as well as serializable execution during migration, Aion proposes the mutual validation phase. Moreover, Aion introduces an analysis phase before the snapshot transfer phase to identify dynamically changing hotspots in workloads. The analysis phase identifies and transfers tuples and versions accessed less frequently to the destination node, reducing the amount of data transferred. Aion is implemented on a distributed in-memory database and evaluated using various OLTP workloads. The results demonstrate that Aion can fundamentally eliminate service downtime, adapt effectively to various workloads and exhibit robust scalability. Compared to state-of-the-art approaches, Aion achieves up to 2.25x–6.57x higher throughput during migration and shortens the migration duration by 53.7–68.2%.
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Article
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2364-1541<br />2364-1185
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s41019-024-00276-5
– Name: URL
  Label: Access URL
  Group: URL
  Data: <link linkTarget="URL" linkTerm="https://doaj.org/article/86845ebd676e4146bf8ce977048d26e0" linkWindow="_blank">https://doaj.org/article/86845ebd676e4146bf8ce977048d26e0</link>
– Name: Copyright
  Label: Rights
  Group: Cpyrght
  Data: CC BY
– Name: AN
  Label: Accession Number
  Group: ID
  Data: edsair.doi.dedup.....58cb50e2bdd414b691cf739c9d7e6768
PLink https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsair&AN=edsair.doi.dedup.....58cb50e2bdd414b691cf739c9d7e6768
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s41019-024-00276-5
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
        StartPage: 212
    Subjects:
      – SubjectFull: Electronic computers. Computer science
        Type: general
      – SubjectFull: Distributed database
        Type: general
      – SubjectFull: Information technology
        Type: general
      – SubjectFull: QA75.5-76.95
        Type: general
      – SubjectFull: Live migration
        Type: general
      – SubjectFull: In-memory database
        Type: general
      – SubjectFull: T58.5-58.64
        Type: general
      – SubjectFull: Concurrency control
        Type: general
    Titles:
      – TitleFull: Aion: Live Migration for In-Memory Databases with Zero Downtime and Reduced Redundant Data Transfer
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Huijie Cao
      – PersonEntity:
          Name:
            NameFull: Chenfeng Huang
      – PersonEntity:
          Name:
            NameFull: Shengchi Liu
      – PersonEntity:
          Name:
            NameFull: Huiqi Hu
      – PersonEntity:
          Name:
            NameFull: Minghao Zhao
      – PersonEntity:
          Name:
            NameFull: Xuan Zhou
      – PersonEntity:
          Name:
            NameFull: Yaofeng Tu
      – PersonEntity:
          Name:
            NameFull: Weining Qian
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 15
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 23641541
            – Type: issn-print
              Value: 23641185
            – Type: issn-locals
              Value: edsair
            – Type: issn-locals
              Value: edsairFT
          Numbering:
            – Type: volume
              Value: 10
          Titles:
            – TitleFull: Data Science and Engineering
              Type: main
ResultId 1