GX-Plug: a Middleware for Plugging Accelerators to Distributed Graph Processing

Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out benefits from distributed graph systems, and the scale-up benefits from high-performance accelerators. To this end, we propose a middleware, call...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Data engineering S. 2682 - 2694
Hauptverfasser: Zou, Kai, Xie, Xike, Li, Qi, Kong, Deyu
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 01.05.2022
Schlagworte:
accelerators
Computational modeling
Data engineering
Distributed graph systems
Middleware
Pipelines
Programming
Runtime environment
Scalability
Synchronization
ISSN:2375-026X
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out benefits from distributed graph systems, and the scale-up benefits from high-performance accelerators. To this end, we propose a middleware, called the GX-plug, for the ease of integrating the merits of both. As a middleware, the GX-plug is versatile in supporting different runtime environments, computation models, and programming models. More, for improving the middleware performance, we study a series of techniques, including pipeline shuffle, synchro-nization caching and skipping, and workload balancing, for intra-, inter-, and beyond-iteration optimizations, respectively. Exper-iments show that our middleware efficiently plugs accelerators to representative distributed graph systems, e.g., GraphX and Powergraph, with up-to 20x acceleration ratio.
AbstractList Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out benefits from distributed graph systems, and the scale-up benefits from high-performance accelerators. To this end, we propose a middleware, called the GX-plug, for the ease of integrating the merits of both. As a middleware, the GX-plug is versatile in supporting different runtime environments, computation models, and programming models. More, for improving the middleware performance, we study a series of techniques, including pipeline shuffle, synchro-nization caching and skipping, and workload balancing, for intra-, inter-, and beyond-iteration optimizations, respectively. Exper-iments show that our middleware efficiently plugs accelerators to representative distributed graph systems, e.g., GraphX and Powergraph, with up-to 20x acceleration ratio.
Author Kong, Deyu
Xie, Xike
Li, Qi
Zou, Kai
Author_xml – sequence: 1
  givenname: Kai
  surname: Zou
  fullname: Zou, Kai
  email: slnt@mail.ustc.edu.cn
  organization: University of Science and Technology of China,Data Darkness Lab
– sequence: 2
  givenname: Xike
  surname: Xie
  fullname: Xie, Xike
  email: xkxie@ustc.edu.cn
  organization: University of Science and Technology of China,Data Darkness Lab
– sequence: 3
  givenname: Qi
  surname: Li
  fullname: Li, Qi
  email: likamo@mail.ustc.edu.cn
  organization: University of Science and Technology of China,Data Darkness Lab
– sequence: 4
  givenname: Deyu
  surname: Kong
  fullname: Kong, Deyu
  email: cavegf@mail.ustc.edu.cn
  organization: University of Science and Technology of China,Data Darkness Lab
BookMark eNotjMFOAjEURavRREC-QBf9gRlf-6adjjsCiCQYWGjCjrTTN1gzMqQdYvx7MXo3Jzk5uUN2degOxNi9gFwIqB6W09lcYVmoXIKUOYAs9AUbCq1VAcZgdckGEkuVgdTbGzZO6QPOqwohFAzYerHNNu1p_8gtfwnet_RlI_Gmi_xX78Nhzyd1TS1F23cx8b7js5D6GNypJ88X0R7f-SZ2NaV0jm_ZdWPbRON_jtjb0_x1-pyt1ovldLLKggTsM9cUxgtViloaUShP6AU2YLCxUjow1hOhQ6eV02CcQVVWpfS1IWvqyhCO2N3fbyCi3TGGTxu_d9U51KjwBzd7UPs
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IH
CBEJK
RIE
RIO
DOI 10.1109/ICDE53745.2022.00246
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan (POP) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP) 1998-present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 1665408839
9781665408837
EISSN 2375-026X
EndPage 2694
ExternalDocumentID 9835635
Genre orig-research
GrantInformation_xml – fundername: NSFC
  grantid: 61772492,62072428
  funderid: 10.13039/501100001809
GroupedDBID 6IE
6IH
6IL
6IN
AAWTH
ABLEC
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IJVOP
OCL
RIE
RIL
RIO
ID FETCH-LOGICAL-i203t-bf48d1571c28145de3d13f083fa22b08adee3b3b65b608b8357972dc8ea8c98e3
IEDL.DBID RIE
ISICitedReferencesCount 0
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000855078402055&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 27 02:24:33 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i203t-bf48d1571c28145de3d13f083fa22b08adee3b3b65b608b8357972dc8ea8c98e3
PageCount 13
ParticipantIDs ieee_primary_9835635
PublicationCentury 2000
PublicationDate 2022-May
PublicationDateYYYYMMDD 2022-05-01
PublicationDate_xml – month: 05
  year: 2022
  text: 2022-May
PublicationDecade 2020
PublicationTitle Data engineering
PublicationTitleAbbrev ICDE
PublicationYear 2022
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0000941150
Score 2.1950777
Snippet Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out...
SourceID ieee
SourceType Publisher
StartPage 2682
SubjectTerms accelerators
Computational modeling
Data engineering
Distributed graph systems
Middleware
Pipelines
Programming
Runtime environment
Scalability
Synchronization
Title GX-Plug: a Middleware for Plugging Accelerators to Distributed Graph Processing
URI https://ieeexplore.ieee.org/document/9835635
WOSCitedRecordID wos000855078402055&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV25TgMxFHxKIgqqAAnilgtKTHbt9UWHyAEFIQVI6SJfiyKhBCUb-H3s3SVQ0NBZliXLl2b87HkDcKk5FTogASbOMJwpp7FJDcGZdXGLZNzpymxCjMdyOlWTBlxttTDe-_Lzmb-OxfIt3y3tJobKeirQhQCQTWgKwSut1jaeEq4pkdzU6rg0Ub2Hu_6AUZGxcAskMS0niSz3l4dKCSHD9v8634PujxYPTbYosw8NvziA9rcZA6rPZgeeRlM8edu83iCNHsuow6deeRQ4KYrV0YsI3VobUKZ8WF-jYon6MWtuNLzyDo1i5mpU6wZC4y68DAfPd_e4dkvAc5LQAps8ky5lIrVEphlznrqU5oFh5ZoQk0jtvKeGGs4MT6QJoxFKEGel19Iq6ekhtBbLhT8ClNgA47myiXE8Y4wYy43nuWE8p1pTcQydOD-z9yohxqyempO_q09hNy5A9UvwDFrFauPPYcd-FPP16qJcxS_rHJ5F
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1JTwIxGP2CaKInVDDu9uDRkZlu0_Fm2CMgB0y4kW5jSAwYGPTv2w4jevDirWmaNN3yXr_2fQ_gVnISS4cEATaKBTQxMlCRwgHVxm8Ryo3cmE3Ew6GYTJJRCe62Whhrbf75zN77Yv6WbxZ67UNl9cTRBQeQO7DLKMXhRq21jai4i4qnN4U-LgqTeq_RbDESU-bugdgn5sSe5_5yUclBpF35X_eHUPtR46HRFmeOoGTnx1D5tmNAxemswnNnEoze1q8PSKJBHnf4lEuLHCtFvtq7EaFHrR3O5E_rK5QtUNPnzfWWV9agjs9djQrlgGtcg5d2a9zoBoVfQjDDIckClVJhIhZHGouIMmOJiUjqOFYqMVahkMZaoojiTPFQKDeaOImx0cJKoRNhyQmU54u5PQUUagfkaaJDZThlDCvNleWpYjwlUpL4DKp-fqbvm5QY02Jqzv-uvoH97njQn_Z7w6cLOPCLsfkzeAnlbLm2V7CnP7LZanmdr-gXVfmhjA
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=Data+engineering&rft.atitle=GX-Plug%3A+a+Middleware+for+Plugging+Accelerators+to+Distributed+Graph+Processing&rft.au=Zou%2C+Kai&rft.au=Xie%2C+Xike&rft.au=Li%2C+Qi&rft.au=Kong%2C+Deyu&rft.date=2022-05-01&rft.pub=IEEE&rft.eissn=2375-026X&rft.spage=2682&rft.epage=2694&rft_id=info:doi/10.1109%2FICDE53745.2022.00246&rft.externalDocID=9835635