GX-Plug: a Middleware for Plugging Accelerators to Distributed Graph Processing

Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out benefits from distributed graph systems, and the scale-up benefits from high-performance accelerators. To this end, we propose a middleware, call...

Full description

Saved in:
Bibliographic Details
Published in:Data engineering pp. 2682 - 2694
Main Authors: Zou, Kai, Xie, Xike, Li, Qi, Kong, Deyu
Format: Conference Proceeding
Language:English
Published: IEEE 01.05.2022
Subjects:
accelerators
Computational modeling
Data engineering
Distributed graph systems
Middleware
Pipelines
Programming
Runtime environment
Scalability
Synchronization
ISSN:2375-026X
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out benefits from distributed graph systems, and the scale-up benefits from high-performance accelerators. To this end, we propose a middleware, called the GX-plug, for the ease of integrating the merits of both. As a middleware, the GX-plug is versatile in supporting different runtime environments, computation models, and programming models. More, for improving the middleware performance, we study a series of techniques, including pipeline shuffle, synchro-nization caching and skipping, and workload balancing, for intra-, inter-, and beyond-iteration optimizations, respectively. Exper-iments show that our middleware efficiently plugs accelerators to representative distributed graph systems, e.g., GraphX and Powergraph, with up-to 20x acceleration ratio.
AbstractList Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out benefits from distributed graph systems, and the scale-up benefits from high-performance accelerators. To this end, we propose a middleware, called the GX-plug, for the ease of integrating the merits of both. As a middleware, the GX-plug is versatile in supporting different runtime environments, computation models, and programming models. More, for improving the middleware performance, we study a series of techniques, including pipeline shuffle, synchro-nization caching and skipping, and workload balancing, for intra-, inter-, and beyond-iteration optimizations, respectively. Exper-iments show that our middleware efficiently plugs accelerators to representative distributed graph systems, e.g., GraphX and Powergraph, with up-to 20x acceleration ratio.
Author Kong, Deyu
Xie, Xike
Li, Qi
Zou, Kai
Author_xml – sequence: 1
  givenname: Kai
  surname: Zou
  fullname: Zou, Kai
  email: slnt@mail.ustc.edu.cn
  organization: University of Science and Technology of China,Data Darkness Lab
– sequence: 2
  givenname: Xike
  surname: Xie
  fullname: Xie, Xike
  email: xkxie@ustc.edu.cn
  organization: University of Science and Technology of China,Data Darkness Lab
– sequence: 3
  givenname: Qi
  surname: Li
  fullname: Li, Qi
  email: likamo@mail.ustc.edu.cn
  organization: University of Science and Technology of China,Data Darkness Lab
– sequence: 4
  givenname: Deyu
  surname: Kong
  fullname: Kong, Deyu
  email: cavegf@mail.ustc.edu.cn
  organization: University of Science and Technology of China,Data Darkness Lab
BookMark eNotjMFOAjEURavRREC-QBf9gRlf-6adjjsCiCQYWGjCjrTTN1gzMqQdYvx7MXo3Jzk5uUN2degOxNi9gFwIqB6W09lcYVmoXIKUOYAs9AUbCq1VAcZgdckGEkuVgdTbGzZO6QPOqwohFAzYerHNNu1p_8gtfwnet_RlI_Gmi_xX78Nhzyd1TS1F23cx8b7js5D6GNypJ88X0R7f-SZ2NaV0jm_ZdWPbRON_jtjb0_x1-pyt1ovldLLKggTsM9cUxgtViloaUShP6AU2YLCxUjow1hOhQ6eV02CcQVVWpfS1IWvqyhCO2N3fbyCi3TGGTxu_d9U51KjwBzd7UPs
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IH
CBEJK
RIE
RIO
DOI 10.1109/ICDE53745.2022.00246
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan (POP) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP) 1998-present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 1665408839
9781665408837
EISSN 2375-026X
EndPage 2694
ExternalDocumentID 9835635
Genre orig-research
GrantInformation_xml – fundername: NSFC
  grantid: 61772492,62072428
  funderid: 10.13039/501100001809
GroupedDBID 6IE
6IH
6IL
6IN
AAWTH
ABLEC
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IJVOP
OCL
RIE
RIL
RIO
ID FETCH-LOGICAL-i203t-bf48d1571c28145de3d13f083fa22b08adee3b3b65b608b8357972dc8ea8c98e3
IEDL.DBID RIE
ISICitedReferencesCount 0
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000855078402055&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 27 02:24:33 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i203t-bf48d1571c28145de3d13f083fa22b08adee3b3b65b608b8357972dc8ea8c98e3
PageCount 13
ParticipantIDs ieee_primary_9835635
PublicationCentury 2000
PublicationDate 2022-May
PublicationDateYYYYMMDD 2022-05-01
PublicationDate_xml – month: 05
  year: 2022
  text: 2022-May
PublicationDecade 2020
PublicationTitle Data engineering
PublicationTitleAbbrev ICDE
PublicationYear 2022
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0000941150
Score 2.1950777
Snippet Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out...
SourceID ieee
SourceType Publisher
StartPage 2682
SubjectTerms accelerators
Computational modeling
Data engineering
Distributed graph systems
Middleware
Pipelines
Programming
Runtime environment
Scalability
Synchronization
Title GX-Plug: a Middleware for Plugging Accelerators to Distributed Graph Processing
URI https://ieeexplore.ieee.org/document/9835635
WOSCitedRecordID wos000855078402055&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LTwIxEJ4A8eAJFYzv9ODRld22u229GV56EDlowo30MWtIDBBY9O_bLit68OKtado0bdPMNzP95gO45tRwzWzI6uYq4tbQSOXCRDJ3meAZFTHaUmxCjEZyMlHjGtzsuDCIWH4-w9vQLHP5bmE3IVTWUR4ueANZh7oQ2ZartYuneDclgJuKHZfEqvPY7fVTJnjqvUAaynLSgHJ_aaiUJmTQ_N_iB9D-4eKR8c7KHEIN50fQ_BZjINXbbMHzcBKN3zdvd0STpzLq8KlXSDwmJaE7aBGRe2u9lSkT62tSLEgvVM0NglfoyDBUriYVb8APbsProP_SfYgqtYRoRmNWRCbn0iWpSCyVCU8dMpew3COsXFNqYqkdIjPMZKnJYmn8boQS1FmJWlolkR1DY76Y4wmQnFLn3Tg_ARm3yDVPnOIu8WOFMzGeQiucz3S5LYgxrY7m7O_uc9gPF7D9JXgBjWK1wUvYsx_FbL26Km_xC1g1nsg
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NTwIxEJ0gmugJFYzf9uDRld22u-16M3xHQA6YcCPbdtaQGDCw6N-3XVb04MVb07Rp2qaZNzN98wBuOVU8YdplddPY41pRL06F8mRqIsEjKnzUudiEGA7lZBKPSnC35cIgYv75DO9dM8_lm4Veu1BZPbZwwRrIHdh1ylkFW2sbUbGOioM3BT8u8ON6r9FshUzw0PqB1BXmpA7n_lJRyY1Iu_K_5Q-h9sPGI6OtnTmCEs6PofItx0CK11mF587EG72tXx9IQgZ53OEzWSKxqJS4bqdGRB61tnYmT62vSLYgTVc310leoSEdV7uaFMwBO7gGL-3WuNH1Cr0Eb0Z9lnkq5dIEoQg0lQEPDTITsNRirDShVPkyMYhMMRWFKvKlsrsRsaBGS0ykjiWyEyjPF3M8BZJSaqwjZycg4xp5wgMTcxPYscIoH8-g6s5n-r4piTEtjub87-4b2O-OB_1pvzd8uoADdxmbP4OXUM6Wa7yCPf2RzVbL6_xGvwDNHKIR
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=Data+engineering&rft.atitle=GX-Plug%3A+a+Middleware+for+Plugging+Accelerators+to+Distributed+Graph+Processing&rft.au=Zou%2C+Kai&rft.au=Xie%2C+Xike&rft.au=Li%2C+Qi&rft.au=Kong%2C+Deyu&rft.date=2022-05-01&rft.pub=IEEE&rft.eissn=2375-026X&rft.spage=2682&rft.epage=2694&rft_id=info:doi/10.1109%2FICDE53745.2022.00246&rft.externalDocID=9835635