GX-Plug: a Middleware for Plugging Accelerators to Distributed Graph Processing

Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out benefits from distributed graph systems, and the scale-up benefits from high-performance accelerators. To this end, we propose a middleware, call...

Full description

Saved in:
Bibliographic Details
Published in:Data engineering pp. 2682 - 2694
Main Authors: Zou, Kai, Xie, Xike, Li, Qi, Kong, Deyu
Format: Conference Proceeding
Language:English
Published: IEEE 01.05.2022
Subjects:
accelerators
Computational modeling
Data engineering
Distributed graph systems
Middleware
Pipelines
Programming
Runtime environment
Scalability
Synchronization
ISSN:2375-026X
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out benefits from distributed graph systems, and the scale-up benefits from high-performance accelerators. To this end, we propose a middleware, called the GX-plug, for the ease of integrating the merits of both. As a middleware, the GX-plug is versatile in supporting different runtime environments, computation models, and programming models. More, for improving the middleware performance, we study a series of techniques, including pipeline shuffle, synchro-nization caching and skipping, and workload balancing, for intra-, inter-, and beyond-iteration optimizations, respectively. Exper-iments show that our middleware efficiently plugs accelerators to representative distributed graph systems, e.g., GraphX and Powergraph, with up-to 20x acceleration ratio.
AbstractList Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out benefits from distributed graph systems, and the scale-up benefits from high-performance accelerators. To this end, we propose a middleware, called the GX-plug, for the ease of integrating the merits of both. As a middleware, the GX-plug is versatile in supporting different runtime environments, computation models, and programming models. More, for improving the middleware performance, we study a series of techniques, including pipeline shuffle, synchro-nization caching and skipping, and workload balancing, for intra-, inter-, and beyond-iteration optimizations, respectively. Exper-iments show that our middleware efficiently plugs accelerators to representative distributed graph systems, e.g., GraphX and Powergraph, with up-to 20x acceleration ratio.
Author Kong, Deyu
Xie, Xike
Li, Qi
Zou, Kai
Author_xml – sequence: 1
  givenname: Kai
  surname: Zou
  fullname: Zou, Kai
  email: slnt@mail.ustc.edu.cn
  organization: University of Science and Technology of China,Data Darkness Lab
– sequence: 2
  givenname: Xike
  surname: Xie
  fullname: Xie, Xike
  email: xkxie@ustc.edu.cn
  organization: University of Science and Technology of China,Data Darkness Lab
– sequence: 3
  givenname: Qi
  surname: Li
  fullname: Li, Qi
  email: likamo@mail.ustc.edu.cn
  organization: University of Science and Technology of China,Data Darkness Lab
– sequence: 4
  givenname: Deyu
  surname: Kong
  fullname: Kong, Deyu
  email: cavegf@mail.ustc.edu.cn
  organization: University of Science and Technology of China,Data Darkness Lab
BookMark eNotjMFOAjEURavRREC-QBf9gRlf-6adjjsCiCQYWGjCjrTTN1gzMqQdYvx7MXo3Jzk5uUN2degOxNi9gFwIqB6W09lcYVmoXIKUOYAs9AUbCq1VAcZgdckGEkuVgdTbGzZO6QPOqwohFAzYerHNNu1p_8gtfwnet_RlI_Gmi_xX78Nhzyd1TS1F23cx8b7js5D6GNypJ88X0R7f-SZ2NaV0jm_ZdWPbRON_jtjb0_x1-pyt1ovldLLKggTsM9cUxgtViloaUShP6AU2YLCxUjow1hOhQ6eV02CcQVVWpfS1IWvqyhCO2N3fbyCi3TGGTxu_d9U51KjwBzd7UPs
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IH
CBEJK
RIE
RIO
DOI 10.1109/ICDE53745.2022.00246
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan (POP) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP) 1998-present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 1665408839
9781665408837
EISSN 2375-026X
EndPage 2694
ExternalDocumentID 9835635
Genre orig-research
GrantInformation_xml – fundername: NSFC
  grantid: 61772492,62072428
  funderid: 10.13039/501100001809
GroupedDBID 6IE
6IH
6IL
6IN
AAWTH
ABLEC
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IJVOP
OCL
RIE
RIL
RIO
ID FETCH-LOGICAL-i203t-bf48d1571c28145de3d13f083fa22b08adee3b3b65b608b8357972dc8ea8c98e3
IEDL.DBID RIE
ISICitedReferencesCount 0
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000855078402055&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 27 02:24:33 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i203t-bf48d1571c28145de3d13f083fa22b08adee3b3b65b608b8357972dc8ea8c98e3
PageCount 13
ParticipantIDs ieee_primary_9835635
PublicationCentury 2000
PublicationDate 2022-May
PublicationDateYYYYMMDD 2022-05-01
PublicationDate_xml – month: 05
  year: 2022
  text: 2022-May
PublicationDecade 2020
PublicationTitle Data engineering
PublicationTitleAbbrev ICDE
PublicationYear 2022
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0000941150
Score 2.1950777
Snippet Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out...
SourceID ieee
SourceType Publisher
StartPage 2682
SubjectTerms accelerators
Computational modeling
Data engineering
Distributed graph systems
Middleware
Pipelines
Programming
Runtime environment
Scalability
Synchronization
Title GX-Plug: a Middleware for Plugging Accelerators to Distributed Graph Processing
URI https://ieeexplore.ieee.org/document/9835635
WOSCitedRecordID wos000855078402055&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NTwIxEG2AePCECsbv9ODRyrbdfnkzgGiiyEENN9JtZw2JAQOL_n3bZUUPXrxtmk02O00zrzPz3kPo3HmTa2mA5FzlJNWpI5YlllDKc01BQlpOVb7cq-FQj8dmVEMXGy4MAJTDZ3AZH8tevp-7VSyVdUyACyFB1lFdKbnmam3qKeGaEsFNxY6jiencdXt9wVUqwi2QRVlOFlHuLw-VMoXcNP_38R3U_uHi4dEmy-yiGsz2UPPbjAFXZ7OFHgdjMnpbvV5hix_KqsOnXQAOmBTH5ehFhK-dC1mmbKwvcTHHvaiaGw2vwONBVK7GFW8gvNxGzzf9p-4tqdwSyJQlvCBZnmpPhaKOaZoKD9yHeAeElVvGskRbD8AznkmRyURn4W-UUcw7DVY7o4Hvo8ZsPoMDhDMWDTiE8T42ZqN8j5YuobmwkICQ6hC1Ynwm72tBjEkVmqO_l4_RdtyA9ZTgCWoUixWcoi33UUyXi7NyF78A5pudXQ
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NTwIxEG0QTfSECsZve_BoZdtud1tvBvmKgBzQcCPddtaQGDCw6N-3XVb04MXbptlks9M08zoz7z2Ero1VqYwUkJTHKQllaIhmgSaU8lRSiCDMpypfevFgIMdjNSyhmw0XBgDy4TO49Y95L9_OzcqXyurKwQWXILfQtnfOKtham4qKu6h4eFPw42ig6t3GQ1PwOBTuHsi8MCfzOPeXi0qeRFqV_31-H9V-2Hh4uMkzB6gEs0NU-bZjwMXprKKn9pgM31avd1jjfl53-NQLwA6VYr_s3YjwvTEuz-St9SXO5vjB6-Z6yyuwuO21q3HBHHAv19BzqzlqdEjhl0CmLOAZSdJQWipiapikobDArYu4w1ipZiwJpLYAPOFJJJIokIn7m1jFzBoJWholgR-h8mw-g2OEE-YtOISy1rdmvYCPjExAU6EhABHFJ6jq4zN5X0tiTIrQnP69fIV2O6N-b9LrDh7P0J7fjPXM4DkqZ4sVXKAd85FNl4vLfEe_AEqhoKY
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=Data+engineering&rft.atitle=GX-Plug%3A+a+Middleware+for+Plugging+Accelerators+to+Distributed+Graph+Processing&rft.au=Zou%2C+Kai&rft.au=Xie%2C+Xike&rft.au=Li%2C+Qi&rft.au=Kong%2C+Deyu&rft.date=2022-05-01&rft.pub=IEEE&rft.eissn=2375-026X&rft.spage=2682&rft.epage=2694&rft_id=info:doi/10.1109%2FICDE53745.2022.00246&rft.externalDocID=9835635