GX-Plug: a Middleware for Plugging Accelerators to Distributed Graph Processing
Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out benefits from distributed graph systems, and the scale-up benefits from high-performance accelerators. To this end, we propose a middleware, call...
Uloženo v:
| Vydáno v: | Data engineering s. 2682 - 2694 |
|---|---|
| Hlavní autoři: | , , , |
| Médium: | Konferenční příspěvek |
| Jazyk: | angličtina |
| Vydáno: |
IEEE
01.05.2022
|
| Témata: | |
| ISSN: | 2375-026X |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out benefits from distributed graph systems, and the scale-up benefits from high-performance accelerators. To this end, we propose a middleware, called the GX-plug, for the ease of integrating the merits of both. As a middleware, the GX-plug is versatile in supporting different runtime environments, computation models, and programming models. More, for improving the middleware performance, we study a series of techniques, including pipeline shuffle, synchro-nization caching and skipping, and workload balancing, for intra-, inter-, and beyond-iteration optimizations, respectively. Exper-iments show that our middleware efficiently plugs accelerators to representative distributed graph systems, e.g., GraphX and Powergraph, with up-to 20x acceleration ratio. |
|---|---|
| AbstractList | Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out benefits from distributed graph systems, and the scale-up benefits from high-performance accelerators. To this end, we propose a middleware, called the GX-plug, for the ease of integrating the merits of both. As a middleware, the GX-plug is versatile in supporting different runtime environments, computation models, and programming models. More, for improving the middleware performance, we study a series of techniques, including pipeline shuffle, synchro-nization caching and skipping, and workload balancing, for intra-, inter-, and beyond-iteration optimizations, respectively. Exper-iments show that our middleware efficiently plugs accelerators to representative distributed graph systems, e.g., GraphX and Powergraph, with up-to 20x acceleration ratio. |
| Author | Kong, Deyu Xie, Xike Li, Qi Zou, Kai |
| Author_xml | – sequence: 1 givenname: Kai surname: Zou fullname: Zou, Kai email: slnt@mail.ustc.edu.cn organization: University of Science and Technology of China,Data Darkness Lab – sequence: 2 givenname: Xike surname: Xie fullname: Xie, Xike email: xkxie@ustc.edu.cn organization: University of Science and Technology of China,Data Darkness Lab – sequence: 3 givenname: Qi surname: Li fullname: Li, Qi email: likamo@mail.ustc.edu.cn organization: University of Science and Technology of China,Data Darkness Lab – sequence: 4 givenname: Deyu surname: Kong fullname: Kong, Deyu email: cavegf@mail.ustc.edu.cn organization: University of Science and Technology of China,Data Darkness Lab |
| BookMark | eNotjMFOAjEURavRREC-QBf9gRlf-6adjjsCiCQYWGjCjrTTN1gzMqQdYvx7MXo3Jzk5uUN2degOxNi9gFwIqB6W09lcYVmoXIKUOYAs9AUbCq1VAcZgdckGEkuVgdTbGzZO6QPOqwohFAzYerHNNu1p_8gtfwnet_RlI_Gmi_xX78Nhzyd1TS1F23cx8b7js5D6GNypJ88X0R7f-SZ2NaV0jm_ZdWPbRON_jtjb0_x1-pyt1ovldLLKggTsM9cUxgtViloaUShP6AU2YLCxUjow1hOhQ6eV02CcQVVWpfS1IWvqyhCO2N3fbyCi3TGGTxu_d9U51KjwBzd7UPs |
| CODEN | IEEPAD |
| ContentType | Conference Proceeding |
| DBID | 6IE 6IH CBEJK RIE RIO |
| DOI | 10.1109/ICDE53745.2022.00246 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan (POP) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE/IET Electronic Library (IEL) (UW System Shared) IEEE Proceedings Order Plans (POP) 1998-present |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Xplore Digital Library url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISBN | 1665408839 9781665408837 |
| EISSN | 2375-026X |
| EndPage | 2694 |
| ExternalDocumentID | 9835635 |
| Genre | orig-research |
| GrantInformation_xml | – fundername: NSFC grantid: 61772492,62072428 funderid: 10.13039/501100001809 |
| GroupedDBID | 6IE 6IH 6IL 6IN AAWTH ABLEC ADZIZ ALMA_UNASSIGNED_HOLDINGS BEFXN BFFAM BGNUA BKEBE BPEOZ CBEJK CHZPO IEGSK IJVOP OCL RIE RIL RIO |
| ID | FETCH-LOGICAL-i203t-bf48d1571c28145de3d13f083fa22b08adee3b3b65b608b8357972dc8ea8c98e3 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 0 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000855078402055&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| IngestDate | Wed Aug 27 02:24:33 EDT 2025 |
| IsPeerReviewed | false |
| IsScholarly | true |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-i203t-bf48d1571c28145de3d13f083fa22b08adee3b3b65b608b8357972dc8ea8c98e3 |
| PageCount | 13 |
| ParticipantIDs | ieee_primary_9835635 |
| PublicationCentury | 2000 |
| PublicationDate | 2022-May |
| PublicationDateYYYYMMDD | 2022-05-01 |
| PublicationDate_xml | – month: 05 year: 2022 text: 2022-May |
| PublicationDecade | 2020 |
| PublicationTitle | Data engineering |
| PublicationTitleAbbrev | ICDE |
| PublicationYear | 2022 |
| Publisher | IEEE |
| Publisher_xml | – name: IEEE |
| SSID | ssj0000941150 |
| Score | 2.194975 |
| Snippet | Recently, research communities highlight the neces-sity of formulating a scalability continuum for large-scale graph processing, which gains the scale-out... |
| SourceID | ieee |
| SourceType | Publisher |
| StartPage | 2682 |
| SubjectTerms | accelerators Computational modeling Data engineering Distributed graph systems Middleware Pipelines Programming Runtime environment Scalability Synchronization |
| Title | GX-Plug: a Middleware for Plugging Accelerators to Distributed Graph Processing |
| URI | https://ieeexplore.ieee.org/document/9835635 |
| WOSCitedRecordID | wos000855078402055&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LTwMhECZt48FT1db4DgePYpfHLuDN2IcerD1o0lvDY9Y0Ma1pt_r3hd21evDijUxICENgPga--RC6lI4pZU1GWDgXiUhzRZTwOXHOW0utpJ5VYhNyPFbTqZ400NWWCwMA5eczuI7N8i3fL90mpsp6OsCFECCbqCllVnG1tvmUcE2J4KZmx9FE9x7u-oOUS5GGWyCLZTlZRLm_NFTKEDJs_2_wPdT94eLhyTbK7KMGLA5Q-1uMAdd7s4OeRlMyedu83mCDH8usw6dZAQ6YFEdz1CLCt86FKFM-rK9xscT9WDU3Cl6Bx6NYuRrXvIHQuYtehoPnu3tSqyWQOUt4QWwulKeppMH7VKQeuKc8DwgrN4zZRBkPwC23WWqzRNkwG6kl806BUU4r4IeotVgu4AhhLimoJDeaCiu8MiZlIKyETGllqafHqBP9M3uvCmLMatec_G0-RbtxAapfgmeoVaw2cI523EcxX68uylX8Ako_nig |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LTwIxEG4QTfSECsa3PXh0Zdttadeb4R0BOWDCjfQxa0gMGFj079vurujBi7emadJ0mna-mfabD6FbYaiUWjUC6u7FgPFEBpLZJDDGak20IJbmYhNiNJLTaTwuobstFwYAss9ncO-b2Vu-XZqNT5XVYwcXnIPcQbucubgnZ2ttMyouUPHwpuDHkTCu95utNo8E4y4OpL4wJ_U495eKSuZEOpX_TX-Iaj9sPDze-pkjVILFMap8yzHg4nRW0XN3GozfNq8PWOFhlnf4VCvADpVi3-3ViPCjMc7PZE_ra5wuccvXzfWSV2Bx19euxgVzwA2uoZdOe9LsBYVeQjCnYZQGOmHSEi6Isz9h3EJkSZQ4jJUoSnUolQWIdKQbXDdCqd1qRCyoNRKUNLGE6ASVF8sFnCIcCQIyTFRMmGZWKsUpMC2gIWOpiSVnqOrtM3vPS2LMCtOc_919g_Z7k-FgNuiPni7Qgd-M_M_gJSqnqw1coT3zkc7Xq-tsR78AtC2hbw |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=Data+engineering&rft.atitle=GX-Plug%3A+a+Middleware+for+Plugging+Accelerators+to+Distributed+Graph+Processing&rft.au=Zou%2C+Kai&rft.au=Xie%2C+Xike&rft.au=Li%2C+Qi&rft.au=Kong%2C+Deyu&rft.date=2022-05-01&rft.pub=IEEE&rft.eissn=2375-026X&rft.spage=2682&rft.epage=2694&rft_id=info:doi/10.1109%2FICDE53745.2022.00246&rft.externalDocID=9835635 |