A Shared-Memory Algorithm for Updating Tree-Based Properties of Large Dynamic Networks
This paper presents a network-based template for analyzing large-scale dynamic data. Specifically, we propose a novel shared-memory parallel algorithm for updating tree-based structures or properties, such as connected components (CC) and minimum spanning trees (MST), on dynamic networks. The underl...
Gespeichert in:
| Veröffentlicht in: | IEEE transactions on big data Jg. 8; H. 2; S. 302 - 317 |
|---|---|
| Hauptverfasser: | , , , , |
| Format: | Journal Article |
| Sprache: | Englisch |
| Veröffentlicht: |
Piscataway
IEEE
01.04.2022
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Schlagworte: | |
| ISSN: | 2332-7790, 2372-2096 |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | This paper presents a network-based template for analyzing large-scale dynamic data. Specifically, we propose a novel shared-memory parallel algorithm for updating tree-based structures or properties, such as connected components (CC) and minimum spanning trees (MST), on dynamic networks. The underlying idea is to update the information in a rooted tree data structure that stores the edges of the network that are most relevant to the analysis. Extensive experiments on real-world and synthetic networks demonstrate that, with the exception of the inherently sequential component for creating the rooted tree, our proposed updatiing algorithm is scalable and, in most cases, also requires significantly less memory, energy, and time than recomputing-from-scratch algorithm. To the best of our knowledge, this is the first parallel algorithm for updating MST on weighted dynamic networks. The rooted-tree based framework that we propose in this paper can be extended for updating other weighted and unweighted tree-based properties such as single source shortest path and betweenness and closeness centrality. |
|---|---|
| AbstractList | This paper presents a network-based template for analyzing large-scale dynamic data. Specifically, we propose a novel shared-memory parallel algorithm for updating tree-based structures or properties, such as connected components (CC) and minimum spanning trees (MST), on dynamic networks. The underlying idea is to update the information in a rooted tree data structure that stores the edges of the network that are most relevant to the analysis. Extensive experiments on real-world and synthetic networks demonstrate that, with the exception of the inherently sequential component for creating the rooted tree, our proposed updatiing algorithm is scalable and, in most cases, also requires significantly less memory, energy, and time than recomputing-from-scratch algorithm. To the best of our knowledge, this is the first parallel algorithm for updating MST on weighted dynamic networks. The rooted-tree based framework that we propose in this paper can be extended for updating other weighted and unweighted tree-based properties such as single source shortest path and betweenness and closeness centrality. |
| Author | Pollard, Samuel D. Das, Sajal K. Norris, Boyana Bhowmick, Sanjukta Srinivasan, Sriram |
| Author_xml | – sequence: 1 givenname: Sriram orcidid: 0000-0003-0085-309X surname: Srinivasan fullname: Srinivasan, Sriram email: sriramsrinivas@unomaha.edu organization: Department of Computer Science, University of Nebraska Omaha, Omaha, NE, USA – sequence: 2 givenname: Samuel D. orcidid: 0000-0002-3275-4064 surname: Pollard fullname: Pollard, Samuel D. email: spollard@cs.uoregon.edu organization: Department of Computer and Information Science, University of Oregon, Eugene, OR, USA – sequence: 3 givenname: Boyana orcidid: 0000-0001-5811-9731 surname: Norris fullname: Norris, Boyana email: norris@cs.uoregon.edu organization: Department of Computer and Information Science, University of Oregon, Eugene, OR, USA – sequence: 4 givenname: Sajal K. orcidid: 0000-0002-9471-0868 surname: Das fullname: Das, Sajal K. email: sdas@mst.edu organization: Department of Computer Science, Missouri University of Science and Technology, Rolla, MO, USA – sequence: 5 givenname: Sanjukta surname: Bhowmick fullname: Bhowmick, Sanjukta email: sbhowmick@unomaha.edu organization: Department of Computer Science, University of Nebraska Omaha, Omaha, NE, USA |
| BookMark | eNqFkMtuwjAQRa2qlUopX8DGUtehfiR2sgzQl0QfUkO3keNMwJTE1A6q-PsGBXXRTVczi3vmjs4VOm9sAwiNKZlQSpLbbDpPs3TCCI0nLJaEcnGGBoxLFjCSiPPjzlkgZUIu0cj7DSGECkJ4wgboI8Xva-WgDJ6htu6A0-3KOtOua1xZh5e7UrWmWeHMAQRT5aHEb87uwLUGPLYVXii3Ajw_NKo2Gr9A-23dp79GF5Xaehid5hAt7--y2WOweH14mqWLQDMm24BHRMiKA5E8jAQLmS6KMhLARKyIlgnTsRQFjYCKJFZaci2hopWqYsVVoSI-RDf93Z2zX3vwbb6xe9d0lTkTPKYsFGHSpXif0s5676DKd87Uyh1ySvKjw7x3mB8d5ieHHZX8obRpOxu2aZ0y23_Ycc8aAPhti7tvWPfPD3WXgH8 |
| CODEN | ITBDAX |
| CitedBy_id | crossref_primary_10_1109_TPDS_2021_3084096 |
| Cites_doi | 10.1109/ICPP.2004.1327954 10.1038/35075138 10.1137/1.9781611972740.43 10.1109/NAECON.2015.7443098 10.1145/1572769.1572796 10.1109/MICRO.2016.7783759 10.1109/SC.2005.4 10.1145/359657.359665 10.14778/2212351.2212354 10.1109/RCIS.2011.6006866 10.1007/978-3-642-11261-4_11 10.1145/1837274.1837289 10.1109/SC.2010.46 10.1016/j.jpdc.2014.04.001 10.1109/IPDPSW.2016.180 10.1016/j.jpdc.2005.03.011 10.1109/TCSII.2013.2285966 10.1145/2425676.2425689 10.1002/9780470253489 10.1145/1840845.1840883 10.1145/1298306.1298311 10.1145/1807167.1807184 10.1201/9781420049503-c9 10.1109/HiPC.2013.6799108 10.1142/s012962649900013x 10.1109/ICIP.2000.901000 10.1145/1993316.1993501 |
| ContentType | Journal Article |
| Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022 |
| Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022 |
| DBID | 97E RIA RIE AAYXX CITATION 7SP 8FD L7M |
| DOI | 10.1109/TBDATA.2018.2870136 |
| DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005–Present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Electronics & Communications Abstracts Technology Research Database Advanced Technologies Database with Aerospace |
| DatabaseTitle | CrossRef Technology Research Database Advanced Technologies Database with Aerospace Electronics & Communications Abstracts |
| DatabaseTitleList | Technology Research Database |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 2372-2096 |
| EndPage | 317 |
| ExternalDocumentID | 10_1109_TBDATA_2018_2870136 8464249 |
| Genre | orig-research |
| GrantInformation_xml | – fundername: National Science Foundation grantid: #1533881; #1725566; #1533918; #1725755; #1725585 funderid: 10.13039/100000001 |
| GroupedDBID | 0R~ 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABJNI ABQJQ ABVLG ACGFS AGQYO AHBIQ AKJIK AKQYR ALMA_UNASSIGNED_HOLDINGS ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ EBS IEDLZ IFIPE IPLJI JAVBF M43 OCL RIA RIE AAYXX AGSQL CITATION EJD O9- 7SP 8FD L7M |
| ID | FETCH-LOGICAL-c227t-35067f3e073456242cbbd56e268a0c792c876b15e1698ac73c7ef1faf8a3aba53 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 3 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000767848400002&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 2332-7790 |
| IngestDate | Sun Jun 29 16:13:51 EDT 2025 Tue Nov 18 21:27:19 EST 2025 Sat Nov 29 05:31:04 EST 2025 Wed Aug 27 02:49:19 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 2 |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c227t-35067f3e073456242cbbd56e268a0c792c876b15e1698ac73c7ef1faf8a3aba53 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0002-9471-0868 0000-0001-5811-9731 0000-0003-0085-309X 0000-0002-3275-4064 |
| PQID | 2638124649 |
| PQPubID | 4437220 |
| PageCount | 16 |
| ParticipantIDs | ieee_primary_8464249 crossref_primary_10_1109_TBDATA_2018_2870136 proquest_journals_2638124649 crossref_citationtrail_10_1109_TBDATA_2018_2870136 |
| PublicationCentury | 2000 |
| PublicationDate | 2022-04-01 |
| PublicationDateYYYYMMDD | 2022-04-01 |
| PublicationDate_xml | – month: 04 year: 2022 text: 2022-04-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | Piscataway |
| PublicationPlace_xml | – name: Piscataway |
| PublicationTitle | IEEE transactions on big data |
| PublicationTitleAbbrev | TBData |
| PublicationYear | 2022 |
| Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | ref13 ref35 ref12 ref34 ref15 ref31 ref30 ref11 Cattaneo (ref29) 2010; 158 ref33 ref10 ref2 ref17 Plimpton (ref23) 2014 ref16 ref19 Sneath (ref5) 1957; 17 Cormen (ref8) 2009 Leskovec (ref14) 2014 ref24 ref26 ref25 ref20 ref21 Bader (ref9) 2005; 65 ref28 ref27 Junker (ref1) 2008 ref7 Hoefler (ref32) 2012 ref4 ref3 ref6 |
| References_xml | – ident: ref10 doi: 10.1109/ICPP.2004.1327954 – ident: ref4 doi: 10.1038/35075138 – ident: ref13 doi: 10.1137/1.9781611972740.43 – ident: ref33 doi: 10.1109/NAECON.2015.7443098 – ident: ref28 doi: 10.1145/1572769.1572796 – ident: ref34 doi: 10.1109/MICRO.2016.7783759 – ident: ref11 doi: 10.1109/SC.2005.4 – ident: ref6 doi: 10.1145/359657.359665 – ident: ref19 doi: 10.14778/2212351.2212354 – ident: ref2 doi: 10.1109/RCIS.2011.6006866 – volume: 65 start-page: 994 issue: 9 volume-title: J. Parallel Distrib. Comput. year: 2005 ident: ref9 article-title: A fast, parallel spanning tree algorithm for symmetric multiprocessors (SMPs) – ident: ref16 doi: 10.1007/978-3-642-11261-4_11 – ident: ref12 doi: 10.1145/1837274.1837289 – ident: ref24 doi: 10.1109/SC.2010.46 – year: 2014 ident: ref23 article-title: Streaming data analytics via message passing with application to graph algorithms doi: 10.1016/j.jpdc.2014.04.001 – ident: ref26 doi: 10.1109/IPDPSW.2016.180 – ident: ref27 doi: 10.1016/j.jpdc.2005.03.011 – year: 2014 ident: ref14 article-title: Stanford large network dataset collection – year: 2012 ident: ref32 article-title: Green Graph 500 – ident: ref35 doi: 10.1109/TCSII.2013.2285966 – ident: ref21 doi: 10.1145/2425676.2425689 – volume-title: Analysis of Biological Networks (Wiley Series in Bioinformatics) year: 2008 ident: ref1 doi: 10.1002/9780470253489 – ident: ref17 doi: 10.1145/1840845.1840883 – volume: 158 start-page: 404 issue: 5 volume-title: Discr. Appl. Math. year: 2010 ident: ref29 article-title: Maintaining dynamic minimum spanning trees: An experimental study – volume: 17 start-page: 201 issue: 1 volume-title: Microbiology year: 1957 ident: ref5 article-title: The application of computers to taxonomy – ident: ref3 doi: 10.1145/1298306.1298311 – volume-title: Introduction to Algorithms year: 2009 ident: ref8 – ident: ref20 doi: 10.1145/1807167.1807184 – ident: ref30 doi: 10.1201/9781420049503-c9 – ident: ref25 doi: 10.1109/HiPC.2013.6799108 – ident: ref31 doi: 10.1142/s012962649900013x – ident: ref7 doi: 10.1109/ICIP.2000.901000 – ident: ref15 doi: 10.1145/1993316.1993501 |
| SSID | ssj0001600392 |
| Score | 2.199606 |
| Snippet | This paper presents a network-based template for analyzing large-scale dynamic data. Specifically, we propose a novel shared-memory parallel algorithm for... |
| SourceID | proquest crossref ieee |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 302 |
| SubjectTerms | Algorithms Big Data connected components Data structures Dynamic networks Graph theory Heuristic algorithms Image edge detection Maintenance engineering minimum spanning tree Networks Parallel algorithms Partitioning algorithms shared memory algorithms |
| Title | A Shared-Memory Algorithm for Updating Tree-Based Properties of Large Dynamic Networks |
| URI | https://ieeexplore.ieee.org/document/8464249 https://www.proquest.com/docview/2638124649 |
| Volume | 8 |
| WOSCitedRecordID | wos000767848400002&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 2372-2096 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001600392 issn: 2332-7790 databaseCode: RIE dateStart: 20150101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NT8IwFH8B4sGLqGhE0fTgkQHrPtodh0g8KOEAhtvSdW9IoowMMPG_t-0GHDQm3nZok6Zv77Pv_X4A965AKhyfWwkVaLmpj1Ycq6yVSzfxZI8Hyj4Ysgk2GvHZLBhXoL2fhUFE03yGHf1p3vKTTG51qayrfKWr0oUqVBljxazWoZ7i6zFTWgIL2b2gO-kPwkmou7d4Rz_n2QaG-eB8DJvKDxNs_Mqw_r8TncJJGT-SsBD4GVRweQ71HTcDKVW1Aa8h0VjMmFgvupf2i4Tv8yxfbN4-iApTyXSlxxqWczLJEa2-cmUJGeu6fK4BVkmWkmfdIk4GBWE9GRXd4usLmA4fJw9PVsmhYElK2cZyPOWOUgeVJutcx6UyjhPPR-pz0ZMsoFKZw9j20PYDLiRzJMPUTkXKhSNi4TmXUFtmS7wC4nHBPRZTn6LKoVgaJJiocEyymKPDU94EurvcSJYA45rn4j0yiUYviAqJRFoiUSmRJrT3m1YFvsbfyxtaCPul5f03obWTYlTq4DqiyrSo6MV3g-vfd93AMdXDDKYPpwW1Tb7FWziSn5vFOr8zv9c38tvNuQ |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NT8IwFH9RNNGLqGjEzx48MmDdV3ecItGIC4dhuC1d94YkCmYME_97227gQWPibYc2afr2Pvve7wdwbXOk3HKZkVKOhp25aCSJzFqZsFNHdJkv7YMmm_DCkI3H_nADWutZGETUzWfYVp_6LT-di6UqlXWkr7RlurAJW45tU7Oc1vquqLhq0JRW0EJm1-9EN70gClT_FmurBz1TAzF_ux_Np_LDCGvP0q__70z7sFdFkCQoRX4AGzg7hPqKnYFUytqA54AoNGZMjSfVTftJgtfJPJ8WL29EBqpk9K4GG2YTEuWIxo10ZikZqsp8riBWyTwjA9UkTnolZT0Jy37xxRGM-nfR7b1RsSgYglKvMCxHOqTMQqnLKtuxqUiS1HGRuox3hedTIQ1iYjpouj7jwrOEh5mZ8YxxiyfcsY6hNpvP8ASIwzhzvIS6FGUW5WV-iqkMyISXMLRYxppAV5cbiwpiXDFdvMY61ej6cSmRWEkkriTShNZ603uJsPH38oYSwnppdf9NOF9JMa60cBFTaVxk_OLa_unvu65g5z56GsSDh_DxDHapGm3QXTnnUCvyJV7Atvgopov8Uv9qX9Af0QA |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Shared-Memory+Algorithm+for+Updating+Tree-Based+Properties+of+Large+Dynamic+Networks&rft.jtitle=IEEE+transactions+on+big+data&rft.au=Srinivasan%2C+Sriram&rft.au=Pollard%2C+Samuel+D&rft.au=Norris%2C+Boyana&rft.au=Das%2C+Sajal+K&rft.date=2022-04-01&rft.pub=The+Institute+of+Electrical+and+Electronics+Engineers%2C+Inc.+%28IEEE%29&rft.eissn=2372-2096&rft.volume=8&rft.issue=2&rft.spage=302&rft_id=info:doi/10.1109%2FTBDATA.2018.2870136&rft.externalDBID=NO_FULL_TEXT |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2332-7790&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2332-7790&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2332-7790&client=summon |