An Efficient Binary Locally Repairable Code for Hadoop Distributed File System
In the Hadoop distributed file systems (HDFSs), to lower costly communication traffic for data recovery, the concept of locally repairable codes (LRCs) has been recently proposed. With regard to the immense size of modern energy-hungry HDFS, computational complexity reduction can be attractive. In t...
Uloženo v:
| Vydáno v: | IEEE communications letters Ročník 18; číslo 8; s. 1287 - 1290 |
|---|---|
| Hlavní autoři: | , , |
| Médium: | Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
New York, NY
IEEE
01.08.2014
Institute of Electrical and Electronics Engineers The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Témata: | |
| ISSN: | 1089-7798, 1558-2558 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | In the Hadoop distributed file systems (HDFSs), to lower costly communication traffic for data recovery, the concept of locally repairable codes (LRCs) has been recently proposed. With regard to the immense size of modern energy-hungry HDFS, computational complexity reduction can be attractive. In this letter, to avoid finite field multiplications, which are the major source of complexity, we put forward the idea of designing binary locally repairable codes (BLRCs). More specifically, we design a BLRC with a length of 15, rate of 2/3, and minimum distance of 4, which has the minimum possible locality among its type. We show that our code has lower complexity than most recent non-binary LRC in the literature while meeting other desirable requirements in HDFS such as storage overhead and reliability. |
|---|---|
| AbstractList | In the Hadoop distributed file systems (HDFSs), to lower costly communication traffic for data recovery, the concept of locally repairable codes (LRCs) has been recently proposed. With regard to the immense size of modern energy-hungry HDFS, computational complexity reduction can be attractive. In this letter, to avoid finite field multiplications, which are the major source of complexity, we put forward the idea of designing binary locally repairable codes (BLRCs). More specifically, we design a BLRC with a length of 15, rate of 2/3, and minimum distance of 4, which has the minimum possible locality among its type. We show that our code has lower complexity than most recent non-binary LRC in the literature while meeting other desirable requirements in HDFS such as storage overhead and reliability. In the Hadoop distributed file systems (HDFSs), to lower costly communication traffic for data recovery, the concept of locally repairable codes (LRCs) has been recently proposed. With regard to the immense size of modern energy-hungry HDFS, computational complexity reduction can be attractive. In this letter, to avoid finite field multiplications, which are the major source of complexity, we put forward the idea of designing binary locally repairable codes (BLRCs). More specifically, we design a BLRC with a length of 15, rate of 2/3, and minimum distance of 4, which has the minimum possible locality among its type. We show that our code has lower complexity than most recent non-binary LRC in the literature while meeting other desirable requirements in HDFS such as storage overhead and reliability. [PUBLICATION ABSTRACT] |
| Author | Khabbazian, Majid Shahabinejad, Mostafa Ardakani, Masoud |
| Author_xml | – sequence: 1 givenname: Mostafa surname: Shahabinejad fullname: Shahabinejad, Mostafa email: mshahabi@ualberta.ca organization: Dept. of Electr. & Comput. Eng., Univ. of Alberta, Edmonton, AB, Canada – sequence: 2 givenname: Majid surname: Khabbazian fullname: Khabbazian, Majid email: mkhabbazian@ualberta.ca organization: Dept. of Electr. & Comput. Eng., Univ. of Alberta, Edmonton, AB, Canada – sequence: 3 givenname: Masoud surname: Ardakani fullname: Ardakani, Masoud email: ardakani@ualberta.ca organization: Dept. of Electr. & Comput. Eng., Univ. of Alberta, Edmonton, AB, Canada |
| BackLink | http://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=28807861$$DView record in Pascal Francis |
| BookMark | eNp9kE9PAjEQxRuDiYB-Ab00MR4Xp-2W7R4RQUwWSfxz3nR326Rk2WJbDnx7ixAOHrzMzOH35uW9Aep1tlMI3RIYEQL5YzFdLZcjCiQdUcZompML1Ceci4TG0Ys3iDzJslxcoYH3awAQlJM-ept0eKa1qY3qAn4ynXR7XNhatu0ev6utNE5WrcJT2yisrcML2Vi7xc_GB2eqXVANnpsIfOx9UJtrdKll69XNaQ_R13z2OV0kxerldTopkppRHhJNBBeUQMZZ1hDd5JVI61opRnWVj4WsgGuejqVgnGiuATRkjECjQVeaNsCG6P74d-vs9075UK7tznXRsoypGRVplmeRejhR0sdE2smuNr7cOrOJMUsqBGRiTCJHj1ztrPdO6TNCoDz0W_72Wx76LU_9RpH4I6pNkMHYLjhp2v-ld0epUUqdvcaCMyYo-wFQ24jo |
| CODEN | ICLEF6 |
| CitedBy_id | crossref_primary_10_1155_2016_4837894 crossref_primary_10_1088_1742_6596_1549_2_022075 crossref_primary_10_1109_LCOMM_2019_2892950 crossref_primary_10_1109_TCOMM_2018_2827053 crossref_primary_10_1109_TCOMM_2017_2712186 crossref_primary_10_1109_LCOMM_2017_2697424 crossref_primary_10_1109_TMC_2016_2591537 crossref_primary_10_1007_s10623_024_01419_5 crossref_primary_10_1109_TCOMM_2016_2581163 crossref_primary_10_1016_j_jcss_2017_05_005 crossref_primary_10_1109_TCOMM_2023_3322174 crossref_primary_10_1109_ACCESS_2020_3002824 crossref_primary_10_3233_IDT_180347 crossref_primary_10_1007_s10623_017_0358_0 crossref_primary_10_1016_j_future_2017_11_015 crossref_primary_10_3390_electronics8060596 crossref_primary_10_1007_s11277_016_3234_8 crossref_primary_10_1109_ACCESS_2018_2814624 crossref_primary_10_1109_TIT_2017_2713245 crossref_primary_10_1109_TITS_2019_2950172 crossref_primary_10_1109_TCOMM_2018_2879088 crossref_primary_10_1109_TIT_2021_3052749 crossref_primary_10_1109_TCOMM_2017_2769116 crossref_primary_10_1111_coin_12642 |
| Cites_doi | 10.1137/0108018 10.1016/j.matcom.2007.09.010 10.1109/MASCOT.2008.4770564 10.1109/JPROC.2010.2096170 10.14778/2535573.2488339 |
| ContentType | Journal Article |
| Copyright | 2015 INIST-CNRS Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Aug 2014 |
| Copyright_xml | – notice: 2015 INIST-CNRS – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Aug 2014 |
| DBID | 97E RIA RIE AAYXX CITATION IQODW 7SP 8FD L7M |
| DOI | 10.1109/LCOMM.2014.2332491 |
| DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005–Present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Pascal-Francis Electronics & Communications Abstracts Technology Research Database Advanced Technologies Database with Aerospace |
| DatabaseTitle | CrossRef Technology Research Database Advanced Technologies Database with Aerospace Electronics & Communications Abstracts |
| DatabaseTitleList | Technology Research Database |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering Applied Sciences |
| EISSN | 1558-2558 |
| EndPage | 1290 |
| ExternalDocumentID | 3403192321 28807861 10_1109_LCOMM_2014_2332491 6853382 |
| Genre | orig-research |
| GroupedDBID | -~X 0R~ 29I 4.4 5GY 5VS 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFO ACIWK AENEX AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ATWAV AZLTO BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 EBS EJD HZ~ H~9 IES IFIPE IFJZH IPLJI JAVBF LAI M43 O9- OCL P2P RIA RIE RNS TN5 VH1 AAYXX CITATION AAYOK IQODW RIG 7SP 8FD L7M |
| ID | FETCH-LOGICAL-c325t-f18582107537d1fd9b84ccee32fb968ab05f546a8351f5f00f07310df0fbf2d03 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 38 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000340657000002&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1089-7798 |
| IngestDate | Mon Jun 30 10:17:07 EDT 2025 Wed Apr 02 07:37:51 EDT 2025 Tue Nov 18 20:42:38 EST 2025 Sat Nov 29 06:26:32 EST 2025 Wed Aug 27 02:48:14 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 8 |
| Keywords | locally repairable codes hadoop distributed file system Erasure coding Finite field Multiplication Coding Data recovery Minimal distance Distributed system Reliability Binary code Computational complexity |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html CC BY 4.0 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c325t-f18582107537d1fd9b84ccee32fb968ab05f546a8351f5f00f07310df0fbf2d03 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| PQID | 1553284797 |
| PQPubID | 85419 |
| PageCount | 4 |
| ParticipantIDs | pascalfrancis_primary_28807861 crossref_primary_10_1109_LCOMM_2014_2332491 crossref_citationtrail_10_1109_LCOMM_2014_2332491 ieee_primary_6853382 proquest_journals_1553284797 |
| PublicationCentury | 2000 |
| PublicationDate | 2014-08-01 |
| PublicationDateYYYYMMDD | 2014-08-01 |
| PublicationDate_xml | – month: 08 year: 2014 text: 2014-08-01 day: 01 |
| PublicationDecade | 2010 |
| PublicationPlace | New York, NY |
| PublicationPlace_xml | – name: New York, NY – name: New York |
| PublicationTitle | IEEE communications letters |
| PublicationTitleAbbrev | COML |
| PublicationYear | 2014 |
| Publisher | IEEE Institute of Electrical and Electronics Engineers The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: Institute of Electrical and Electronics Engineers – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | ford (ref4) 0 ref8 huang (ref7) 0 (ref1) 0 rashmi (ref9) 0 snell (ref11) 2006 (ref3) 0 ref6 ref10 ref5 ref2 |
| References_xml | – ident: ref5 doi: 10.1137/0108018 – ident: ref10 doi: 10.1016/j.matcom.2007.09.010 – ident: ref8 doi: 10.1109/MASCOT.2008.4770564 – ident: ref6 doi: 10.1109/JPROC.2010.2096170 – year: 2006 ident: ref11 publication-title: Introduction to Probability – start-page: 8 year: 0 ident: ref9 article-title: A solution to the network challenges of data recovery in erasure-coded distributed storage systems: A study on the facebook warehouse cluster publication-title: Proc 5th USENIX Workshop Hot Topics Storage File Syst – start-page: 15 year: 0 ident: ref7 article-title: Erasure coding in windows azure storage publication-title: Proc USENIX Conf Annu Tech Conf – year: 0 ident: ref3 – year: 0 ident: ref1 – start-page: 61 year: 0 ident: ref4 article-title: Availability in globally distributed storage systems publication-title: Proc 9th USENIX Conf Oper Syst Des Implementation – ident: ref2 doi: 10.14778/2535573.2488339 |
| SSID | ssj0008251 |
| Score | 2.3184686 |
| Snippet | In the Hadoop distributed file systems (HDFSs), to lower costly communication traffic for data recovery, the concept of locally repairable codes (LRCs) has... |
| SourceID | proquest pascalfrancis crossref ieee |
| SourceType | Aggregation Database Index Database Enrichment Source Publisher |
| StartPage | 1287 |
| SubjectTerms | Applied sciences Coding, codes Computational complexity Decoding Encoding Exact sciences and technology Information theory Information, signal and communications theory Maintenance engineering Reliability Signal and communications theory Systematics Telecommunications and information theory |
| Title | An Efficient Binary Locally Repairable Code for Hadoop Distributed File System |
| URI | https://ieeexplore.ieee.org/document/6853382 https://www.proquest.com/docview/1553284797 |
| Volume | 18 |
| WOSCitedRecordID | wos000340657000002&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 1558-2558 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0008251 issn: 1089-7798 databaseCode: RIE dateStart: 19970101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LS8NAEF60eNCDryrWR9mDN43dZPPYPWpt8VCrB4XeQpLdgYI00lbBf-_MJg2KIngLZCcJMzvzzWTnwdi5khBav0g80AYDFJvnntZB4WmbSQFG5QJCN2wiGY_VZKIf19hlUwtjrXXJZ_aKLt1ZvimLN_pV1osRW6RCg7ueJHFVq9VYXSrBrJLpNXqMWq0KZITujfoP9_eUxRVeBRIdCO1_AyE3VYVyIrMFsgWqeRY_TLPDm-HO_750l23XfiW_rjbCHluzs3229aXbYJuNr2d84DpGIC2_cYW4fERY9vLB0RHPpnOqo-L90liOvixHq1SWr_yWeuvSWCxr-BCNCK-6nB-w5-HgqX_n1eMUvEIG0dIDhGaFER4GKInxwehchQVipAwg17HKchFBFMYZ-mQ-RCAEoPr7woCAHAIj5CFrzcqZPWLcxBDZOKRDVghjazHIypJEoj7nEhXa7zB_xd-0qHuN08iLl9TFHEKnTiYpySStZdJhFw3Na9Vp48_VbeJ6s7JmeId1v4mxuR8oaqwfI93pSq5pra2LlGYnEUzr5Pj3x56wTXp5lfh3ylrL-Zs9YxvF-3K6mHfdRvwE_fvZXQ |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3fS9xAEB7EFrQPta1KT63uQ99qdJPdJLuP9uph8e7aBwXfQpLdAUEucncW-t87s8kFpSL0LZDdsMzszo_szPcBfDUKtY_rPELrKEHxVRVZm9SR9aWS6EwlUQeyiXw6NTc39vcaHPe9MN77UHzmT_gx3OW7pn7gX2WnGfkWZcjgvkm1TmTbrdXbXW7CbMvpLcWM1qxaZKQ9HQ9_TSZcx6VPEkUhhI2fuaHAq8JVkeWCBIMto8U_xjl4nNHW_631A7zvIktx1m6Fj7DmZ5_g3RO8wW2Yns3EecCMoLnie2jFFWP2Znd_BYXi5e2cO6nEsHFeUDQryC41zb34wei6TIzlnRiRGREtzvkOXI_Or4YXUUeoENUqSZcRknM2lONRipK7GJ2tjK7JS6oEK5uZspIppjorKSqLMUUpkQxALB1KrDBxUu3C-qyZ-c8gXIapzzRfs6LOvKc0q8xzRSe6UnSk4wHEK_kWdYc2zqQXd0XIOqQtgk4K1knR6WQA3_o59y3Wxqujt1nq_chO4AM4fKbG_n1iGFo_o3kHK70W3XldFMyexI7a5nsvf_YINi6uJuNi_HN6uQ-bvJC2DPAA1pfzB_8F3tZ_lreL-WHYlI92Ktyk |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+Efficient+Binary+Locally+Repairable+Code+for+Hadoop+Distributed+File+System&rft.jtitle=IEEE+communications+letters&rft.au=Shahabinejad%2C+Mostafa&rft.au=Khabbazian%2C+Majid&rft.au=Ardakani%2C+Masoud&rft.date=2014-08-01&rft.issn=1089-7798&rft.volume=18&rft.issue=8&rft.spage=1287&rft.epage=1290&rft_id=info:doi/10.1109%2FLCOMM.2014.2332491&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_LCOMM_2014_2332491 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1089-7798&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1089-7798&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1089-7798&client=summon |