Storage vs repair bandwidth for network erasure coding in distributed storage systems

Network coding is used in peer-to-peer storage systems, archival storage, wireless networks, satellite communication, video conferencing etc. Storage system stores data at different locations. For the data to be available, durable and reliable, it must be able to recover from failures efficiently. D...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2015 International Conference on Soft Computing Techniques and Implementations (ICSCTI) s. 27 - 32
Hlavní autoři: Singal, Swati Mittal, Rakesh, Nitin, Matam, Rakesh
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 01.10.2015
Témata:
Artificial neural networks
Distributed Storage System
Erasure Codes
Hybrid codes
Maintenance engineering
Regenerating codes
Reliability
Replication
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Abstract Network coding is used in peer-to-peer storage systems, archival storage, wireless networks, satellite communication, video conferencing etc. Storage system stores data at different locations. For the data to be available, durable and reliable, it must be able to recover from failures efficiently. Different approaches applied for recovery in storage systems are examined and evaluated in this paper. Keeping replicas of the data at multiple places is traditional technique used by major storage systems. To reduce the amount of storage required by replication the distributed system is now transitioning towards, the erasure codes. Several approaches like the hybrid and regenerating codes provide solution to storage and repair bandwidth. But still improvement in terms of communication cost in the face of failures is required. The approaches and main application areas of these approaches are examined and analyzed in this paper. A comparative analysis based on storage requirement, disk access, repair bandwidth and unavailability probability is also presented.
AbstractList Network coding is used in peer-to-peer storage systems, archival storage, wireless networks, satellite communication, video conferencing etc. Storage system stores data at different locations. For the data to be available, durable and reliable, it must be able to recover from failures efficiently. Different approaches applied for recovery in storage systems are examined and evaluated in this paper. Keeping replicas of the data at multiple places is traditional technique used by major storage systems. To reduce the amount of storage required by replication the distributed system is now transitioning towards, the erasure codes. Several approaches like the hybrid and regenerating codes provide solution to storage and repair bandwidth. But still improvement in terms of communication cost in the face of failures is required. The approaches and main application areas of these approaches are examined and analyzed in this paper. A comparative analysis based on storage requirement, disk access, repair bandwidth and unavailability probability is also presented.
Author Singal, Swati Mittal
Matam, Rakesh
Rakesh, Nitin
Author_xml – sequence: 1
  givenname: Swati Mittal
  surname: Singal
  fullname: Singal, Swati Mittal
  email: ssingal@amity.edu
  organization: Dept. of Comput. Sci. & Eng., Amity Univ., Noida, India
– sequence: 2
  givenname: Nitin
  surname: Rakesh
  fullname: Rakesh, Nitin
  email: nrakesh@amity.edu
  organization: Dept. of Comput. Sci. & Eng., Amity Univ., Noida, India
– sequence: 3
  givenname: Rakesh
  surname: Matam
  fullname: Matam, Rakesh
  email: rakesh@iiitg.ac.in
  organization: Dept. of Comput. Sci. & Eng., Indian Inst. of Inf. Technol., Guwahati, India
BookMark eNotz7tuwjAYQGFXaoeW8gQsfoGkvsWXsYp6iYTEAMzIjn9Tq8VBtini7Ts009k-6Tyh-zQlQGhFSUspMS9Dv-13Q8sI7VoltOmMukNLozQVUnGpDDOPaL-tU7ZHwL8FZzjbmLGzyV-jr184TBknqNcpf2PItlwy4HHyMR1xTNjHUnN0lwoel1kpt1LhVJ7RQ7A_BZZzF2j__rbrP5v15mPoX9dNpIzXhhENnnNpiRxHB7TTxGuvgFmlAw8ebEcFk9IF4cbQCe6V8TRw5XRgoC1foNW_GwHgcM7xZPPtMM_yP5UjUMw
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/ICSCTI.2015.7489597
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9781467367929
9781467367905
1467367907
1467367923
EndPage 32
ExternalDocumentID 7489597
Genre orig-research
GroupedDBID 6IE
6IL
CBEJK
RIE
RIL
ID FETCH-LOGICAL-i123t-208ed336a06ccbe1580d8d7e2a78f3fdea514266bf4bcf543d79d1f37b8f2e8a3
IEDL.DBID RIE
IngestDate Thu Jun 29 18:36:44 EDT 2023
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i123t-208ed336a06ccbe1580d8d7e2a78f3fdea514266bf4bcf543d79d1f37b8f2e8a3
PageCount 6
ParticipantIDs ieee_primary_7489597
PublicationCentury 2000
PublicationDate 20151001
PublicationDateYYYYMMDD 2015-10-01
PublicationDate_xml – month: 10
  year: 2015
  text: 20151001
  day: 01
PublicationDecade 2010
PublicationTitle 2015 International Conference on Soft Computing Techniques and Implementations (ICSCTI)
PublicationTitleAbbrev ICSCTI
PublicationYear 2015
Publisher IEEE
Publisher_xml – name: IEEE
Score 1.596944
Snippet Network coding is used in peer-to-peer storage systems, archival storage, wireless networks, satellite communication, video conferencing etc. Storage system...
SourceID ieee
SourceType Publisher
StartPage 27
SubjectTerms Artificial neural networks
Distributed Storage System
Erasure Codes
Hybrid codes
Maintenance engineering
Regenerating codes
Reliability
Replication
Title Storage vs repair bandwidth for network erasure coding in distributed storage systems
URI https://ieeexplore.ieee.org/document/7489597
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3Pa8IwFH6o7LDTNnTsNznsuGpr0iY9y2TCEEEd3iQ_XlgvdbRV__0lbXEMdtktJG0CLy3fl5f3vgfwLDXl0jHPIOI4DhhTLJCxxgCNoNYNGlbnVn288_lcbDbpogMvp1wYRKyDz3Dom_VdvtnpvXeVjbxSiiPAXehynjS5Wq2QUBSmo9lkOVnNfLRWPGyf_FUypUaM6cX_1rqEwU_qHVmcQOUKOpj3Yb10J2P345NDSQqHH1lBlMzNMTPVJ3Gsk-RNMDfBovb4Eb3zb5MsJ8YL4_qaVmhI2c7SqDeXA1hPX1eTt6CthxBkDl8q90ELNJQmMky0VhjFIjTCOBtLLiy1BqVjPw5wlWVK25hRw1MTWcqVsGMUkl5DL9_leAOE2xBjFCr1fp9UcJVQZoXljtzY1HJ5C31vku1XI3mxba1x93f3PZx7qzcxbg_Qq4o9PsKZPlRZWTzV-_QN9c2ZEA
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PT8IwFH5BNNGTGjD-tgePDgbtaHcmGohISADDjfTHa9xlmG3gv2-7LRgTL96adV2T1zXf19f3vgfwKDXl0jHPoMexHzCmWCAjjQEaQa3rNKzMrXqf8OlUrFbxrAFP-1wYRCyDz7Djm-VdvtnorXeVdb1SiiPAB3AYMdYPq2ytWkqoF8bd8XA-XIx9vFbUqd_9VTSlxIyX0__Ndgbtn-Q7MtvDyjk0MG3Bcu7Oxm7rk11OMocgSUaUTM1XYooP4ngnSatwboJZ6fMjeuNHkyQlxkvj-qpWaEhef6XSb87bsHx5XgxHQV0RIUgcwhTulxZoKB3IcKC1wl4kQiOMs7LkwlJrUDr-4yBXWaa0jRg1PDY9S7kSto9C0gtoppsUL4FwG2KEQsXe8xMLrgaUWWG5ozc2tlxeQcubZP1ZiV6sa2tc__34AY5Hi7fJejKevt7AiV-BKuLtFppFtsU7ONK7Ismz-3LNvgEYUJxX
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2015+International+Conference+on+Soft+Computing+Techniques+and+Implementations+%28ICSCTI%29&rft.atitle=Storage+vs+repair+bandwidth+for+network+erasure+coding+in+distributed+storage+systems&rft.au=Singal%2C+Swati+Mittal&rft.au=Rakesh%2C+Nitin&rft.au=Matam%2C+Rakesh&rft.date=2015-10-01&rft.pub=IEEE&rft.spage=27&rft.epage=32&rft_id=info:doi/10.1109%2FICSCTI.2015.7489597&rft.externalDocID=7489597