Storage vs repair bandwidth for network erasure coding in distributed storage systems

Network coding is used in peer-to-peer storage systems, archival storage, wireless networks, satellite communication, video conferencing etc. Storage system stores data at different locations. For the data to be available, durable and reliable, it must be able to recover from failures efficiently. D...

Full description

Saved in:
Bibliographic Details
Published in:2015 International Conference on Soft Computing Techniques and Implementations (ICSCTI) pp. 27 - 32
Main Authors: Singal, Swati Mittal, Rakesh, Nitin, Matam, Rakesh
Format: Conference Proceeding
Language:English
Published: IEEE 01.10.2015
Subjects:
Artificial neural networks
Distributed Storage System
Erasure Codes
Hybrid codes
Maintenance engineering
Regenerating codes
Reliability
Replication
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Network coding is used in peer-to-peer storage systems, archival storage, wireless networks, satellite communication, video conferencing etc. Storage system stores data at different locations. For the data to be available, durable and reliable, it must be able to recover from failures efficiently. Different approaches applied for recovery in storage systems are examined and evaluated in this paper. Keeping replicas of the data at multiple places is traditional technique used by major storage systems. To reduce the amount of storage required by replication the distributed system is now transitioning towards, the erasure codes. Several approaches like the hybrid and regenerating codes provide solution to storage and repair bandwidth. But still improvement in terms of communication cost in the face of failures is required. The approaches and main application areas of these approaches are examined and analyzed in this paper. A comparative analysis based on storage requirement, disk access, repair bandwidth and unavailability probability is also presented.
AbstractList Network coding is used in peer-to-peer storage systems, archival storage, wireless networks, satellite communication, video conferencing etc. Storage system stores data at different locations. For the data to be available, durable and reliable, it must be able to recover from failures efficiently. Different approaches applied for recovery in storage systems are examined and evaluated in this paper. Keeping replicas of the data at multiple places is traditional technique used by major storage systems. To reduce the amount of storage required by replication the distributed system is now transitioning towards, the erasure codes. Several approaches like the hybrid and regenerating codes provide solution to storage and repair bandwidth. But still improvement in terms of communication cost in the face of failures is required. The approaches and main application areas of these approaches are examined and analyzed in this paper. A comparative analysis based on storage requirement, disk access, repair bandwidth and unavailability probability is also presented.
Author Singal, Swati Mittal
Matam, Rakesh
Rakesh, Nitin
Author_xml – sequence: 1
  givenname: Swati Mittal
  surname: Singal
  fullname: Singal, Swati Mittal
  email: ssingal@amity.edu
  organization: Dept. of Comput. Sci. & Eng., Amity Univ., Noida, India
– sequence: 2
  givenname: Nitin
  surname: Rakesh
  fullname: Rakesh, Nitin
  email: nrakesh@amity.edu
  organization: Dept. of Comput. Sci. & Eng., Amity Univ., Noida, India
– sequence: 3
  givenname: Rakesh
  surname: Matam
  fullname: Matam, Rakesh
  email: rakesh@iiitg.ac.in
  organization: Dept. of Comput. Sci. & Eng., Indian Inst. of Inf. Technol., Guwahati, India
BookMark eNotz7tuwjAYQGFXaoeW8gQsfoGkvsWXsYp6iYTEAMzIjn9Tq8VBtini7Ts009k-6Tyh-zQlQGhFSUspMS9Dv-13Q8sI7VoltOmMukNLozQVUnGpDDOPaL-tU7ZHwL8FZzjbmLGzyV-jr184TBknqNcpf2PItlwy4HHyMR1xTNjHUnN0lwoel1kpt1LhVJ7RQ7A_BZZzF2j__rbrP5v15mPoX9dNpIzXhhENnnNpiRxHB7TTxGuvgFmlAw8ebEcFk9IF4cbQCe6V8TRw5XRgoC1foNW_GwHgcM7xZPPtMM_yP5UjUMw
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/ICSCTI.2015.7489597
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9781467367929
9781467367905
1467367907
1467367923
EndPage 32
ExternalDocumentID 7489597
Genre orig-research
GroupedDBID 6IE
6IL
CBEJK
RIE
RIL
ID FETCH-LOGICAL-i123t-208ed336a06ccbe1580d8d7e2a78f3fdea514266bf4bcf543d79d1f37b8f2e8a3
IEDL.DBID RIE
IngestDate Thu Jun 29 18:36:44 EDT 2023
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i123t-208ed336a06ccbe1580d8d7e2a78f3fdea514266bf4bcf543d79d1f37b8f2e8a3
PageCount 6
ParticipantIDs ieee_primary_7489597
PublicationCentury 2000
PublicationDate 20151001
PublicationDateYYYYMMDD 2015-10-01
PublicationDate_xml – month: 10
  year: 2015
  text: 20151001
  day: 01
PublicationDecade 2010
PublicationTitle 2015 International Conference on Soft Computing Techniques and Implementations (ICSCTI)
PublicationTitleAbbrev ICSCTI
PublicationYear 2015
Publisher IEEE
Publisher_xml – name: IEEE
Score 1.5970263
Snippet Network coding is used in peer-to-peer storage systems, archival storage, wireless networks, satellite communication, video conferencing etc. Storage system...
SourceID ieee
SourceType Publisher
StartPage 27
SubjectTerms Artificial neural networks
Distributed Storage System
Erasure Codes
Hybrid codes
Maintenance engineering
Regenerating codes
Reliability
Replication
Title Storage vs repair bandwidth for network erasure coding in distributed storage systems
URI https://ieeexplore.ieee.org/document/7489597
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV09a8MwED2S0KFTW5LSbzR0rBPbki15Dg3NEgJJIFvQx4l6cYrtJH-_km1SCl262cay4WTxnk_v3gG8Zql1tNzaQNJEBUxTHshIu9NEJzJDB8DUNM0m-GIhttts2YO3cy0MIjbiMxz7w2Yv3-z1wafKJt4pxRHgPvQ5T9tarc5IKAqzyXy6mq7nXq2VjLs7f7VMaRBjdvW_d13D6Kf0jizPoHIDPSyGsFm5P2O38MmxIqXDj7wkShbmlJv6kzjWSYpWzE2wbDJ-RO_9aJIXxHhjXN_TCg2puqe07s3VCDaz9_X0I-j6IQS5w5fafdACDaWpDFOtFUaJCI0wHGPJhaXWoHTsxwGuskxpmzBqeGYiS7kSNkYh6S0Min2Bd0DikFsWK02NZIw6lhhZYZGlTEQUZcTuYehDsvtqLS92XTQe_r78CJc-6q3G7QkGdXnAZ7jQxzqvypdmnr4BAMWY6g
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NS8MwFH_MKehJZRO_zcGj3dombdPzcKw4x2Ab7DbS5AV76aTt5r9v0paJ4MVbEvIB-eD3S_Le7wE8x6E2tFxrR9AgdZikkSM8abKBDESMBoCpqoNNRLMZX6_jeQdeDr4wiFgbn-HAJuu_fLWVO_tUNrRKKYYAH8FxwJjvNt5arZSQ58bDZLQYLRNrrxUM2rq_gqbUmDE-_99oF9D_cb4j8wOsXEIH8x6sFuZubI4-2ZekMAiSFSQVufrKVPVBDO8keWPOTbCo3_yI3NrWJMuJstK4NqoVKlK2vTT6zWUfVuPX5WjitBERnMwgTGW2NEdFaSjcUMoUvYC7iqsIfRFxTbVCYfiPgdxUs1TqgFEVxcrTNEq59pELegXdfJvjNRDfjTTzU0mVYIwanuhprpGFjHsUhcduoGenZPPZiF5s2tm4_bv4CU4ny_fpZprM3u7gzK5AY_F2D92q2OEDnMh9lZXFY71m3yGLnDE
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2015+International+Conference+on+Soft+Computing+Techniques+and+Implementations+%28ICSCTI%29&rft.atitle=Storage+vs+repair+bandwidth+for+network+erasure+coding+in+distributed+storage+systems&rft.au=Singal%2C+Swati+Mittal&rft.au=Rakesh%2C+Nitin&rft.au=Matam%2C+Rakesh&rft.date=2015-10-01&rft.pub=IEEE&rft.spage=27&rft.epage=32&rft_id=info:doi/10.1109%2FICSCTI.2015.7489597&rft.externalDocID=7489597