In EDS ansehen

Distributed Metadata Management Scheme in HDFS

Gespeichert in:
Bibliographische Detailangaben
Titel: Distributed Metadata Management Scheme in HDFS
Autoren: Mrudula Varade, Vimla Jethani
Weitere Verfasser: The Pennsylvania State University CiteSeerX Archives
Quelle: http://www.ijsrp.org/research-paper-0513/ijsrp-p1770.pdf.
Bestand: CiteSeerX
Schlagwörter: Index Terms- Hadoop, HDFS, Distributed File System, Metadata Management, File Management System. W
Beschreibung: designed to store very large data sets reliably and to stream those data sets at high bandwidth to user applications. Metadata management is critical to distributed file system. In HDFS architecture, a single master server manages all metadata, while a number of data servers store file data. This architecture can’t meet the exponentially increased storage demand in cloud computing, as the single master server may become a performance bottleneck. Comparative study of a metadata management scheme is done. There is three of techniques sub-tree partitioning, hashing and consistent hashing of metadata management scheme. Out of these three schemes consistent hashing is the best techniques which employs multiple NameNodes, and divides the metadata into “buckets ” which can be dynamically migrated among NameNodes according to system workloads. To maintain reliability, metadata is replicated in different NameNodes with log replication technology, and Paxos algorithm is adopted to keep replication consistency.
Publikationsart: text
Dateibeschreibung: application/pdf
Sprache: English
Relation: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.414.7349
Verfügbarkeit: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.414.7349
http://www.ijsrp.org/research-paper-0513/ijsrp-p1770.pdf
Rights: Metadata may be used without restrictions as long as the oai identifier remains attached to it.
Dokumentencode: edsbas.94C954FE
Datenbank: BASE
FullText Text:
  Availability: 0
CustomLinks:
  – Url: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.414.7349#
    Name: EDS - BASE (s4221598)
    Category: fullText
    Text: View record from BASE
  – Url: https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=EBSCO&SrcAuth=EBSCO&DestApp=WOS&ServiceName=TransferToWoS&DestLinkType=GeneralSearchSummary&Func=Links&author=Varade%20M
    Name: ISI
    Category: fullText
    Text: Nájsť tento článok vo Web of Science
    Icon: https://imagesrvr.epnet.com/ls/20docs.gif
    MouseOverText: Nájsť tento článok vo Web of Science
Header DbId: edsbas
DbLabel: BASE
An: edsbas.94C954FE
RelevancyScore: 750
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 750
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Distributed Metadata Management Scheme in HDFS
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Mrudula+Varade%22">Mrudula Varade</searchLink><br /><searchLink fieldCode="AR" term="%22Vimla+Jethani%22">Vimla Jethani</searchLink>
– Name: Author
  Label: Contributors
  Group: Au
  Data: The Pennsylvania State University CiteSeerX Archives
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <i>http://www.ijsrp.org/research-paper-0513/ijsrp-p1770.pdf</i>.
– Name: Subset
  Label: Collection
  Group: HoldingsInfo
  Data: CiteSeerX
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Index+Terms-+Hadoop%22">Index Terms- Hadoop</searchLink><br /><searchLink fieldCode="DE" term="%22HDFS%22">HDFS</searchLink><br /><searchLink fieldCode="DE" term="%22Distributed+File+System%22">Distributed File System</searchLink><br /><searchLink fieldCode="DE" term="%22Metadata+Management%22">Metadata Management</searchLink><br /><searchLink fieldCode="DE" term="%22File+Management+System%2E+W%22">File Management System. W</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: designed to store very large data sets reliably and to stream those data sets at high bandwidth to user applications. Metadata management is critical to distributed file system. In HDFS architecture, a single master server manages all metadata, while a number of data servers store file data. This architecture can’t meet the exponentially increased storage demand in cloud computing, as the single master server may become a performance bottleneck. Comparative study of a metadata management scheme is done. There is three of techniques sub-tree partitioning, hashing and consistent hashing of metadata management scheme. Out of these three schemes consistent hashing is the best techniques which employs multiple NameNodes, and divides the metadata into “buckets ” which can be dynamically migrated among NameNodes according to system workloads. To maintain reliability, metadata is replicated in different NameNodes with log replication technology, and Paxos algorithm is adopted to keep replication consistency.
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: text
– Name: Format
  Label: File Description
  Group: SrcInfo
  Data: application/pdf
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: NoteTitleSource
  Label: Relation
  Group: SrcInfo
  Data: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.414.7349
– Name: URL
  Label: Availability
  Group: URL
  Data: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.414.7349<br />http://www.ijsrp.org/research-paper-0513/ijsrp-p1770.pdf
– Name: Copyright
  Label: Rights
  Group: Cpyrght
  Data: Metadata may be used without restrictions as long as the oai identifier remains attached to it.
– Name: AN
  Label: Accession Number
  Group: ID
  Data: edsbas.94C954FE
PLink https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.94C954FE
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    Subjects:
      – SubjectFull: Index Terms- Hadoop
        Type: general
      – SubjectFull: HDFS
        Type: general
      – SubjectFull: Distributed File System
        Type: general
      – SubjectFull: Metadata Management
        Type: general
      – SubjectFull: File Management System. W
        Type: general
    Titles:
      – TitleFull: Distributed Metadata Management Scheme in HDFS
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Mrudula Varade
      – PersonEntity:
          Name:
            NameFull: Vimla Jethani
      – PersonEntity:
          Name:
            NameFull: The Pennsylvania State University CiteSeerX Archives
    IsPartOfRelationships:
      – BibEntity:
          Identifiers:
            – Type: issn-locals
              Value: edsbas
            – Type: issn-locals
              Value: edsbas.oa
          Titles:
            – TitleFull: http://www.ijsrp.org/research-paper-0513/ijsrp-p1770.pdf
              Type: main
ResultId 1