Mochi: Composing Data Services for High-Performance Computing Environments

Technology enhancements and the growing breadth of application workflows running on high-performance computing (HPC) platforms drive the development of new data services that provide high performance on these new platforms, provide capable and productive interfaces and abstractions for a variety of...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Journal of computer science and technology Ročník 35; číslo 1; s. 121 - 144
Hlavní autoři: Ross, Robert B., Amvrosiadis, George, Carns, Philip, Cranor, Charles D., Dorier, Matthieu, Harms, Kevin, Ganger, Greg, Gibson, Garth, Gutierrez, Samuel K., Latham, Robert, Robey, Bob, Robinson, Dana, Settlemyer, Bradley, Shipman, Galen, Snyder, Shane, Soumagne, Jerome, Zheng, Qing
Médium: Journal Article
Jazyk:angličtina
Vydáno: New York Springer US 01.01.2020
Springer
Springer Nature B.V
Argonne National Laboratory, Lemont, IL 60439, U.S.A.%Parallel Data Laboratory, Carnegie Mellon University, Pittsburgh, PA 15213, U.S.A.%Vector Institute for Artificial Intelligence, Toronto, Ontario, Canada%Los Alamos National Laboratory, Los Alamos NM, U.S.A.%The HDF Group, Champaign IL, U.S.A
Springer Nature
Témata:
Analysis
Artificial Intelligence
Computation
Computational linguistics
Computer Science
Data Structures and Information Theory
data-intensive computing
distributed services
High performance computing
Information storage and retrieval
Information Systems Applications (incl.Internet)
Language processing
MATHEMATICS AND COMPUTING
Natural language interfaces
New technology
Performance evaluation
Regular Paper
Software Engineering
storage and I/O
Theory of Computation
data-intensive computing
storage and I/O
high-performance computing
distributed services
ISSN:1000-9000, 1860-4749
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Technology enhancements and the growing breadth of application workflows running on high-performance computing (HPC) platforms drive the development of new data services that provide high performance on these new platforms, provide capable and productive interfaces and abstractions for a variety of applications, and are readily adapted when new technologies are deployed. The Mochi framework enables composition of specialized distributed data services from a collection of connectable modules and subservices. Rather than forcing all applications to use a one-size-fits-all data staging and I/O software configuration, Mochi allows each application to use a data service specialized to its needs and access patterns. This paper introduces the Mochi framework and methodology. The Mochi core components and microservices are described. Examples of the application of the Mochi methodology to the development of four specialized services are detailed. Finally, a performance evaluation of a Mochi core component, a Mochi microservice, and a composed service providing an object model is performed. The paper concludes by positioning Mochi relative to related work in the HPC space and indicating directions for future work.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
AC02-06CH11357; AC02-05CH11231
USDOE National Nuclear Security Administration (NNSA)
ISSN:1000-9000
1860-4749
DOI:10.1007/s11390-020-9802-0