Optimization of checkpointing-related I/O for high-performance parallel and distributed computing

Checkpointing, the process of saving program/application state, usually to a stable storage, has been the most common fault-tolerance methodology for high-performance applications. The rate of checkpointing (how often) is primarily driven by the failure rate of the system. If the checkpointing rate...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:The Journal of supercomputing Ročník 46; číslo 2; s. 150 - 180
Hlavní autoři: Subramaniyan, Rajagopal, Grobelny, Eric, Studham, Scott, George, Alan D.
Médium: Journal Article
Jazyk:angličtina
Vydáno: Boston Springer US 01.11.2008
Témata:
Checkpointing
Compilers
Computer Science
Consumption
Failure rates
Fault tolerance
GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE
Interpreters
Mathematical analysis
OPTIMIZATION
PARALLEL PROCESSING
Processor Architectures
Programming Languages
SIMULATION
SPECIFICATIONS
STORAGE
Strikes
SUPERCOMPUTERS
TOLERANCE
Checkpointing
Fault tolerance
Supercomputing
Parallel computing
High-performance computing
Technology growth
Modeling
Distributed computing
ISSN:0920-8542, 1573-0484
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Checkpointing, the process of saving program/application state, usually to a stable storage, has been the most common fault-tolerance methodology for high-performance applications. The rate of checkpointing (how often) is primarily driven by the failure rate of the system. If the checkpointing rate is low, fewer resources are consumed but the chance of high computational loss is increased and vice versa if the checkpointing rate is high. It is important to strike a balance, and an optimum rate of checkpointing is required. In this paper, we analytically model the process of checkpointing in terms of mean-time-between-failure of the system, amount of memory being checkpointed, sustainable I/O bandwidth to the stable storage, and frequency of checkpointing. We identify the optimum frequency of checkpointing to be used on systems with given specifications thereby making way for efficient use of available resources and maximum performance of the system without compromising on the fault-tolerance aspects. Further, we develop discrete-event models simulating the checkpointing process to verify the analytical model for optimum checkpointing. Using the analytical model, we also investigate the optimum rate of checkpointing for systems of varying resource levels ranging from small embedded cluster systems to large supercomputers.
Bibliografie:ObjectType-Article-2
SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 23
USDOE
DE-AC05-00OR22725
ISSN:0920-8542
1573-0484
DOI:10.1007/s11227-007-0162-0