Modeling and Simulating Multiple Failure Masking Enabled by Local Recovery for Stencil-Based Applications at Extreme Scales

Obtaining multi-process hard failure resilience at the application level is a key challenge that must be overcome before the promise of exascale can be fully realized. Previous work has shown that online global recovery can dramatically reduce the overhead of failures when compared to the more tradi...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on parallel and distributed systems Vol. 28; no. 10; pp. 2881 - 2895
Main Authors: Gamell, Marc, Teranishi, Keita, Mayo, Jackson, Kolla, Hemanth, Heroux, Michael A., Chen, Jacqueline, Parashar, Manish
Format: Journal Article
Language:English
Published: New York IEEE 01.10.2017
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Computational modeling
Computer simulation
Delays
Failure
Failure analysis
failure masking
Failure rates
Fault tolerance
Fault tolerant systems
Hardware
Masking
MATHEMATICS AND COMPUTING
modeling
Parallel processing
Protocols
Recovery
Resilience
Restarting
stencil computation
ISSN:1045-9219, 1558-2183
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Obtaining multi-process hard failure resilience at the application level is a key challenge that must be overcome before the promise of exascale can be fully realized. Previous work has shown that online global recovery can dramatically reduce the overhead of failures when compared to the more traditional approach of terminating the job and restarting it from the last stored checkpoint. If online recovery is performed in a local manner further scalability is enabled, not only due to the intrinsic lower costs of recovering locally, but also due to derived effects when using some application types. In this paper we model one such effect, namely multiple failure masking, that manifests when running Stencil parallel computations on an environment when failures are recovered locally. First, the delay propagation shape of one or multiple failures recovered locally is modeled to enable several analyses of the probability of different levels of failure masking under certain Stencil application behaviors. Our results indicate that failure masking is an extremely desirable effect at scale which manifestation is more evident and beneficial as the machine size or the failure rate increase.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
National Science Foundation (NSF)
SAND-2017-4099J
USDOE National Nuclear Security Administration (NNSA)
AC04-94AL85000; FG02-06ER54857; SC0007455
ISSN:1045-9219
1558-2183
DOI:10.1109/TPDS.2017.2696538