Fault-Tolerant Protocol for Hybrid Task-Parallel Message-Passing Applications

We present a fault-tolerant protocol for task-parallel message-passing applications to mitigate transient errors. The protocol requires the restart only of the task that experienced the error and transparently handles any MPI calls inside the task. The protocol is implemented in Nanos -- a dataflow...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Proceedings / IEEE International Conference on Cluster Computing s. 563 - 570
Hlavní autoři: Martsinkevich, Tatiana, Subasi, Omer, Unsal, Osman, Cappello, Franck, Labarta, Jesus
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 01.09.2015
Témata:
Checkpointing
dataflow model
Fault tolerance
Fault tolerant systems
high performance computing
message logging
Message systems
Protocols
Runtime
task-based programming model
Transient analysis
ISSN:1552-5244
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:We present a fault-tolerant protocol for task-parallel message-passing applications to mitigate transient errors. The protocol requires the restart only of the task that experienced the error and transparently handles any MPI calls inside the task. The protocol is implemented in Nanos -- a dataflow runtime for task-based OmpSs programming model -- and the PMPI profiling layer to fully support hybrid OmpSs+MPI applications. In our experiments we demonstrate that our fault-tolerant solution has a reasonable overhead, with a maximum observed overhead of 4.5%. We also show that fine-grained parallelization is important for hiding the overheads related to the protocol as well as the recovery of tasks.
ISSN:1552-5244
DOI:10.1109/CLUSTER.2015.104