Petascale high order dynamic rupture earthquake simulations on heterogeneous supercomputers

We present an end-to-end optimization of the innovative Arbitrary high-order DERivative Discontinuous Galerkin (ADER-DG) software SeisSol targeting Intel® Xeon Phi™ coprocessor platforms, achieving unprecedented earthquake model complexity through coupled simulation of full frictional sliding and se...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis pp. 3 - 14
Main Authors: Heinecke, Alexander, Breuer, Alexander, Rettenberger, Sebastian, Bader, Michael, Gabriel, Alice-Agnes, Pelties, Christian, Bode, Arndt, Barth, William, Liao, Xiang-Ke, Vaidyanathan, Karthikeyan, Smelyanskiy, Mikhail, Dubey, Pradeep
Format: Conference Proceeding
Language:English
Published: Piscataway, NJ, USA IEEE Press 01.11.2014
IEEE
Series:ACM Conferences
Subjects:
ISBN:1479955000, 9781479955008
ISSN:2167-4329
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract We present an end-to-end optimization of the innovative Arbitrary high-order DERivative Discontinuous Galerkin (ADER-DG) software SeisSol targeting Intel® Xeon Phi™ coprocessor platforms, achieving unprecedented earthquake model complexity through coupled simulation of full frictional sliding and seismic wave propagation. SeisSol exploits unstructured meshes to flexibly adapt for complicated geometries in realistic geological models. Seismic wave propagation is solved simultaneously with earthquake faulting in a multiphysical manner leading to a heterogeneous solver structure. Our architecture-aware optimizations deliver up to 50% of peak performance, and introduce an efficient compute--communication overlapping scheme shadowing the multiphysics computations. SeisSol delivers near-optimal weak scaling, reaching 8.6 DP-PFLOPS on 8,192 nodes of the Tianhe-2 supercomputer. Our performance model projects reaching 18--20 DP-PFLOPS on the full Tianhe-2 machine. Of special relevance to modern civil engineering needs, our pioneering simulation of the 1992 Landers earthquake shows highly detailed rupture evolution and ground motion at frequencies up to 10 Hz.
AbstractList We present an end-to-end optimization of the innovative Arbitrary high-order DERivative Discontinuous Galerkin (ADER-DG) software SeisSol targeting Intel® Xeon Phi™ coprocessor platforms, achieving unprecedented earthquake model complexity through coupled simulation of full frictional sliding and seismic wave propagation. SeisSol exploits unstructured meshes to flexibly adapt for complicated geometries in realistic geological models. Seismic wave propagation is solved simultaneously with earthquake faulting in a multiphysical manner leading to a heterogeneous solver structure. Our architecture-aware optimizations deliver up to 50% of peak performance, and introduce an efficient compute--communication overlapping scheme shadowing the multiphysics computations. SeisSol delivers near-optimal weak scaling, reaching 8.6 DP-PFLOPS on 8,192 nodes of the Tianhe-2 supercomputer. Our performance model projects reaching 18--20 DP-PFLOPS on the full Tianhe-2 machine. Of special relevance to modern civil engineering needs, our pioneering simulation of the 1992 Landers earthquake shows highly detailed rupture evolution and ground motion at frequencies up to 10 Hz.
We present an end-to-end optimization of the innovative Arbitrary high-order DERivative Discontinuous Galerkin (ADER-DG) software SeisSol targeting Intel® Xeon Phi coprocessor platforms, achieving unprecedented earthquake model complexity through coupled simulation of full frictional sliding and seismic wave propagation. SeisSol exploits unstructured meshes to flexibly adapt for complicated geometries in realistic geological models. Seismic wave propagation is solved simultaneously with earthquake faulting in a multiphysical manner leading to a heterogeneous solver structure. Our architecture aware optimizations deliver up to 50% of peak performance, and introduce an efficient compute-communication overlapping scheme shadowing the multiphysics computations. SeisSol delivers near-optimal weak scaling, reaching 8.6 DP-PFLOPS on 8,192 nodes of the Tianhe-2 supercomputer. Our performance model projects reaching 18 -- 20 DP-PFLOPS on the full Tianhe-2 machine. Of special relevance to modern civil engineering needs, our pioneering simulation of the 1992 Landers earthquake shows highly detailed rupture evolution and ground motion at frequencies up to 10 Hz.
Author Bader, Michael
Rettenberger, Sebastian
Dubey, Pradeep
Barth, William
Liao, Xiang-Ke
Breuer, Alexander
Gabriel, Alice-Agnes
Heinecke, Alexander
Bode, Arndt
Smelyanskiy, Mikhail
Pelties, Christian
Vaidyanathan, Karthikeyan
Author_xml – sequence: 1
  givenname: Alexander
  surname: Heinecke
  fullname: Heinecke, Alexander
  organization: Technische Universität München, Munich, Germany and Parallel Computing Lab, Intel Corporation, Santa Clara, CA
– sequence: 2
  givenname: Alexander
  surname: Breuer
  fullname: Breuer, Alexander
  organization: Technische Universität München, Munich, Germany
– sequence: 3
  givenname: Sebastian
  surname: Rettenberger
  fullname: Rettenberger, Sebastian
  organization: Technische Universität München, Munich, Germany
– sequence: 4
  givenname: Michael
  surname: Bader
  fullname: Bader, Michael
  organization: Technische Universität München, Munich, Germany
– sequence: 5
  givenname: Alice-Agnes
  surname: Gabriel
  fullname: Gabriel, Alice-Agnes
  organization: Ludwig-Maximilians-Universität München, Munich, Germany
– sequence: 6
  givenname: Christian
  surname: Pelties
  fullname: Pelties, Christian
  organization: Ludwig-Maximilians-Universität München, Munich, Germany
– sequence: 7
  givenname: Arndt
  surname: Bode
  fullname: Bode, Arndt
  organization: Leibniz Supercomputing Centre, Munich, Germany and Technische Universität München, Munich, Germany
– sequence: 8
  givenname: William
  surname: Barth
  fullname: Barth, William
  organization: Texas Advanced Computing Center, Austin, TX
– sequence: 9
  givenname: Xiang-Ke
  surname: Liao
  fullname: Liao, Xiang-Ke
  organization: National University of Defense Technology, Changsha, China
– sequence: 10
  givenname: Karthikeyan
  surname: Vaidyanathan
  fullname: Vaidyanathan, Karthikeyan
  organization: Parallel Computing Lab, Intel Corporation, Bangalore, India
– sequence: 11
  givenname: Mikhail
  surname: Smelyanskiy
  fullname: Smelyanskiy, Mikhail
  organization: Parallel Computing Lab, Intel Corporation, Santa Clara, CA
– sequence: 12
  givenname: Pradeep
  surname: Dubey
  fullname: Dubey, Pradeep
  organization: Parallel Computing Lab, Intel Corporation, Santa Clara, CA
BookMark eNqFkD1PwzAYhI0oErR0YGaxmFhS_NqOE48o4kuqBFJhYrDc5E0T2sTBTob-e1IVZqbT3XO64aZk0roWCbkCtgBg-m6VLTgDuVAnZAoy0TqWWovTPxMzxibkgoNKIim4PifzEL7GEGSsgMcX5PMNextyu0Na1ZuKOl-gp8W-tU2dUz90_eCRovV99T3YLdJQN8PO9rVrA3UtrbBH7zbYohsCDUOHPndNN4xpuCRnpd0FnP_qjHw8Prxnz9Hy9eklu19GVgjVR4UuVIIWYm651BZErmOLSoDNRZkK0FDINVO6SJFJDrksuc45yNImMhFFIWbk-rhbI6LpfN1YvzcJAw5pOtKbI7V5Y9bObYMBZg7vmVVmDu8ZNZZu_y2Zta-xFD_GhW3u
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/SC.2014.6
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 1479954993
9781479955008
9781479954995
1479955000
EndPage 14
ExternalDocumentID 7012188
Genre orig-research
GroupedDBID 6IE
6IF
6IK
6IL
6IN
AAJGR
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
IEGSK
IERZE
OCL
RIE
RIL
6IH
AAWTH
ABLEC
ADZIZ
CHZPO
IPLJI
ID FETCH-LOGICAL-a336t-d9d67ea152a249a13c95ae631ac3f83191d4b069d8e0421c4f29c214fa7473dd3
IEDL.DBID RIE
ISBN 1479955000
9781479955008
ISICitedReferencesCount 101
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000393484400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 2167-4329
IngestDate Wed Aug 27 01:54:18 EDT 2025
Wed Jan 31 06:40:24 EST 2024
Wed Jan 31 06:49:49 EST 2024
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Keywords ADER-DG
dynamic rupture
heterogeneous supercomputers
earthquake simulation
hybrid parallelization
petascale performance
SeisSol
Language English
LinkModel DirectLink
MeetingName SC '14: International Conference for High Performance Computing, Networking, Storage and Analysis
MergedId FETCHMERGED-LOGICAL-a336t-d9d67ea152a249a13c95ae631ac3f83191d4b069d8e0421c4f29c214fa7473dd3
OpenAccessLink https://ieeexplore.ieee.org/document/7012188
PageCount 12
ParticipantIDs acm_books_10_1109_SC_2014_6
ieee_primary_7012188
acm_books_10_1109_SC_2014_6_brief
PublicationCentury 2000
PublicationDate 2014-11
PublicationDateYYYYMMDD 2014-11-01
PublicationDate_xml – month: 11
  year: 2014
  text: 2014-11
PublicationDecade 2010
PublicationPlace Piscataway, NJ, USA
PublicationPlace_xml – name: Piscataway, NJ, USA
PublicationSeriesTitle ACM Conferences
PublicationTitle Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
PublicationTitleAbbrev SC
PublicationYear 2014
Publisher IEEE Press
IEEE
Publisher_xml – name: IEEE Press
– name: IEEE
SSID ssj0001456125
ssj0001947932
ssj0003204180
Score 1.9399694
Snippet We present an end-to-end optimization of the innovative Arbitrary high-order DERivative Discontinuous Galerkin (ADER-DG) software SeisSol targeting Intel® Xeon...
SourceID ieee
acm
SourceType Publisher
StartPage 3
SubjectTerms ADER-DG
Applied computing -- Physical sciences and engineering -- Earth and atmospheric sciences
Computational modeling
Computer systems organization -- Architectures -- Distributed architectures -- Grid computing
Computer systems organization -- Architectures -- Parallel architectures -- Multicore architectures
Computer systems organization -- Architectures -- Serial architectures -- Superscalar architectures
Computer systems organization -- Dependable and fault-tolerant systems and networks
Computing methodologies -- Modeling and simulation -- Simulation types and techniques -- Massively parallel and high-performance simulations
dynamic rupture
earthquake simulation
Earthquakes
General and reference -- Cross-computing tools and techniques -- Performance
heterogeneous supercomputers
hybrid parallelization
Jacobian matrices
Kernel
Networks -- Network performance evaluation
Optimization
petascale performance
Seismic waves
SeisSol
Software and its engineering -- Software organization and properties -- Software system structures -- Distributed systems organizing principles -- Grid computing
Stress
Title Petascale high order dynamic rupture earthquake simulations on heterogeneous supercomputers
URI https://ieeexplore.ieee.org/document/7012188
WOSCitedRecordID wos000393484400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3dS8MwED9UfPDJjynOLyL4aLVJats8T8UHmcOpCD6UW3LBIVvnuvr3m2R1IojgW68ltFzvuNzl7vcDOBkkVmWIMnLBmaJEII-UMDzyUL42jaWlAKX0dJt1u_nzs-otweliFoaIQvMZnfnLcJZvSl37Utl55gHI8nwZlrMsnc9qfddT_E6gsc0gK18zEgtZijjhgUhNBKhvKVQDNMRjdd7v-C6v5Mwjj6Ae_aBaCZHmev1_37gB298je6y3CEabsETjLVj_4mxgjQu34KVHM6zcjyHmWzzYnYfeZJdzXnp2X0_8iQK7cgb1-l7jG7H-cNQwfFWsHLMb3z5TOqujsq5Yv57QVDcvqbbh8frqoXMTNQQLEUqZziKjTJoRuhCOLgtDLrW6QEolRy1t7pyTm2QQp8rk5Hyb68QKpQVPLLokRBojd2BlXI5pF5hJiZNCSxqdnjNUTpaJMIjaSjXgbdh3ei185lAVIfGIVdHvFF7rRdqG4z-eFoPpkGwbWl7bxWSOwlE0it77_fY-rPnF86nBA1iZTWs6hFX9MRtW06NgOp_iD77J
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3fb9MwED6NgQRPAzZEGT-MxCPZYjtL4ueyqYhSKjrQJB6sq30WFVrTNQ1_Pz43dEJCSLzlEsmJLnc63_nu-wDezItgKkSdxeBMWaFQZkZ5mTGUbyhzHShBKX0dV5NJfXVlpnvwdjcLQ0Sp-YxO-DKd5fvGdVwqO60YgKyu78BdZs7Kt9NatxUV3gv01plkw1UjtZO1yguZqNRUAvvWyvRQQzI3p7Mh93kVJ4w9gu76D7KVFGsuDv7vKx_C0e3QnpjuwtEj2KPlYzj4zdogeic-hG9T2mAbfw0JbvIQnxh8U7zbMtOLz92KzxTEeTSp7zcd_iAxW1z3HF-taJZixA00TbQ7arpWzLoVrV3_kvYIvlycXw5HWU-xkKHW5SbzxpcVYQziGPMwlNqZM6RSS3Q61NE9pS_meWl8TdG7pSuCMk7JImBMQ7T3-gnsL5slPQXhS5JkMJDDqOcKTZR1oTyiC9rM5QCOo14t5w6tTalHbuxsaFnrthzA6388tfP1gsIADlnbdrXF4bC9op_9_fYruD-6_Di24_eTD8fwgBfazhA-h_3NuqMXcM_93Cza9ctkRr8A-4XCDw
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+of+the+International+Conference+for+High+Performance+Computing%2C+Networking%2C+Storage+and+Analysis&rft.atitle=Petascale+high+order+dynamic+rupture+earthquake+simulations+on+heterogeneous+supercomputers&rft.au=Heinecke%2C+Alexander&rft.au=Breuer%2C+Alexander&rft.au=Rettenberger%2C+Sebastian&rft.au=Bader%2C+Michael&rft.series=ACM+Conferences&rft.date=2014-11-01&rft.pub=IEEE+Press&rft.isbn=1479955000&rft.spage=3&rft.epage=14&rft_id=info:doi/10.1109%2FSC.2014.6
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2167-4329&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2167-4329&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2167-4329&client=summon