Search Results - Distributed-memory parallelisms

3D DFT by block tensor-matrix multiplication via a modified Cannon's algorithm: Implementation and scaling on distributed-memory clusters with fat tree networks by Malapally, Nitin, Bolnykh, Viacheslav, Suarez, Estela, Carloni, Paolo, Lippert, Thomas, Mandelli, Davide

“…A known scalability bottleneck of the parallel 3D FFT is its use of all-to-all communications. Here, we present S3DFT, a library that circumvents this by using…”
Get full text

A framework for exploiting task and data parallelism on distributed memory multicomputers by Ramaswamy, S., Sapatnekar, S., Banerjee, P.

“… compiler and run-time support for distributed memory machines. In this paper, we explore a new compiler optimization for regular scientific applications-the simultaneous exploitation of task and data parallelism…”
Get full text

Axially-deformed solution of the Skyrme-Hartree-Fock-Bogoliubov equations using the transformed harmonic oscillator basis (IV) hfbtho (v4.0): A new version of the program by Marević, P., Schunck, N., Ney, E.M., Navarro Pérez, R., Verriere, M., O'Neal, J.

“…We describe the new version 4.0 of the code hfbtho that solves the nuclear Hartree-Fock-Bogoliubov problem by using the deformed harmonic oscillator basis in…”
Get full text

superB/NRPy: scalable, task-based numerical relativity for 3G gravitational wave science by Jadoo, Nishita, Jacques, Terrence Pierre, Etienne, Zachariah B

Get full text

Iterators, Schedulers, and Distributed-memory Parallelism by GRAEFE, GOETZ

“…’ for sequential and parallel query evaluation. Unfortunately, those earlier models have a severe drawback with respect to resource allocation in distributed‐memory systems…”
Get full text

Massively parallel implementation and approaches to simulate quantum dynamics using Krylov subspace techniques by Brenes, Marlon, Varma, Vipin Kerala, Scardicchio, Antonello, Girotto, Ivan

“…We have developed an application and implemented parallel algorithms in order to provide a computational framework suitable for massively parallel…”
Get full text

Leveraging HPC accelerator architectures with modern techniques — hydrologic modeling on GPUs with ParFlow by Hokkanen, Jaro, Kollet, Stefan, Kraus, Jiri, Herten, Andreas, Hrywniak, Markus, Pleiter, Dirk

“…Rapidly changing heterogeneous supercomputer architectures pose a great challenge to many scientific communities trying to leverage the latest technology in…”
Get full text

MPI+X: task-based parallelisation and dynamic load balance of finite element assembly by Garcia-Gasulla, Marta, Houzeaux, Guillaume, Ferrer, Roger, Artigues, Antoni, López, Victor, Labarta, Jesús, Vázquez, Mariano

“… of the MPI partitions to compute element matrices and vectors and then of their assemblies. In a MPI+X hybrid parallelism context, X has consisted traditionally of loop…”
Get full text

Parallelization of a distributed ecohydrological model by Liu, Ning, Shaikh, Mohsin Ahmed, Kala, Jatin, Harper, Richard J., Dell, Bernard, Liu, Shirong, Sun, Ge

“… High resolution simulations at a large scale are therefore computationally expensive and cause a run-time memory burden. Using distributed (MPI) and shared (OpenMP…”
Get full text

A scalable scheduling scheme for functional parallelism on distributed memory multiprocessor systems by Pande, S., Agrawal, D.P., Mauney, J.

“… and partially at run time. Assuming infinite number of processors, the compile time schedule is found using a new concept of the threshold of a task that quantifies a trade-off between the schedule-length and the degree of parallelism…”
Get full text

A shared compilation stack for distributed-memory parallelism in stencil DSLs by Bisbas, George, Lydike, Anton, Bauer, Emilien, Brown, Nick, Fehr, Mathieu, Mitchell, Lawrence, Rodriguez-Canal, Gabriel, Jamieson, Maurice, Kelly, Paul H J, Steuwer, Michel, Grosser, Tobias

“…Domain Specific Languages (DSLs) increase programmer productivity and provide high performance. Their targeted abstractions allow scientists to express…”
Get full text

A Robust Compile Time Method for Scheduling Task Parallelism on Distributed Memory Machines by Darbha, Sekhar, Pande, Santosh

“…A compile time scheduling algorithm for a variable number of available processors is introduced and the impact of the change of computation and communication…”
Get full text

On the Test Particle Monte-Carlo method to solve the steady state Boltzmann equation, the congruity of its results with experiments and its potential for shared memory parallelism by Rondeau, Maxime, Arès, R.

“…The Test Particle Monte Carlo is a known method to solve the steady state Boltzmann particle transport equation in rarefied gas systems. A description of the…”
Get full text

High-Performance Sorting-Based k-mer Counting in Distributed Memory with Flexible Hybrid Parallelism by Li, Yifan, Guidi, Giulia

“… Due to the growing volume of data, the scaling of the counting process is critical. In the literature, distributed memory software uses hash tables, which exhibit poor cache friendliness and consume excessive memory…”
Get full text

CAPTURE: Memory-Centric Partitioning for Distributed DNN Training with Hybrid Parallelism by Dreuning, Henk, Verstoep, Kees, Bal, Henri E., van Nieuwpoort, Rob V.

“… Hybrid-parallel training approaches have emerged that combine pipelining with data and tensor parallelism to facilitate the training of large DL models on distributed hardware setups…”
Get full text

A study of shared-memory parallelism in a multifrontal solver by L’Excellent, Jean-Yves, Sid-Lakhdar, Wissam M.

“… We introduce shared-memory parallelism in a parallel distributed-memory solver, targeting multi-core architectures…”
Get full text

A robust compile time method for scheduling task parallelism on distributed memory machines by Darbha, S., Pande, S.

“…A desirable property of a compile time scheduling algorithm is robustness against the variations in the computation and communication costs so that the run…”
Get full text

Reservoir Echo State Network for Classification of Multivariate Time Series by Purkayastha, Basab Bijoy, Barma, Shovan

“… It leverages both CPU-shared memory and parallel distributed memory architecture to efficiently capture reservoir state's optimal model space representation, addressing computational challenges in MTS analysis…”
Get full text

Swift : a modern highly parallel gravity and smoothed particle hydrodynamics solver for astrophysical and cosmological applications by Schaller, Matthieu, Borrow, Josh, Draper, Peter W, Ivkovic, Mladen, McAlpine, Stuart, Vandenbroucke, Bert, Bahé, Yannick, Chaikin, Evgenii, Chalk, Aidan B G, Chan, Tsang Keung, Correa, Camila, van Daalen, Marcel, Elbers, Willem, Gonnet, Pedro, Hausammann, Loïc, Helly, John, Huško, Filip, Kegerreis, Jacob A, Nobels, Folkert S J, Ploeckinger, Sylvia, Revaz, Yves, Roper, William J, Ruiz-Bonilla, Sergio, Sandnes, Thomas D, Uyttenhove, Yolan, Willis, James S, Xiang, Zhen

“… The software package exploits hybrid shared- and distributed-memory task-based parallelism, asynchronous communications, and domain-decomposition algorithms based on balancing the workload, rather…”
Get full text

Automated MPI-X Code Generation for Scalable Finite-Difference Solvers by Bisbas, George, Nelson, Rhodri, Louboutin, Mathias, Luporini, Fabio, Kelly, Paul H.J., Gorman, Gerard

“… This paper introduces automated codegeneration techniques specifically tailored for distributed memory parallelism (DMP…”
Get full text