A survey on the Distributed Computing stack

In this paper, we review the background and the state of the art of the Distributed Computing software stack. We aim to provide the readers with a comprehensive overview of this area by supplying a detailed big-picture of the latest technologies. First, we introduce the general background of Distrib...

Full description

Saved in:
Bibliographic Details
Published in:Computer science review Vol. 42; p. 100422
Main Authors: Ramon-Cortes, Cristian, Alvarez, Pol, Lordan, Francesc, Alvarez, Javier, Ejarque, Jorge, Badia, Rosa M.
Format: Journal Article
Language:English
Published: Elsevier Inc 01.11.2021
Subjects:
Cloud computing
Data Sharing
Dataflows
Distributed Computing
Distributed programming models
Distributed systems
Graph Processing
Infrastructure managers
Resource Management
Streaming
Task-based Workflows
Streaming
Cloud computing
Dataflows
Infrastructure managers
Distributed systems
Graph Processing
Task-based Workflows
Data Sharing
Distributed Computing
Distributed programming models
Resource Management
ISSN:1574-0137
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we review the background and the state of the art of the Distributed Computing software stack. We aim to provide the readers with a comprehensive overview of this area by supplying a detailed big-picture of the latest technologies. First, we introduce the general background of Distributed Computing and propose a layered top–bottom classification of the latest available software. Next, we focus on each abstraction layer, i.e. Application Development (including Task-based Workflows, Dataflows, and Graph Processing), Platform (including Data Sharing and Resource Management), Communication (including Remote Invocation, Message Passing, and Message Queuing), and Infrastructure (including Batch and Interactive systems). For each layer, we give a general background, discuss its technical challenges, review the latest programming languages, programming models, frameworks, libraries, and tools, and provide a summary table comparing the features of each alternative. Finally, we conclude this survey with a discussion of open problems and future directions.
ISSN:1574-0137
DOI:10.1016/j.cosrev.2021.100422