A survey on the Distributed Computing stack

In this paper, we review the background and the state of the art of the Distributed Computing software stack. We aim to provide the readers with a comprehensive overview of this area by supplying a detailed big-picture of the latest technologies. First, we introduce the general background of Distrib...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Computer science review Jg. 42; S. 100422
Hauptverfasser: Ramon-Cortes, Cristian, Alvarez, Pol, Lordan, Francesc, Alvarez, Javier, Ejarque, Jorge, Badia, Rosa M.
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Elsevier Inc 01.11.2021
Schlagworte:
Cloud computing
Data Sharing
Dataflows
Distributed Computing
Distributed programming models
Distributed systems
Graph Processing
Infrastructure managers
Resource Management
Streaming
Task-based Workflows
Streaming
Cloud computing
Dataflows
Infrastructure managers
Distributed systems
Graph Processing
Task-based Workflows
Data Sharing
Distributed Computing
Distributed programming models
Resource Management
ISSN:1574-0137
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:In this paper, we review the background and the state of the art of the Distributed Computing software stack. We aim to provide the readers with a comprehensive overview of this area by supplying a detailed big-picture of the latest technologies. First, we introduce the general background of Distributed Computing and propose a layered top–bottom classification of the latest available software. Next, we focus on each abstraction layer, i.e. Application Development (including Task-based Workflows, Dataflows, and Graph Processing), Platform (including Data Sharing and Resource Management), Communication (including Remote Invocation, Message Passing, and Message Queuing), and Infrastructure (including Batch and Interactive systems). For each layer, we give a general background, discuss its technical challenges, review the latest programming languages, programming models, frameworks, libraries, and tools, and provide a summary table comparing the features of each alternative. Finally, we conclude this survey with a discussion of open problems and future directions.
ISSN:1574-0137
DOI:10.1016/j.cosrev.2021.100422