Data Flow Lifecycles for Optimizing Workflow Coordination

A critical performance challenge in distributed scientific workflows is coordinating tasks and data flows on distributed resources. To guide these decisions, this paper introduces data flow lifecycle analysis. Workflows are commonly represented using directed acyclic graphs (DAGs). Data flow lifecyc...

Full description

Bibliographic Details

Published in:	International Conference for High Performance Computing, Networking, Storage and Analysis (Online) pp. 1 - 15
Main Authors:	Lee, Hyungro, Guo, Luanzheng, Tang, Meng, Firoz, Jesun, Tallent, Nathan R., Kougkas, Anthony, Sun, Xian-He
Format:	Conference Proceeding
Language:	English
Published:	ACM 11.11.2023
Subjects:	caterpillar tree data flow lifecycles Data visualization Distributed databases distributed workflows Instruments performance analysis Processor scheduling Quality of service storage bottlenecks Throughput Volume measurement
ISSN:	2167-4337
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!