Distributed Stream Rebalance for Stateful Operator Under Workload Variance

Key-based workload partitioning is now commonly used in parallel stream processing, enabling effective key-value tuple distribution over worker threads in a logical operator. While randomized hashing on the keys is capable of balancing the workload for key-based partitioning when the keys generally...

Full description

Saved in:

Bibliographic Details
Published in:	IEEE transactions on parallel and distributed systems Vol. 29; no. 10; pp. 2223 - 2240
Main Authors:	Fang, Junhua, Zhang, Rong, Fu, Tom Z. J., Zhang, Zhenjie, Zhou, Aoying, Zhou, Xiaofang
Format:	Journal Article
Language:	English
Published:	New York IEEE 01.10.2018 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:	adjustment Computer networks Distributed databases Distributed stream processing Engines Instruction sets load balance Migration Optimization Partitioning Proposals Routing stateful operation Task analysis Workload workload variance Workloads
ISSN:	1045-9219, 1558-2183
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!