Latency Aware and Resource-Efficient Bin Pack Autoscaling for Distributed Event Queues: Parameters Impact and Setting

The event driven architectural style is becoming increasingly popular for designing large scale real time cloud applications. In this architectural style, an application is composed of a set of services that communicate by exchanging events over a distributed event queue rather than over remote proc...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:SN computer science Jg. 6; H. 3; S. 219
Hauptverfasser: Ezzeddine, Mazen, Baude, Françoise, Huet, Fabrice, Laaziz, Fatima
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Singapore Springer Nature Singapore 24.02.2025
Springer Nature B.V
Springer
Schlagworte:
Advanced Research on Cloud Computing and Services Science (CLOSER 2024)
Architecture
Cloud computing
Computer Imaging
Computer Science
Computer Systems Organization and Communication Networks
Consumers
Data Structures and Information Theory
Information Systems and Communication Service
Linear programming
Original Research
Pattern Recognition and Graphics
Provisioning
Queues
Real time
Remote procedure calls
Software Engineering/Programming and Operating Systems
Synchronism
Usability
Vision
Kafka
Bin packing autoscaler
Distributed queue
Rebalancing
Dynamic resource provisioning
dynamic resource provisioning
bin packing autoscaler
distributed queue
rebalancing
ISSN:2661-8907, 2662-995X, 2661-8907
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The event driven architectural style is becoming increasingly popular for designing large scale real time cloud applications. In this architectural style, an application is composed of a set of services that communicate by exchanging events over a distributed event queue rather than over remote procedure calls RPC. To achieve real time processing, services (event consumers) in the application must be able to consume and process events in less than a desired latency. Meeting such desired latency must be accomplished at low cost in terms of resources used. This paper presents a new approach to dynamic event consumer provisioning in distributed event queues, focusing on latency-awareness and resource efficiency. Our proposed solution models the dynamic event consumer replica provisioner as a two-dimensional bin packing problem. Furthermore, we discuss how dynamic event consumers provisioning in distributed event queues necessitates a blocking synchronization protocol that is at conflict with meeting a desired latency for high percentile of events. To address this issue, we propose an extension to the bin pack autoscaler logic to reduce the tail latency caused by the events accumulated during the blocking synchronization protocol. As part of the experimental work, we provide insights and recommendations on the configuration of the proposed bin pack model when the events processing time and the workload feature large variance.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2661-8907
2662-995X
2661-8907
DOI:10.1007/s42979-025-03740-9