Latency Aware and Resource-Efficient Bin Pack Autoscaling for Distributed Event Queues: Parameters Impact and Setting

The event driven architectural style is becoming increasingly popular for designing large scale real time cloud applications. In this architectural style, an application is composed of a set of services that communicate by exchanging events over a distributed event queue rather than over remote proc...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:SN computer science Ročník 6; číslo 3; s. 219
Hlavní autoři: Ezzeddine, Mazen, Baude, Françoise, Huet, Fabrice, Laaziz, Fatima
Médium: Journal Article
Jazyk:angličtina
Vydáno: Singapore Springer Nature Singapore 24.02.2025
Springer Nature B.V
Springer
Témata:
Advanced Research on Cloud Computing and Services Science (CLOSER 2024)
Architecture
Cloud computing
Computer Imaging
Computer Science
Computer Systems Organization and Communication Networks
Consumers
Data Structures and Information Theory
Information Systems and Communication Service
Linear programming
Original Research
Pattern Recognition and Graphics
Provisioning
Queues
Real time
Remote procedure calls
Software Engineering/Programming and Operating Systems
Synchronism
Usability
Vision
Kafka
Bin packing autoscaler
Distributed queue
Rebalancing
Dynamic resource provisioning
dynamic resource provisioning
bin packing autoscaler
distributed queue
rebalancing
ISSN:2661-8907, 2662-995X, 2661-8907
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:The event driven architectural style is becoming increasingly popular for designing large scale real time cloud applications. In this architectural style, an application is composed of a set of services that communicate by exchanging events over a distributed event queue rather than over remote procedure calls RPC. To achieve real time processing, services (event consumers) in the application must be able to consume and process events in less than a desired latency. Meeting such desired latency must be accomplished at low cost in terms of resources used. This paper presents a new approach to dynamic event consumer provisioning in distributed event queues, focusing on latency-awareness and resource efficiency. Our proposed solution models the dynamic event consumer replica provisioner as a two-dimensional bin packing problem. Furthermore, we discuss how dynamic event consumers provisioning in distributed event queues necessitates a blocking synchronization protocol that is at conflict with meeting a desired latency for high percentile of events. To address this issue, we propose an extension to the bin pack autoscaler logic to reduce the tail latency caused by the events accumulated during the blocking synchronization protocol. As part of the experimental work, we provide insights and recommendations on the configuration of the proposed bin pack model when the events processing time and the workload feature large variance.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2661-8907
2662-995X
2661-8907
DOI:10.1007/s42979-025-03740-9