Latency Aware and Resource-Efficient Bin Pack Autoscaling for Distributed Event Queues: Parameters Impact and Setting

The event driven architectural style is becoming increasingly popular for designing large scale real time cloud applications. In this architectural style, an application is composed of a set of services that communicate by exchanging events over a distributed event queue rather than over remote proc...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	SN computer science Jg. 6; H. 3; S. 219
Hauptverfasser:	Ezzeddine, Mazen, Baude, Françoise, Huet, Fabrice, Laaziz, Fatima
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	Singapore Springer Nature Singapore 24.02.2025 Springer Nature B.V Springer
Schlagworte:	Advanced Research on Cloud Computing and Services Science (CLOSER 2024) Architecture Cloud computing Computer Imaging Computer Science Computer Systems Organization and Communication Networks Consumers Data Structures and Information Theory Information Systems and Communication Service Linear programming Original Research Pattern Recognition and Graphics Provisioning Queues Real time Remote procedure calls Software Engineering/Programming and Operating Systems Synchronism Usability Vision Kafka Bin packing autoscaler Distributed queue Rebalancing Dynamic resource provisioning dynamic resource provisioning bin packing autoscaler distributed queue rebalancing
ISSN:	2661-8907, 2662-995X, 2661-8907
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Abstract	The event driven architectural style is becoming increasingly popular for designing large scale real time cloud applications. In this architectural style, an application is composed of a set of services that communicate by exchanging events over a distributed event queue rather than over remote procedure calls RPC. To achieve real time processing, services (event consumers) in the application must be able to consume and process events in less than a desired latency. Meeting such desired latency must be accomplished at low cost in terms of resources used. This paper presents a new approach to dynamic event consumer provisioning in distributed event queues, focusing on latency-awareness and resource efficiency. Our proposed solution models the dynamic event consumer replica provisioner as a two-dimensional bin packing problem. Furthermore, we discuss how dynamic event consumers provisioning in distributed event queues necessitates a blocking synchronization protocol that is at conflict with meeting a desired latency for high percentile of events. To address this issue, we propose an extension to the bin pack autoscaler logic to reduce the tail latency caused by the events accumulated during the blocking synchronization protocol. As part of the experimental work, we provide insights and recommendations on the configuration of the proposed bin pack model when the events processing time and the workload feature large variance.
AbstractList	The event driven architectural style is becoming increasingly popular for designing large scale real time cloud applications. In this architectural style, an application is composed of a set of services that communicate by exchanging events over a distributed event queue rather than over remote procedure calls RPC. To achieve real time processing, services (event consumers) in the application must be able to consume and process events in less than a desired latency. Meeting such desired latency must be accomplished at low cost in terms of resources used. This paper presents a new approach to dynamic event consumer provisioning in distributed event queues, focusing on latency-awareness and resource efficiency. Our proposed solution models the dynamic event consumer replica provisioner as a two-dimensional bin packing problem. Furthermore, we discuss how dynamic event consumers provisioning in distributed event queues necessitates a blocking synchronization protocol that is at conflict with meeting a desired latency for high percentile of events. To address this issue, we propose an extension to the bin pack autoscaler logic to reduce the tail latency caused by the events accumulated during the blocking synchronization protocol. As part of the experimental work, we provide insights and recommendations on the configuration of the proposed bin pack model when the events processing time and the workload feature large variance.
ArticleNumber	219
Author	Baude, Françoise Huet, Fabrice Laaziz, Fatima Ezzeddine, Mazen
Author_xml	– sequence: 1 givenname: Mazen surname: Ezzeddine fullname: Ezzeddine, Mazen organization: Université Côte d’Azur, CNRS, I3S, HighTech Payment Systems, HPS – sequence: 2 givenname: Françoise surname: Baude fullname: Baude, Françoise email: francoise.baude@univ-cotedazur.fr organization: Université Côte d’Azur, CNRS, I3S – sequence: 3 givenname: Fabrice surname: Huet fullname: Huet, Fabrice organization: Université Côte d’Azur, CNRS, I3S – sequence: 4 givenname: Fatima surname: Laaziz fullname: Laaziz, Fatima organization: Université Côte d’Azur, CNRS, I3S
BackLink	https://hal.science/hal-04973463$$DView record in HAL
BookMark	eNp9kctO5DAQRS0EEs8fYGWJFYswfiWO2TXQDEgt8V5bjlOGQLfT2A6Iv8dN0DArVlUqnXtVVXcbrfveA0L7lBxRQuSfKJiSqiCsLAiXghRqDW2xqqJFrYhc_6_fRHsxPhOSUSJEVW6hYWYSePuBJ-8mADa-xbcQ-yFYKKbOdbYDn_BJ5_G1sS94MqQ-WjPv_CN2fcBnXUyha4YELZ6-rdCbAQaIxxkPZgEJQsSXi6Wx6cv7DlLK2l204cw8wt533UEP59P704tidvX38nQyKyyjShXcKdeUjDa2pqYiTPC2NlJYSitwVth8PChwjFZKtKVlzPGWNcaBqEtS24bvoMPR98nM9TJ0CxM-dG86fTGZ6dWMCCW5qPgbzezByC5D_5pPSPo5v8Hn9TSnkkhOKqkyxUbKhj7GAO6fLSV6lYYe09D5xforDb0S8VEUM-wfIfxY_6L6BGCrjiw
Cites_doi	10.5220/0012630100003711 10.1109/SEAA51224.2020.00045 10.1145/3629104.3666036 10.1109/FAS-W.2019.00042 10.1145/3530050.3532925 10.1109/SBAC-PAD55451.2022.00023 10.1109/COMST.2018.2844341 10.1145/2678373.2665718 10.1109/JPROC.2019.2901578 10.1016/j.csi.2014.08.002 10.1109/TVCG.2013.226 10.3390/computers9010012 10.1109/MobileCloud58788.2023.00009 10.1109/TPDS.2017.2762683 10.1145/2408776.2408794 10.1016/j.is.2017.09.002 10.1145/3592598 10.1002/9781118445112.stat01100.pub2
ContentType	Journal Article
Copyright	The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd. 2025 Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. Copyright Springer Nature B.V. Mar 2025 Distributed under a Creative Commons Attribution 4.0 International License
Copyright_xml	– notice: The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd. 2025 Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. – notice: Copyright Springer Nature B.V. Mar 2025 – notice: Distributed under a Creative Commons Attribution 4.0 International License
DBID	AAYXX CITATION JQ2 1XC
DOI	10.1007/s42979-025-03740-9
DatabaseName	CrossRef ProQuest Computer Science Collection Hyper Article en Ligne (HAL)
DatabaseTitle	CrossRef ProQuest Computer Science Collection
DatabaseTitleList	ProQuest Computer Science Collection
DeliveryMethod	fulltext_linktorsrc
Discipline	Computer Science Architecture
EISSN	2661-8907
ExternalDocumentID	oai:HAL:hal-04973463v1 10_1007_s42979_025_03740_9
GroupedDBID	0R~ 406 AACDK AAHNG AAJBT AASML AATNV AAUYE ABAKF ABECU ABHQN ABJNI ABMQK ABTEG ABTKH ABWNU ACAOD ACDTI ACHSB ACOKC ACPIV ACZOJ ADKNI ADTPH ADYFF AEFQL AEMSY AESKC AFBBN AFQWF AGMZJ AGQEE AGRTI AIGIU AILAN AJZVZ ALMA_UNASSIGNED_HOLDINGS AMXSW AMYLF BAPOH BSONS DPUIP EBLON EBS FIGPU FNLPD GGCAI GNWQR IKXTQ IWAJR JZLTJ LLZTM NPVJJ NQJWS OK1 PT4 ROL RSV SJYHP SNE SOJ SRMVM SSLCW UOJIU UTJUX ZMTXR 2JN AAYXX ABBRH ABDBE ABFSG ABRTQ ACSTC ADKFA AEZWR AFDZB AFHIU AFOHR AHPBZ AHWEU AIXLP ATHPR AYFIA CITATION KOV JQ2 1XC
ID	FETCH-LOGICAL-c2199-3f9fb521bc81a60243d8a74c116efc4c007e9ef21694d5c22f3d2bafe48508cb3
IEDL.DBID	RSV
ISSN	2661-8907 2662-995X
IngestDate	Tue Oct 14 20:35:05 EDT 2025 Wed Nov 05 14:46:06 EST 2025 Sat Nov 29 08:17:13 EST 2025 Tue Feb 25 01:11:42 EST 2025
IsPeerReviewed	true
IsScholarly	true
Issue	3
Keywords	Kafka Bin packing autoscaler Distributed queue Rebalancing Dynamic resource provisioning dynamic resource provisioning bin packing autoscaler distributed queue rebalancing
Language	English
License	Distributed under a Creative Commons Attribution 4.0 International License: http://creativecommons.org/licenses/by/4.0
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c2199-3f9fb521bc81a60243d8a74c116efc4c007e9ef21694d5c22f3d2bafe48508cb3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14
PQID	3170730679
PQPubID	6623307
ParticipantIDs	hal_primary_oai_HAL_hal_04973463v1 proquest_journals_3170730679 crossref_primary_10_1007_s42979_025_03740_9 springer_journals_10_1007_s42979_025_03740_9
PublicationCentury	2000
PublicationDate	20250224
PublicationDateYYYYMMDD	2025-02-24
PublicationDate_xml	– month: 2 year: 2025 text: 20250224 day: 24
PublicationDecade	2020
PublicationPlace	Singapore
PublicationPlace_xml	– name: Singapore – name: Kolkata
PublicationTitle	SN computer science
PublicationTitleAbbrev	SN COMPUT. SCI
PublicationYear	2025
Publisher	Springer Nature Singapore Springer Nature B.V Springer
Publisher_xml	– name: Springer Nature Singapore – name: Springer Nature B.V – name: Springer
References	F Metzger (3740_CR29) 2019; 107 3740_CR30 3740_CR10 K Goodhope (3740_CR5) 2012; 35 3740_CR31 3740_CR12 3740_CR11 D Lo (3740_CR17) 2014; 42 KM Al-Aubidy (3740_CR6) 2017; 1 3740_CR4 3740_CR13 3740_CR3 3740_CR16 3740_CR2 3740_CR15 N Ferreira (3740_CR26) 2013; 19 3740_CR1 3740_CR18 3740_CR19 3740_CR21 3740_CR20 3740_CR23 P Chindanonda (3740_CR25) 2020; 9 F Lombardi (3740_CR22) 2017; 29 JY Fernández-Rodríguez (3740_CR9) 2017; 72 M Mohammadi (3740_CR7) 2018; 20 M Albano (3740_CR8) 2015; 38 J Dean (3740_CR14) 2013; 56 3740_CR24 3740_CR27 3740_CR28
References_xml	– ident: 3740_CR1 doi: 10.5220/0012630100003711 – ident: 3740_CR31 – ident: 3740_CR4 – ident: 3740_CR2 doi: 10.1109/SEAA51224.2020.00045 – ident: 3740_CR23 doi: 10.1145/3629104.3666036 – ident: 3740_CR19 doi: 10.1109/FAS-W.2019.00042 – volume: 35 start-page: 33 issue: 2 year: 2012 ident: 3740_CR5 publication-title: IEEE Data Eng Bull – ident: 3740_CR18 doi: 10.1145/3530050.3532925 – ident: 3740_CR21 doi: 10.1109/SBAC-PAD55451.2022.00023 – volume: 1 start-page: 26 issue: 1 year: 2017 ident: 3740_CR6 publication-title: Int J Digit Signals Smart Syst – ident: 3740_CR12 – ident: 3740_CR16 – volume: 20 start-page: 2923 issue: 4 year: 2018 ident: 3740_CR7 publication-title: IEEE Commun Surv Tutor doi: 10.1109/COMST.2018.2844341 – volume: 42 start-page: 301 issue: 3 year: 2014 ident: 3740_CR17 publication-title: ACM SIGARCH Comput Archit News doi: 10.1145/2678373.2665718 – volume: 107 start-page: 679 year: 2019 ident: 3740_CR29 publication-title: Proc IEEE doi: 10.1109/JPROC.2019.2901578 – ident: 3740_CR10 – volume: 38 start-page: 133 year: 2015 ident: 3740_CR8 publication-title: Comput Stand Interfaces doi: 10.1016/j.csi.2014.08.002 – volume: 19 start-page: 2149 issue: 12 year: 2013 ident: 3740_CR26 publication-title: IEEE Trans Vis Comput Graph doi: 10.1109/TVCG.2013.226 – volume: 9 start-page: 12 issue: 1 year: 2020 ident: 3740_CR25 publication-title: Computers doi: 10.3390/computers9010012 – ident: 3740_CR30 doi: 10.1109/MobileCloud58788.2023.00009 – volume: 29 start-page: 572 issue: 3 year: 2017 ident: 3740_CR22 publication-title: IEEE Trans Parallel Distrib Syst doi: 10.1109/TPDS.2017.2762683 – ident: 3740_CR28 – ident: 3740_CR24 – ident: 3740_CR20 – volume: 56 start-page: 74 issue: 2 year: 2013 ident: 3740_CR14 publication-title: Commun ACM doi: 10.1145/2408776.2408794 – volume: 72 start-page: 62 year: 2017 ident: 3740_CR9 publication-title: Inf Syst doi: 10.1016/j.is.2017.09.002 – ident: 3740_CR11 – ident: 3740_CR13 – ident: 3740_CR15 – ident: 3740_CR3 doi: 10.1145/3592598 – ident: 3740_CR27 doi: 10.1002/9781118445112.stat01100.pub2
SSID	ssj0002504465
Score	2.2976038
Snippet	The event driven architectural style is becoming increasingly popular for designing large scale real time cloud applications. In this architectural style, an...
SourceID	hal proquest crossref springer
SourceType	Open Access Repository Aggregation Database Index Database Publisher
StartPage	219
SubjectTerms	Advanced Research on Cloud Computing and Services Science (CLOSER 2024) Architecture Cloud computing Computer Imaging Computer Science Computer Systems Organization and Communication Networks Consumers Data Structures and Information Theory Information Systems and Communication Service Linear programming Original Research Pattern Recognition and Graphics Provisioning Queues Real time Remote procedure calls Software Engineering/Programming and Operating Systems Synchronism Usability Vision
Title	Latency Aware and Resource-Efficient Bin Pack Autoscaling for Distributed Event Queues: Parameters Impact and Setting
URI	https://link.springer.com/article/10.1007/s42979-025-03740-9 https://www.proquest.com/docview/3170730679 https://hal.science/hal-04973463
Volume	6
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAVX databaseName: SpringerLINK Contemporary 1997-Present customDbUrl: eissn: 2661-8907 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0002504465 issn: 2661-8907 databaseCode: RSV dateStart: 20190101 isFulltext: true titleUrlDefault: https://link.springer.com/search?facet-content-type=%22Journal%22 providerName: Springer Nature – providerCode: PRVAVX databaseName: SpringerLINK Contemporary 1997-Present customDbUrl: eissn: 2661-8907 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0002504465 issn: 2661-8907 databaseCode: RSV dateStart: 20200101 isFulltext: true titleUrlDefault: https://link.springer.com/search?facet-content-type=%22Journal%22 providerName: Springer Nature
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LS8QwEA6uevDiW3wTxJsGtmn6iLequyjIsrIqeytpkuIiVNndKv57Z2JbH-hBr02aNplk5ksy8w0hh0LnBgyjYs53EOlbWCyCmGlftzOtgsCYtks2EfV68XAo-1VQ2KT2dq-vJJ2mboLdQHNGkmH6VeRMaTPZInMBss3gHn1w15ysICmXCIMqQubnV79YodY9-kB-Apjf7kSdqeku_e8nl8liBS1p8j4XVsiMLVbJUp22gVareI2UVwqB8itNXtTYUlUYWh_is45jlABDRE9HBe0r_UCTcvo4AUnCb1BAuPQcqXYxS5Y1tIPekvS6tNCjE6iOnl5I10kvXfCla3tgnWv1Orntdm7OLliVfYFp0GKS-bnMMzDumY49FSJxoYlVJLTnhTbXQkN3rbQ590IpTKA5z33DM5VbEQPo05m_QWaLx8JuEsrxel8qqYSFUquU1AqAm-E8A_gVelvkqJZG-vROspE2dMpuRFMY0dSNaCq3yAEIrKmI_NgXyVWKz2C7E_ki9J-hyd1anmm1KicpYCXUaGEEbRzX8vso_v2T23-rvkMWuJsCnHGxS2an49LukXn9PB1Nxvtutr4BKS_kqQ
linkProvider	Springer Nature
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1ZT8QgECZeib54G9eTGN-UZEvpgW-rrlnjutF4xDdCgUZjUs1exn_vDLbrEX3Q10JpYWDmA2a-IWRXmNyCYdTM-w4ifQtLRZQyE5p6ZnQUWVv3ySaSTie9u5MXZVBYr_J2r64kvaYeBbuB5kwkw_SryJlSZ3KcTApMs4N79Kvb0ckKknKJOCojZH5-9YsVGr9HH8hPAPPbnag3NSdz__vJeTJbQkvaeJ8LC2TMFYtkrkrbQMtVvEQGbY1A-ZU2XnTXUV1YWh3is6ZnlABDRA8fCnqhzSNtDPpPPZAk_AYFhEuPkWoXs2Q5S5voLUkvBw56dADV0dML6TrpqQ--9G1fOe9avUxuTprXRy1WZl9gBrSYZGEu8wyMe2bSQMdIXGhTnQgTBLHLjTDQXSddzoNYChsZzvPQ8kznTqQA-kwWrpCJ4qlwq4RyvN6XWmrhoNRpLY0G4GY5zwB-xUGN7FXSUM_vJBtqRKfsR1TBiCo_okrWyA4IbFQR-bFbjbbCZ7DdSUIRh0NocqOSpypXZU8BVkKNFifQxn4lv4_i3z-59rfq22S6dX3eVu3Tztk6meF-OnDGxQaZ6HcHbpNMmWH_odfd8jP3DelG540
linkToPdf	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1JT-swELZYnhAXlgeIHQu9G1g0jrOYW4FWIKqqrOJmObYjKqSAuoD498y4SR8gOCCuseNtbM9ne-YbQv4Jk1tQjJp520Gkb2GpiFJmQlPLjI4ia2s-2ETSbqd3d7LzzovfW7tXT5IjnwZkaSoGB082Pxg7vsEumkiGoViRP6XG5CSZFnCSQaOuy6vb8S0LEnSJOCq9Zb7-9YNGmrxHe8h3YPPT-6hXO8353zd4gcyVkJPWR3NkkUy44i-Zr8I50HJ1L5FhSyOAfqX1F91zVBeWVpf7rOGZJqA-etQtaEebB1ofDh77IGFoEgXkS0-QghejZzlLG2hFSS-GDnp3CNnRAgxpPOmZd8r0ZV85b3K9TG6ajevjU1ZGZWAGdjfJwlzmGSj9zKSBjpHQ0KY6ESYIYpcbYaC7TrqcB7EUNjKc56Hlmc6dSAEMmixcIVPFY-FWCeX47C-11MJBqtNaGg2AznKeASyLgzWyV0lGPY3IN9SYZtmPqIIRVX5ElVwjuyC8cUbkzT6ttxR-g2NQEoo4fIYiNyvZqnK19hVgKNzp4gTK2K9k-T_5-yrXf5Z9h8x0TpqqddY-3yCz3M8GzrjYJFOD3tBtkT_medDt97b9JH4DBLjwcQ
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Latency+Aware+and+Resource-Efficient+Bin+Pack+Autoscaling+for+Distributed+Event+Queues%3A+Parameters+Impact+and+Setting&rft.jtitle=SN+computer+science&rft.date=2025-02-24&rft.pub=Springer+Nature+B.V&rft.issn=2662-995X&rft.eissn=2661-8907&rft.volume=6&rft.issue=3&rft.spage=219&rft_id=info:doi/10.1007%2Fs42979-025-03740-9&rft.externalDBID=NO_FULL_TEXT
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2661-8907&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2661-8907&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2661-8907&client=summon