Join-Idle-Queue: A novel load balancing algorithm for dynamically scalable web services

The prevalence of dynamic-content web services, exemplified by search and online social networking, has motivated an increasingly wide web-facing front end. Horizontal scaling in the Cloud is favored for its elasticity, and distributed design of load balancers is highly desirable. Existing algorithm...

Full description

Saved in:
Bibliographic Details
Published in:Performance evaluation Vol. 68; no. 11; pp. 1056 - 1071
Main Authors: Lu, Yi, Xie, Qiaomin, Kliot, Gabriel, Geller, Alan, Larus, James R., Greenberg, Albert
Format: Journal Article
Language:English
Published: Elsevier B.V 01.11.2011
Subjects:
Algorithms
Cloud computing
Clouds
Design engineering
Load balancing
Load balancing (computing)
Queueing analysis
Randomized algorithm
Searching
Servers
Web services
Cloud computing
Load balancing
Randomized algorithm
Queueing analysis
ISSN:0166-5316, 1872-745X
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The prevalence of dynamic-content web services, exemplified by search and online social networking, has motivated an increasingly wide web-facing front end. Horizontal scaling in the Cloud is favored for its elasticity, and distributed design of load balancers is highly desirable. Existing algorithms with a centralized design, such as Join-the-Shortest-Queue ( JSQ), incur high communication overhead for distributed dispatchers. We propose a novel class of algorithms called Join-Idle-Queue ( JIQ) for distributed load balancing in large systems. Unlike algorithms such as Power-of-Two, the JIQ algorithm incurs no communication overhead between the dispatchers and processors at job arrivals. We analyze the JIQ algorithm in the large system limit and find that it effectively results in a reduced system load, which produces 30-fold reduction in queueing overhead compared to Power-of-Two at medium to high load. An extension of the basic JIQ algorithm deals with very high loads using only local information of server load.
Bibliography:ObjectType-Article-2
SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 23
ISSN:0166-5316
1872-745X
DOI:10.1016/j.peva.2011.07.015