Dynamic load balancing algorithm for large data flow in distributed complex networks

Information society brings convenience to people, but also produces a lot of data. Relational databases are not suitable for processing big data due to architecture defects. The most commonly used system to store and process large amounts of data is the NoSQL (Not only Structured Query Language) dat...

Celý popis

Uloženo v:

Podrobná bibliografie
Vydáno v:	Open Physics Ročník 16; číslo 1; s. 706 - 716
Hlavní autor:	Zhang, Zhuo
Médium:	Journal Article
Jazyk:	angličtina
Vydáno:	De Gruyter 01.01.2018
Témata:	05.90.+m 07.05.Tp load balancing algorithm, distributed Mass Data Storage System NoSQL sorted binary tree
ISSN:	2391-5471, 2391-5471
On-line přístup:	Získat plný text
Tagy:	Přidat tag Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!

Popis
Shrnutí:	Information society brings convenience to people, but also produces a lot of data. Relational databases are not suitable for processing big data due to architecture defects. The most commonly used system to store and process large amounts of data is the NoSQL (Not only Structured Query Language) database. Obviously, it is very important to cooperate with these independent computers to accomplish processing tasks efficiently, which is the function of load balancing. This paper studies the commonly used NoSQL database and load balancing algorithms, and designs and implements a more efficient load balancing algorithm. By introducing the relationship between nodes and the children of their brother nodes, we reduce the height of the whole sorted binary tree. The time cost of the algorithm is reduced versus the commonly used weighted polling algorithm O(N) to O(log N), while the spatial cost remains unchanged. The equalization algorithm synthetically utilizes the characteristics of big data processing systems and has good performance. At the same time, the algorithm can quickly find the sub-optimal nodes when the optimal nodes have been occupied, so it is very suitable for load balancing in highly concurrent systems. Finally, the effectiveness of the proposed load balancing algorithm is verified by simulation.
ISSN:	2391-5471 2391-5471
DOI:	10.1515/phys-2018-0089