Neighborhood search-based job scheduling for IoT big data real-time processing in distributed edge-cloud computing environment

Cloud-edge collaboration architecture, which combines edge processing and centralized cloud processing, is suitable for placement and caching of streaming media. A cache-aware scheduling model based on neighborhood search is proposed. The model is divided into four sub-problems: job classification,...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:The Journal of supercomputing Jg. 77; H. 2; S. 1853 - 1878
Hauptverfasser: Li, Chunlin, Zhang, YiHan, Luo, Youlong
Format: Journal Article
Sprache:Englisch
Veröffentlicht: New York Springer US 01.02.2021
Springer Nature B.V
Schlagworte:
Algorithms
Caching
Cloud computing
Clustering
Compilers
Computer Science
Data centers
Interpreters
Job classification
Neighborhoods
Nodes
Placement
Processor Architectures
Programming Languages
Resource allocation
Scheduling
Searching
Streaming media
Neighborhood search
Distributed edge-cloud
Job scheduling
ISSN:0920-8542, 1573-0484
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Cloud-edge collaboration architecture, which combines edge processing and centralized cloud processing, is suitable for placement and caching of streaming media. A cache-aware scheduling model based on neighborhood search is proposed. The model is divided into four sub-problems: job classification, node resource allocation, node clustering, and cache-aware job scheduling. Firstly, jobs are categorized into three categories, and then different resources are allocated to nodes according to different job execution conditions. Secondly, the nodes with similar capabilities are clustered, and the jobs are cached by delay-waiting. For jobs that do not satisfy the data locality, the jobs are scheduled to the nodes with similar capabilities according to the neighborhood search results. Meanwhile, a cache-aware scheduling algorithm based on neighborhood search is proposed. Experiments show that the proposed algorithm can effectively minimize the delay of content transmission and the cost of content placement, the job execution time is shortened and the processing capacity of the cloud data center is improved.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0920-8542
1573-0484
DOI:10.1007/s11227-020-03343-6