Dynamic Routing Algorithm with Q-learning for Internet of things with Delayed Estimator

With the popularity of the Internet of things (IoT), tremendous objects are connected to the network, making the network topology complex. Mechanical engineering achieves intelligent identification, positioning, tracking, monitoring and management of engineering machinery through the IoT, where info...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:IOP conference series. Earth and environmental science Ročník 234; číslo 1; s. 12048 - 12055
Hlavní autoři: Wang, Fang, Feng, Renjun, Chen, Haiyan
Médium: Journal Article
Jazyk:angličtina
Vydáno: Bristol IOP Publishing 08.03.2019
Témata:
Algorithms
Internet of Things
Machine learning
Mechanical engineering
Network topologies
Topology
ISSN:1755-1307, 1755-1315, 1755-1315
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:With the popularity of the Internet of things (IoT), tremendous objects are connected to the network, making the network topology complex. Mechanical engineering achieves intelligent identification, positioning, tracking, monitoring and management of engineering machinery through the IoT, where information exchange and communication require novel intelligent routing algorithms as traditional routing algorithms are unfit for current network environment. Q-routing implemented a dynamic adjustment which was based on the network environment by combining the Q-learning algorithm. However, Q-routing is a highly random network environment and leads to a decline in performance because of overestimation of values. To solve the problem, we propose an algorithm called Delayed Q-routing (DQ-routing), which uses two sets of value functions to carry out random delayed updates so as to reduce the overestimation of the value function and improve the rate of convergence. The experiments indicate that DQ-routing algorithm gets well performance in several problems.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1755-1307
1755-1315
1755-1315
DOI:10.1088/1755-1315/234/1/012048