INCdeep: Intelligent Network Coding with Deep Reinforcement Learning

In this paper, we address the problem of building adaptive network coding coefficients under dynamic network conditions (e.g., varying link quality and changing number of relays). In existing linear network coding solutions including deterministic network coding and random linear network coding, cod...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Annual Joint Conference of the IEEE Computer and Communications Societies S. 1 - 10
Hauptverfasser: Wang, Qi, Liu, Jianmin, Jaffres-Runser, Katia, Wang, Yongqing, He, Chentao, Liu, Cunzhuang, Xu, Yongjun
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 10.05.2021
Schlagworte:
Adaptive systems
Buildings
Deep Reinforcement learning
Fountain codes
Heuristic algorithms
Intelligent networks
Network coding
Reinforcement learning
RLNC
Simulation
ISSN:2641-9874
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:In this paper, we address the problem of building adaptive network coding coefficients under dynamic network conditions (e.g., varying link quality and changing number of relays). In existing linear network coding solutions including deterministic network coding and random linear network coding, coding coefficients are set by a heuristic or randomly chosen from a Galois field with equal probability, which can not adapt to dynamic network conditions with good decoding performance. We propose INCdeep, an adaptive Intelligent Network Coding with Deep Reinforcement Learning. Specifically, we formulate a coding coefficients selection problem where network variations can be automatically and continuously expressed as the state transitions of a Markov decision process (MDP). The key advantage is that INCdeep is able to learn and dynamically adjust the coding coefficients for the source node and each relay node according to ongoing network conditions, instead of randomly. The results show that INCdeep has generalization ability that adapts well in dynamic scenarios where link quality is changing fast, and it converges fast in the training process. Compared with the benchmark coding algorithms, INCdeep shows superior performance, including higher decoding probability and lower coding overhead through simulations and experiments.
ISSN:2641-9874
DOI:10.1109/INFOCOM42981.2021.9488770