iNAV-drlSLAM: An Improved Indoor Self-Driving Framework for Mobile Robots using Deep Reinforcement Learning integrated with SLAM

We introduce a new navigation framework for mobile robots that combines Simultaneous Localization and Mapping (SLAM) and deep reinforcement learning (DRL) techniques. While SLAM algorithms are effective at mapping and navigating through the environment, they struggle to avoid dynamic obstacles and c...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:2023 15th International Conference on Advanced Computational Intelligence (ICACI) S. 1 - 8
Hauptverfasser: Nam, Seunghyeop, Woo, Changseok, Kang, Sinkyu, Nguyen, Tuan Anh, Min, Dugki
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 06.05.2023
Schlagworte:
Autonomy
Deep learning
Deep Reinforcement Learning
Heuristic algorithms
Indoor Self-navigation
Inference algorithms
Mobile Robot
Navigation
Q-learning
Scalability
Simultaneous localization and mapping
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:We introduce a new navigation framework for mobile robots that combines Simultaneous Localization and Mapping (SLAM) and deep reinforcement learning (DRL) techniques. While SLAM algorithms are effective at mapping and navigating through the environment, they struggle to avoid dynamic obstacles and can be computationally intensive. In contrast, DRL algorithms can manage dynamic situations but may result in sub-optimal performance when used alone. Our framework addresses this issue by using SLAM to generate a static path plan using the Ant Colony Optimization (ACO) algorithm. In dynamic environments, the robot follows the global path plan generated by SLAM and moves between way-points using a DRL-based local path planning algorithm. We evaluate the performance of three DRL-based navigation algorithms - Deep Q-Learning Network (DQN), Twin Delayed Deep Deterministic policy gradient (TD3), and Proximal Policy Optimization (PPO) - and compare them with existing navigation methods for mobile robots. Our approach overcomes the traditional reliance on static global and local maps, making it well-suited for dynamic environments. The proposed framework provides a promising alternative to current navigation methods for mobile robots, improving accuracy and efficiency while maintaining scalability and safety.
DOI:10.1109/ICACI58115.2023.10146173