Experimental Study on Path Planning Algorithms for Warehouse Mobile Robot Based on Reinforcement Learning

Planning in mobile robots is an essential task because it helps to achieve efficient movement in terms of time, computational resources, and safety. Warehouse robots, for example, are equipped with sensors and cameras to avoid obstacles and to move products around the warehouse pick and pack orders....

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:IEEE NW Russia Young Researchers in Electrical and Electronic Engineering Conference s. 170 - 175
Hlavní autori: Hammoud, Moahmmed, Haydar, Ola, Lupin, Sergey
Médium: Konferenčný príspevok..
Jazyk:English
Vydavateľské údaje: IEEE 29.01.2024
Predmet:
machine learning
Mobile robot
Multi-category classification
SCITOS G5
wall-following robot
ISSN:2376-6565
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Planning in mobile robots is an essential task because it helps to achieve efficient movement in terms of time, computational resources, and safety. Warehouse robots, for example, are equipped with sensors and cameras to avoid obstacles and to move products around the warehouse pick and pack orders. In this project, we have used path-planning algorithms based on Reinforcement Learning (RL), which include Q-learning (QL), State-Action-Reward-State-Action (SARSA), and Expected SARSA (ESARSA). We evaluated these algorithms on a benchmark dataset with different sizes and obstacle densities. Our findings show that QL produces a more optimal path, but the path is risky since it is close to obstacles. On the other hand, SARSA produces a safer path. However, in terms of convergence speed, SARSA is slow, while ESARSA is faster and more stable but with extra computations.
ISSN:2376-6565
DOI:10.1109/ElCon61730.2024.10468257