View in EDS

UniROS: ROS-Based Reinforcement Learning Across Simulated and Real-World Robotics.

Saved in:
Bibliographic Details
Title: UniROS: ROS-Based Reinforcement Learning Across Simulated and Real-World Robotics.
Authors: Kapukotuwa, Jayasekara, Lee, Brian, Devine, Declan, Qiao, Yuansong
Source: Sensors (14248220); Sep2025, Vol. 25 Issue 18, p5679, 44p
Subject Terms: REINFORCEMENT learning, ROBOTICS, ROBOTS, ROBOTICS software, SEQUENTIAL learning, AUTONOMOUS robots, AGGREGATION (Robotics)
Abstract: Highlights: What are the main findings? We developed UniROS, a unified ROS-based reinforcement learning framework that supports real-time learning across both simulated and physical robots. We demonstrated asynchronous, concurrent control of multiple real and simulated robots using UniROS, effectively reducing latency and improving scalability. What are the implications of the main findings? This enables more efficient and realistic training of multiple robotic agents in the real world, addressing the limitations of existing sequential single-robot frameworks. It facilitates learning across different robots and network conditions, accelerating the deployment of real-world reinforcement learning systems. Reinforcement Learning (RL) enables robots to learn and improve from data without being explicitly programmed. It is well-suited for tackling complex and diverse robotic tasks, offering adaptive solutions without relying on traditional, hand-designed approaches. However, RL solutions in robotics have often been confined to simulations, with challenges in transferring the learned knowledge or learning directly in the real world due to latency issues, lack of a standardized structure, and complexity of integration with real robot platforms. While the use of Robot Operating System (ROS) provides an advantage in addressing these challenges, existing ROS-based RL frameworks typically support sequential, turn-based agent-environment interactions, which fail to represent the continuous, dynamic nature of real-time robotics or support robust multi-robot integration. This paper addresses this gap by proposing UniROS, a novel ROS-based RL framework explicitly designed for real-time multi-robot/task applications. UniROS introduces a ROS-centric implementation strategy for creating RL environments that support asynchronous and concurrent processing, which is pivotal in reducing the latency between agent-environment interactions. This study validates UniROS through practical robotic scenarios, including direct real-world learning, sim-to-real policy transfer, and concurrent multi-robot/task learning. The proposed framework, including all examples and supporting packages developed in this study, is publicly available on GitHub, inviting wider use and exploration in the field. [ABSTRACT FROM AUTHOR]
Copyright of Sensors (14248220) is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Complementary Index
Description
Abstract:Highlights: What are the main findings? We developed UniROS, a unified ROS-based reinforcement learning framework that supports real-time learning across both simulated and physical robots. We demonstrated asynchronous, concurrent control of multiple real and simulated robots using UniROS, effectively reducing latency and improving scalability. What are the implications of the main findings? This enables more efficient and realistic training of multiple robotic agents in the real world, addressing the limitations of existing sequential single-robot frameworks. It facilitates learning across different robots and network conditions, accelerating the deployment of real-world reinforcement learning systems. Reinforcement Learning (RL) enables robots to learn and improve from data without being explicitly programmed. It is well-suited for tackling complex and diverse robotic tasks, offering adaptive solutions without relying on traditional, hand-designed approaches. However, RL solutions in robotics have often been confined to simulations, with challenges in transferring the learned knowledge or learning directly in the real world due to latency issues, lack of a standardized structure, and complexity of integration with real robot platforms. While the use of Robot Operating System (ROS) provides an advantage in addressing these challenges, existing ROS-based RL frameworks typically support sequential, turn-based agent-environment interactions, which fail to represent the continuous, dynamic nature of real-time robotics or support robust multi-robot integration. This paper addresses this gap by proposing UniROS, a novel ROS-based RL framework explicitly designed for real-time multi-robot/task applications. UniROS introduces a ROS-centric implementation strategy for creating RL environments that support asynchronous and concurrent processing, which is pivotal in reducing the latency between agent-environment interactions. This study validates UniROS through practical robotic scenarios, including direct real-world learning, sim-to-real policy transfer, and concurrent multi-robot/task learning. The proposed framework, including all examples and supporting packages developed in this study, is publicly available on GitHub, inviting wider use and exploration in the field. [ABSTRACT FROM AUTHOR]
ISSN:14248220
DOI:10.3390/s25185679