Curiosity-driven acquisition of sensorimotor concepts using memory-based active learning

Operating in real-world environments, a robot will need to continuously learn from its experience to update and extend its knowledge. The paper focuses on the specific problem of how a robot can efficiently select information that is ldquointerestingrdquo, driving the robot's ldquocuriosityrdqu...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2008 IEEE International Conference on Robotics and Biomimetics s. 665 - 670
Hlavní autoři: Roa, S., Kruijff, G.-J.M., Jacobsson, H.
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 01.02.2009
Témata:
ISBN:9781424426782, 1424426782
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Operating in real-world environments, a robot will need to continuously learn from its experience to update and extend its knowledge. The paper focuses on the specific problem of how a robot can efficiently select information that is ldquointerestingrdquo, driving the robot's ldquocuriosityrdquo. The paper investigates the hypothesis that curiosity can be emulated through a combination of active learning, and reinforcement learning using intrinsic and extrinsic rewards. Intrinsic rewards quantify learning progress, providing a measure for ldquointerestingnessrdquo of observations, and extrinsic rewards direct learning using the robot's interactions with the environment and other agents. The paper describes the approach, and experimental results obtained in simulated environments. The results indicate that both intrinsic and extrinsic rewards improve learning progress, measured in the number of training cycles to achieve a goal. The approach presented here extends previous approaches to curiosity-driven learning, by including both intrinsic and extrinsic rewards, and by considering more complex sensorimotor input.
ISBN:9781424426782
1424426782
DOI:10.1109/ROBIO.2009.4913080