Tank War Using Online Reinforcement Learning

Real-Time Strategy(RTS) games provide a challenging platform to implement online reinforcement learning(RL) techniques in a real application. Computer as one player monitors opponents'(human or other computers) strategies and then updates its own policy using RL methods. In this paper, we propo...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 02 Jg. 2; S. 497 - 500
Hauptverfasser: Andersen, Kresten Toftgaard, Zeng, Yifeng, Christensen, Dennis Dahl, Tran, Dung
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: Washington, DC, USA IEEE Computer Society 15.09.2009
IEEE
Schriftenreihe:ACM Conferences
Schlagworte:
Application software
Cities and towns
Computer applications
Computer science
Computing methodologies > Artificial intelligence > Control methods
Computing methodologies > Artificial intelligence > Search methodologies
Computing methodologies > Machine learning
Computing methodologies > Modeling and simulation > Model development and analysis > Modeling methodologies
Conferences
Humans
Intelligent agent
Learning
Real-Time Strategy Game
Reinforcement Learning
State-space methods
Testing
Theory of computation > Design and analysis of algorithms > Algorithm design techniques > Dynamic programming
Theory of computation > Design and analysis of algorithms > Online algorithms > Online learning algorithms
Theory of computation > Models of computation > Interactive computation
Theory of computation > Theory and algorithms for application domains > Machine learning theory > Online learning theory
Real-Time Strategy Game
Reinforcement Learning
ISBN:0769538010, 9780769538013
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Real-Time Strategy(RTS) games provide a challenging platform to implement online reinforcement learning(RL) techniques in a real application. Computer as one player monitors opponents'(human or other computers) strategies and then updates its own policy using RL methods. In this paper, we propose a multi-layer framework for implementing the online RL in a RTS game. The framework significantly reduces the RL computational complexity by decomposing the state space in a hierarchical manner. We implement the RTS game - Tank General, and perform a thorough test on the proposed framework. The results show the effectiveness of our proposed framework and shed light on relevant issues on using the RL in RTS games.
ISBN:0769538010
9780769538013
DOI:10.1109/WI-IAT.2009.201