On discounted approximations of undiscounted stochastic games and Markov decision processes with limited randomness
It is shown that the discount factor needed to solve an undiscounted mean payoff stochastic game to optimality is exponentially close to 1, even in one-player games with a single random node and polynomially bounded rewards and transition probabilities. For the class of the so-called irreducible gam...
Saved in:
| Published in: | Operations research letters Vol. 41; no. 4; pp. 357 - 362 |
|---|---|
| Main Authors: | , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
Elsevier B.V
01.07.2013
|
| Subjects: | |
| ISSN: | 0167-6377, 1872-7468 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | It is shown that the discount factor needed to solve an undiscounted mean payoff stochastic game to optimality is exponentially close to 1, even in one-player games with a single random node and polynomially bounded rewards and transition probabilities. For the class of the so-called irreducible games with perfect information and a constant number of random nodes, we obtain a pseudo-polynomial algorithm using discounts. |
|---|---|
| ISSN: | 0167-6377 1872-7468 |
| DOI: | 10.1016/j.orl.2013.04.006 |