On discounted approximations of undiscounted stochastic games and Markov decision processes with limited randomness

It is shown that the discount factor needed to solve an undiscounted mean payoff stochastic game to optimality is exponentially close to 1, even in one-player games with a single random node and polynomially bounded rewards and transition probabilities. For the class of the so-called irreducible gam...

Full description

Saved in:
Bibliographic Details
Published in:Operations research letters Vol. 41; no. 4; pp. 357 - 362
Main Authors: Boros, Endre, Elbassioni, Khaled, Gurvich, Vladimir, Makino, Kazuhisa
Format: Journal Article
Language:English
Published: Elsevier B.V 01.07.2013
Subjects:
ISSN:0167-6377, 1872-7468
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:It is shown that the discount factor needed to solve an undiscounted mean payoff stochastic game to optimality is exponentially close to 1, even in one-player games with a single random node and polynomially bounded rewards and transition probabilities. For the class of the so-called irreducible games with perfect information and a constant number of random nodes, we obtain a pseudo-polynomial algorithm using discounts.
ISSN:0167-6377
1872-7468
DOI:10.1016/j.orl.2013.04.006