The Monte Carlo computation error of transition probabilities

In many applications one is interested to compute transition probabilities of a Markov chain. This can be achieved by using Monte Carlo methods with local or global sampling points. In this article, we analyze the error by the difference in the L2 norm between the true transition probabilities and t...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Statistics & probability letters Ročník 118; s. 163 - 170
Hlavný autor: Nielsen, Adam
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Elsevier B.V 01.11.2016
Predmet:
Computation error
Markov operator
Measurable state space
Monte Carlo methods
Reversible Markov chain
Monte Carlo methods
Reversible Markov chain
Measurable state space
Markov operator
Computation error
ISSN:0167-7152, 1879-2103
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:In many applications one is interested to compute transition probabilities of a Markov chain. This can be achieved by using Monte Carlo methods with local or global sampling points. In this article, we analyze the error by the difference in the L2 norm between the true transition probabilities and the approximation achieved through a Monte Carlo method. We give a formula for the error for Markov chains with locally computed sampling points. Further, in the case of reversible Markov chains, we will deduce a formula for the error when sampling points are computed globally. We will see that in both cases the error itself can be approximated with Monte Carlo methods. As a consequence of the result, we will derive surprising properties of reversible Markov chains.
ISSN:0167-7152
1879-2103
DOI:10.1016/j.spl.2016.06.011