0
votes
0answers
78 views

Markov Chain : Montonicity of Sample Mean

Let $\{X_n\}_{n\geq1}$ be an irreducible, ergodic Markov chain with discrete state-space $S$, transition probability matrix $P$ and steady state distribution $\pi = \{\pi_j\}_{j\in S}$. Let $f$ be a ...
3
votes
2answers
353 views

How can I compare two Markov processes?

There is a discrete-time irreductible Markov process with $r$ possible states. $k$ observations were performed. At each observation a state of process was determined. $T_0 = \lbrace 0,1,\dots ...