Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

For a Markov chain, I define a reversible distribution to be a distribution wrt which the MC is reversible to. A stationary distribution is defined as a distribution that once reached will stay. A reversible distribution is a stationary distribution. But not vice versa.

I was wondering if a MC that has a reversible distribution can have a stationary distribution which is not a reversible distribution?

My question comes from Wikipedia:

Let $X$ be a finite set and let $K(x,y)$ be the transition probability for a reversible Markov chain on $X$. Assume this chain has stationary distribution $\pi$.

$\pi$ seems to be used as a reversible distribution in the article. I was wondering why it doesn't say $\pi$ is a distribution wrt which the MC is reversible.

Thanks and regards!

share|improve this question

1 Answer 1

up vote 0 down vote accepted

For an irreducible Markov chain, a stationary distribution exists if and only if all states are positive recurrent. When this condition is met, the stationary distribution is unique.

Thus, if a Markov chain (reversible or not) is irreducible and has a stationary distribution, this stationary distribution is unique.

If a Markov chain on a finite set is reversible in the sense that $\mu(x)K(x,y)=\mu(y)K(y,x)$ for every $x$ and $y$, for some measure $\mu$, then $\pi=\mu/|\mu|$ is a stationary distribution. Thus, if a Markov chain on a finite set is reversible and irreducible, it has exactly one stationary distribution, which is reversible.

share|improve this answer
    
+1 Thanks! So I guess that Wikipedia article should add: the finite-state reversible MC is additionally irreducible. Can I also guess for a general reversible MC, there might be a stationary distribution which is not reversible? –  Tim Dec 13 '12 at 16:45
    
It seems to me that this does not answer the op questions. The question was if it is possible for a reversible Markov chain to posses a non-reversible stationary distribution. –  Adam Jun 22 at 9:59
    
@Adam Please read slowly: "if a Markov chain on a finite set is reversible and irreducible, it has exactly one stationary distribution, which is reversible." –  Did Jun 22 at 15:22
    
I am not saying that your answer is wrong, I am just saying that the op question is still open. –  Adam Jun 22 at 15:51
    
@Adam Yes. And I think this statement is false. –  Did Jun 22 at 15:51

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.