Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Does a Markov chain with infinitely many recurrent states and infinitely many transient states exist?

I believe it doesn't exists but I'm not sure how can I prove it.

Thanks guys! :D

share|cite|improve this question
Irreducible? $ $ – Did Mar 18 '13 at 12:07
up vote 2 down vote accepted

Consider the discrete-time Markov chain with infinitely many states $i=1,2,\ldots$, such that $P(X_t=i\mid X_{t-1}=i)=1$ when $i$ is odd, and $P(X_t=i+2\mid X_{t-1}=i)=1$ when $i$ is even. Then every odd-indexed state is a recurrent state and every even-indexed state is a transient state.

share|cite|improve this answer
Thanks :) What was your thought process about coming up with this example? Any tips on how to approach such questions? – Manko Mar 18 '13 at 18:25
@Mankochka The simplest example that every state is recurrent is that every state remains unchanged. The simplest example that every state is transcient is a "right-shift", i.e. every state only transits to the next. Now I merely glue the two examples together by interlacing those states from the two chains according to the parities of indices. – user1551 Mar 18 '13 at 19:01

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.