Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Does a Markov chain with infinite recurrence states and infinite transience exists?

I believe it doesn't exists but I'm not sure how can I prove it.

Thanks guys! :D

share|improve this question
    
Irreducible? $ $ –  Did Mar 18 '13 at 12:07

1 Answer 1

up vote 2 down vote accepted

Consider the discrete-time Markov chain with infinitely many states $i=1,2,\ldots$, such that $P(X_t=i\mid X_{t-1}=i)=1$ when $i$ is odd, and $P(X_t=i+2\mid X_{t-1}=i)=1$ when $i$ is even. Then every odd-indexed state is a recurrent state and every even-indexed state is a transcient state.

share|improve this answer
    
Thanks :) What was your thought process about coming up with this example? Any tips on how to approach such questions? –  Amanda Mar 18 '13 at 18:25
1  
@Mankochka The simplest example that every state is recurrent is that every state remains unchanged. The simplest example that every state is transcient is a "right-shift", i.e. every state only transits to the next. Now I merely glue the two examples together by interlacing those states from the two chains according to the parities of indices. –  user1551 Mar 18 '13 at 19:01

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.