Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Are there any necessary and sufficient conditions for a Markov chain to be null recurrent? What about sufficient conditions?

Naturally, I am not looking for tautological statements, e.g., a Markov chain is null recurrent if and only if it is recurrent and has no stationary distribution.

For example, one can consider various random walks on the integers or on infinite directed graphs; how might I figure out whether a particular such walk is null-recurrent or not, except by writing out the recurrence equations and trying to reason from there?

share|improve this question
1  
are you familiar with Gambler's ruin problem? –  Alex Oct 10 '12 at 21:04
    
+1. Have you found the answer? –  Tim Apr 14 '13 at 16:30
add comment

1 Answer

A simple example: Gambler's ruin problem.

If $p>\frac{1}{2}$, then the Geometric series $\sum_{k=0}^{\infty}\big( \frac{p}{q} \big)^k$ diverges, hence this is a transient MC, if $p<\frac{1}{2}$, then the Geometric series $\sum_{k=0}^{\infty}\big( \frac{p}{q} \big)^k$ converges to $\frac{1}{1-\frac{p}{q}}$, hence this is a positive-recurrent MC. If $p=q=\frac{1}{2}$, this is a null-recurrent MC, i.e. the probability of ruin is 1, but mean time to it is $\infty$.

Hence just by looking at these probabilities you can tell what kind of MC you have and do not need to construct recurrent equations.

share|improve this answer
    
I am aware of this. My question is about the most general case of a Markov chain with countable state-space. –  robinson Oct 10 '12 at 21:41
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.