Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

I'm stuck with this question saying that, we have a homogeneous MC which is indecomposable and aperiodic, if $\tau$ is the random time of return back to any fixed state. Show that there exist $C>0$ and $q<1$ such that $P(\tau>n) \leq Cq^{n}$. I'm not sure whether the question is missing some information about what's $q$ here. Does anyone have an idea?

share|improve this question
    
I guess you should assume that your MC is finite, otherwise $\tau$ can be infinite. –  Ilya Nov 7 '11 at 10:23
    
yes, probably that's one assumption i need. but how do i start to prove that inequality anyway? –  Math Nov 7 '11 at 10:37
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.