Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I'm stuck with this question saying that, we have a homogeneous MC which is indecomposable and aperiodic, if $\tau$ is the random time of return back to any fixed state. Show that there exist $C>0$ and $q<1$ such that $P(\tau>n) \leq Cq^{n}$. I'm not sure whether the question is missing some information about what's $q$ here. Does anyone have an idea?

share|cite|improve this question
I guess you should assume that your MC is finite, otherwise $\tau$ can be infinite. – Ilya Nov 7 '11 at 10:23
yes, probably that's one assumption i need. but how do i start to prove that inequality anyway? – Math Nov 7 '11 at 10:37

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.