Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Let $p(x,y)$ denote the transition probability of a markov chain. Similarly, let $p^n(x,y)$ be the n-step transition probability. My question is, is there a formal name for $S(x,y):=\sup_n p^n(x,y)$. Notice that if the Markov chain is irreducible, then $\lim_{n\rightarrow\infty}p^n(x,y)=\pi(y)$, where $\pi$ is the stationary distribution. Of course, the supremum usually occurs much earlier at some finite $n$. I would greatly appreciate any references to the usage of $S(x,y)$ in some recent papers.

share|improve this question
    
I don't see, what the fact that $p^n(x,y)\to \pi(y)$ with $n\to\infty$ tells us anything useful about the supremum. Especially, taking into account that the convergence is seldom monotonic. The notion of $S$ I've never met, so I wonder whether you've found it useful for some problems. –  S.D. Dec 4 '12 at 7:27

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.