Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Given a transition matrix, is the biggest component of the stationary distribution the one that correspond to the column whose sum of entries is the biggest among all columns?

(By "correspond" I mean $ \text{The } i\text{th component of the vector} \leftrightarrow \text{the }i\text{th column of the matrix}$)

It seems plausible since in the transition matrix the column with the biggest sum of the entries is the most "absorbing" state. My probability teacher told me he often asks his colleagues about this fact, never hearing it is a known fact.

share|cite|improve this question
up vote 2 down vote accepted

Here's another counterexample that may throw some light on why this isn't the case:


The last column has sum $2$, the first one $2-2\epsilon$, but the stationary distribution is concentrated almost entirely in the first state. This shows that it's not just the probabilities of transitions to a state that determine its stationary probability, but also the probabilities of transitions away from that state, and the stationary probabilities of the states that lead to it. In the example, though the first and last state have very similar probabilities for transitions to them, the first state has a much lower probability for a transition away from it.

share|cite|improve this answer
Thanks, now it's very intuitive why is not the case that such a thing had to hold. – Immanuel Weihnacht Oct 3 '11 at 21:01

Here is a counterexample:

$$P=\pmatrix{3/4&1/4&0\cr1/8&2/3&5/24\cr0&1/6&5/6},\quad \pi=\left({2\over11},{4\over11},{5\over11}\right).$$

The second column has the largest sum, but the second state has less probability than the third.

share|cite|improve this answer
Yes, $\pi$ is the unique stationary distribution. – Byron Schmuland Oct 3 '11 at 20:45
This is an irreducible, aperiodic Markov chain. – Byron Schmuland Oct 3 '11 at 20:46
yep, I relized that and deleted my comment before the page was updated with your answer, thanks. – Immanuel Weihnacht Oct 3 '11 at 20:48

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.