Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

It is known that for a regular Markov matrix $M,$ $M^{n}$ has the steady-state vector as all of its columns as $n \to \infty.$ I learned this in class, but what if there is more than one steady-state vector? What form does $M^{n}$ take? Do they switch alternatively one after another?

share|improve this question
1  
The regularity ensures that the process is irreducible and aperiodic, and in that case there's a single stationary distribution. –  joriki Nov 14 '11 at 10:42
add comment

1 Answer

up vote 1 down vote accepted

From the Perron-Frobenius Theorem we have that there is maximal simple eigenvalue $\lambda$ for $M$, meaning that the eigenspace associated to $M$ is one-dimensional. That is, up to a non-zero constant multiple we have exactly one eigenvector $\bf{v}$ associated to $\lambda$. The long-term behavior of $M^n \bf{u}$ for a non-zero vector $\bf{u}$ is independent of $\bf{u}$ and we have that $M^n \bf{v}$ approaches $\bf{v}$(in direction) for large $n$.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.