Im trying to come to grips with what the physical interpretation of a non diagonalisable Markov Matrix means in terms of what we can deduce about it having a limiting distribution/ what potential limiting distributions would be. Please refer to this question: Example of a Markov chain transition matrix that is not diagonalizable? where the Answer shows a transition matrix, $P$ that is recurrent and defective (i.e. non diagonalisable).
This is interesting because I like to think of the fact that for non defective $P$, I can express any initial valid distribution vector $\mathbf{x}^0$, (satisfying $\sum_i x_i^0 = 1$ ) as a linear combination of the left eigenvectors of $P$. This is nice because $\mathbf{x}^{\infty} = \lim_{n\to \infty} \mathbf{x}^0P^n$ will then no longer contain any components of those eigenvectors whose corresponding eigenvalues $|\lambda|<1$. However if $P$ is defective we can't necessarily express any initial distribution in terms of the eigenvectors and hence can't draw any conclusions of what the limiting distributions will look like, if they exist. Is this the end of the story or is there something else I'm missing.
