Problem:
Given a square $ABCD$, $AB$ being an horizontal vertex, we start at $A$. With each step, we move to another corner:
- horizontally with a probability $p$
- vertically with a probability $q$
- to the opposite corner (along the diagonal) with a probability $r$.
What is the probability, after $n$ steps, to be in $A$, $B$, $C$ or $D$?
Attempt to find solution:
If $A_n$, etc. denotes the probability to be in $A$, etc. before the $n$-th step, and if $$ X_n = (A_n, B_n, C_n, D_n) $$ we find a relation $X_{n+1} = X_n \cdot M$, with $$ M = \left (\begin{array}{cccc} 0&p&r&q\\ p&0&q&r\\ r&q&0&p\\ q&r&p&0 \end{array} \right ). $$ This matrix is symmetrical hence can be diagonalized. But, it seems that it may be too complicated to do.
Questions:
- Am I missing another argument? We know that $p+q+r=1$, of course. And we know that $A_n+B_n+C_n+D_n=1$ but I don't feel that it will simplify the difficulty of the diagonalization.
- Is $M$ easily diagonalizable? $1$ is a eigen vector for the eigen value $1$.