Question: $P$ is the transition matrix of a finite state space Markov chain. Which of the following statements are necessarily true?
$1.$ If $P$ is irreducible, then $P^2$ is irreducible.
$2.$ If $P$ is not irreducible then $P^2$ is not irreducible.
$3.$ If $P$ is irreducible then $\frac{I+P}{2} $ is irreducible.
$4.$ If $P$ is irreducible and aperiodic, then $P^3$ is irreducible.
Mt Attempt: For $(1)$, I found a counterexample, take $P= \left[ \begin{matrix} 0&1 \\ 1&0 \end{matrix} \right]$. Here, $P$ is irreducible but $P^2=I$, which is reducible. I tried some examples for $(2),(3)$ and $(4)$ but they could not find any counterexample for these, I guess that last three options are correct, however, I was unable to prove them.
Kindly help me to prove the last three options. Is there any theorem regarding these results? Can these results be generalized for $P^n$? Thank you so much for your effort(s)!