I am monitoring a Markov process with ~21 states. I know all the states, initial state and what states transitions can/cannot be, so that zero elements of transition matrix are known.
I know the probability matrix P after k number of transitions and I want to calculate the transition matrix.
According to formula I need to perform k-root extraction from P, but I do not know how exactly.
Please guide me.