Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I am monitoring a Markov process with ~21 states. I know all the states, initial state and what states transitions can/cannot be, so that zero elements of transition matrix are known.

I know the probability matrix P after k number of transitions and I want to calculate the transition matrix.

According to formula I need to perform k-root extraction from P, but I do not know how exactly.

Please guide me.

share|cite|improve this question

migrated from Apr 23 '14 at 19:25

This question came from our site for professional mathematicians.

You could try Rice iteration to calculate the transition matrix $T=P^{1/k}$, which should work if $P$ is symmetric positive definite. The iteration starts with $T_0=0$ and then proceeds via

$$T_{n+1}=T_n + \frac{1}{k}(P-T_n^k)$$

share|cite|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.