Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

I am monitoring a Markov process with ~21 states. I know all the states, initial state and what states transitions can/cannot be, so that zero elements of transition matrix are known.

I know the probability matrix P after k number of transitions and I want to calculate the transition matrix.

According to formula I need to perform k-root extraction from P, but I do not know how exactly.

Please guide me.

share|improve this question

migrated from mathoverflow.net Apr 23 at 19:25

This question came from our site for professional mathematicians.

1 Answer 1

You could try Rice iteration to calculate the transition matrix $T=P^{1/k}$, which should work if $P$ is symmetric positive definite. The iteration starts with $T_0=0$ and then proceeds via

$$T_{n+1}=T_n + \frac{1}{k}(P-T_n^k)$$

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.