0
$\begingroup$

I am aware of the existence of the following questions: How to discretely stochastically simulate a continuous-time Markov chain? Recipe to discretize a continuous- time markov process

I tried to understand them, but frankly, I couldn't.

Like in discreet time Markov chain, I want to find the probability of being in state $j$ at interval $k$ (discretized). I know of the rate matrix and initial probability distribution. How would I do that?

References will be appreciated.

$\endgroup$
0
$\begingroup$

The following reference perfectly answers my question:

DOYTCHINOV, BOGDAN, and RACHEL IRBY. "TIME DISCRETIZATION OF MARKOV CHAINS." Pi Mu Epsilon Journal 13, no. 2 (2010): 69-82. http://www.jstor.org/stable/24340803.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.