0
$\begingroup$

What are the difference and relation between a Markov jump process and a continuous-time discrete-state Markov process?

By "a continuous-time discrete-state Markov process", I understand it same as a continuous-time Markov chain.

Is a "jump process" here same concept as a discrete-state process?

Thanks and regards!

$\endgroup$
1
$\begingroup$

Presumably because not all jump processes are not Markov jump processes.

Also jump processes do not have discrete space. Take a compound Poisson process, for example, that is a process for which jumps happen at a fixed rate $\lambda$, but the jump distribution is not a constant 1, but instead can be a distribution (which may be continuous), therefore the space is not discrete.

Also there are also jump processes, which has independent increment property (and markov property) but are not compound Poisson process. These processes, with Brownian motions are the only processes with independent increment properties. they are called Levy processes.

Notice jump continuous-time discrete space and compound Poisson process has finite variation, but this is not necessarily the case with general Levy processes (even without the Brownian motion component), which are pure jump processes.

Of course, this is only a small class of Markovian jump processes. I am sure there are plenty of others which I have not mentioned here. Also there are markov processes for which the transition probability is time dependent, but these won't have the Q matrices as generator which you might have had in mind.

$\endgroup$
  • $\begingroup$ THanks! So the state space of a jump process is continuous, not discrete? $\endgroup$ – Tim Apr 14 '13 at 22:29
  • $\begingroup$ not necessarily. Poisson processes and the continuous time discrete space processes are jump processes I would say. Generally, the ones people use for financial modelling (mentioned in one of your links, as extensions of Black scholes) tend to have continuous space. $\endgroup$ – Lost1 Apr 14 '13 at 22:31

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.