# Questions tagged [markov-process]

A stochastic process satisfying the Markov property: the distribution of the future states given the value of the current state does not depend on the past states. Use this tag for general state space processes (both discrete and continuous times); use (markov-chains) for countable state space processes.

101 questions
3answers
8k views

### What is the importance of the infinitesimal generator of Brownian motion?

I have read that the infinitesimal generator of Brownian motion is $\frac{1}{2}\small\triangle$. Unfortunately, I have no background in semigroup theory, and the expositions of semigroup theory I have ...
2answers
5k views

### Transformation of state-space that preserves Markov property

I am solving a problem in Mathematical Statistics by Jun Shao Let $\{X_n \}$ be a Markov chain. Show that if $g$ is a one-to-one Borel function, then $\{g(X_n )\}$ is also a Markov chain. Give an ...
1answer
526 views

0answers
131 views

2answers
11k views

2answers
148 views

### Show that the carré du champ operator is nonnegative

Let $(E,\mathcal E)$ be a measurable space $\mathcal M_b(E,\mathcal E):=\left\{f:E\to\mathbb R\mid f\text{ is bounded and }\mathcal E\text{-measurable}\right\}$ $(\kappa_t)_{t\ge0}$ be a Markov ...
1answer
188 views

### Building a hidden markov model with an absorbing state.

I'm working on trying to implement a hidden markov model to model the affect of a specific protein that can cut an RNA when the ribosome is translating the RNA slowly. Some brief background: The ...
1answer
166 views

### Markov property w.r.t. a countable state space

Background Let $\left(X_t\right)_{t \in I}$ ($I\subseteq\mathbb R$) be an $E$-valued stochastic process ($E$ being a Polish space with the Borel $\sigma$-algebra $\mathcal{B}\left(E\right)$) equipped ...
2answers
970 views

### Markov Chain and Forward and Backward Probabilities with Alice and Bob

System Alice and Bob are moving independently from one city to another. There are $d$ cities, the probability of moving to another city (for each individual) is $m$ and each move is equiprobable (...
0answers
43 views
+50

2answers
508 views

### A Markov process which is not strong Markov process (follow up 2)

In https://mathoverflow.net/questions/43833/a-markov-process-which-is-not-a-strong-markov-process George Lowther's example: "Consider the following continuous Markov process $X$, starting from ...
2answers
1k views

2answers
556 views

### Markovian Gaussian stationary process with continuous paths

Could you, please, help me figure out the following problem. We call a stationary Gaussian process $\xi_t$ (with continuous paths) an Ornstein-Uhlenbeck process if its correlation function \$\mathbb{...