# Tagged Questions

A stochastic process satisfying the Markov property: the distribution of the future states given the value of the current state does not depend on the past states. Use this tag for general state space processes (both discrete and continuous times); use (markov-chains) for countable state space ...

114 views

111 views

### Stochastic variables independent given Tau

Say we have a filtration $(\mathbb{F}_s)$, and a stopping time $\tau$ w.r.t. to that filtration.Let $X_t$ be a continuous stochastic process (not required to be adapted to the mentioned filtration), ...
157 views

### Joint distribution of Brownian motion and its running maximum

$B$ being standard Brownian motion, its running maximum is defined as $M_t = \sup_{0\leq s\leq t} B_s$. I am trying to follow the proof of the following result but I don't understand some of the steps ...
107 views

### Markov and strong Markov properties

In my study of strong Markov property of an RCLL canonical Markov process I encounter the following definition: Suppose $Y_t:\omega\rightarrow \omega(t)$ is canonical Markov process with respect to ...
43 views

20 views

### model a system with finite users as a Markov Chain

I have to model a system M/M/2 with finite users (4 users) as a Markov Chain (and then find the probality an incoming users would enter the queue being the servers busy but that's not the problem). I ...
9 views

### Looking for resources on Harris recurrence

I'm working on a problem (in a not countable space) and it seems that I could get much further with it if I can prove that a certain Markov chain is Harris recurrent (I strongly suspect that it is). I ...
40 views

### How to understand this kind of Markov chain?

There are two unidirectionally coupled processes $X_t$ and $Y_t$. The coupling is $Y_t=g(X_{t-\delta},\dots)$. The Bayesian network of the two process is described in the following figure: Now this ...
21 views

### rigorous definition of adjoint infinitesimal generator for Markov process?

A Markov process on a $\sigma$-addive measurable space $(E,\Sigma,\mu)$ can be described by a family of operators $(P_t)_{t \geq 0} ,\, P_t: L^\infty(\mu) \to L^\infty(\mu)$. These operators define a ...
44 views

### Markov Chains and transition semigoups

I'm trying to figure out what the following statement refers to. A process $X$ is markov with transitions semigroup $(K_t)_{t\geq0}$ and initial distribution $\mu$ if and only if for all ...
15 views

### How does one estimate the order of a Markov chain empirically (given the data)?

I have a string of symbols $x_1, x_2, ...., x_n$, ($n$ very large), belonging to a finite alphabet. I know that they are a result of a Markov process, but I want to find out the order of the process. ...
51 views

### Correct steps in rewriting expectation to a probability

My knowledge of measure theory and probability spaces is limited, so please keep it relatively simple. Let $\{X(t), ~ t \ge 0\}$ be a Markov process on the countable state space $\mathbb{N}_0$ with ...
70 views

### Electrostatic capacity of two spheres with changing radii

Although I have read a lot of questions and answers here, this is my first time actually posting. Feel free to suggest needed edits. My question is the following (in a simplified setting). All this ...
74 views

### Doubt Concerning Markov Property

Given a Markovian process $(X_t )_{t\geq 0 }$, is the following property accurate? \mathbb E \left[ f(X_{t_1}, X_{t_2},X_{t_3}) \mid \mathcal F ^X_{t_2}\right] = \mathbb E \left[ f(X_{t_1}, ...
37 views