A stochastic, or random, process describes the correlation or evolution of random events. It is used to model stock market fluctuations and electronic/audio-visual/biological signals. Among the most well-known stochastic processes are random walks and Brownian motion.

learn more… | top users | synonyms

1
vote
1answer
25 views

What is the general Ito formula for a function of two processes

If $f$ i twice differentiable scalar function and $X_t, Y_t$ are Ito processes then Ito lemma holds. But in 90% of sources I can only find the case, when $Y_t=t$ (it is deterministic function). The ...
1
vote
1answer
20 views

Fubini's Theorem for Stochastic Integral

Probably a bit trivial, but I was curious about the validity of interchanging the following integrals (where $W_t$ is Brownian Motion): $\mathbb{E}[\int^{t}_{0} W^2_s ds] =? \int^{t}_{0} ...
0
votes
0answers
39 views

GARCH model, expectation of volatility?

Consider a time series $\{r_t\}$ following a standard GARCH(1,1) model, i.e., $$ r_t = \sigma_t \epsilon_t,$$ where $\epsilon_t \sim N(0,1)$ and are i.i.d, and $$\sigma_t^2 = \omega + \alpha_1 ...
2
votes
1answer
39 views

Properties of a transient state in a Markov Chain

I have been trying to solve this problem for a while now Prove that if $j$ is transient state, then $\displaystyle\sum_{n=1}^\infty p_{ij}^{(n)}<\infty \ \forall i \in S$, with $S$ the state ...
0
votes
1answer
26 views

How to construct a transition matrix?

I'm giving my first steps in stochastic processes but I'm having some difficulties. See the following example Suppose that whether or not it rains today depends on previous weather conditions ...
2
votes
1answer
42 views

Is this martingale identically zero?

Let $X_t$ be such that $X_t$ is bounded continuous martingale adapted to the filtration $\mathcal{F}_t$ such that $$\Bbb{E} \bigg[\int_0^t e^{X_s} \, d\langle X\rangle_s\bigg] = 0$$ and $X_0=0$. ...
1
vote
2answers
28 views

If $B$ is a BM and $\mathcal F_t=\sigma(B_s,s\le t)$, then $(B_{s+t}-B_t)_{s\ge 0}$ is independent of $\mathcal F_t^+:=\bigcap_{s>t}\mathcal F_s$

Let $B=(B_t)_{t\ge 0}$ be a Brownian motion on a probability space $(\Omega,\mathcal A,\operatorname{P})$, i.e. $B$ is a real-valued stochastic process with $B_0=0$ almost surely $B$ has independent ...
0
votes
0answers
9 views

Sufficient conditions to specify a stochastic process?

In order to specify a stochastic process, is it sufficient to specify all the finite-dimensional distributions of the stochastic process? Can there exist two stochastic processes that agree in all the ...
1
vote
1answer
35 views

Proving that $Z_t=g(X_t)$ is a martingale if and only if $\mathbb{E}(Z_t|Z_s)=Z_s \ \forall t>s \geq 0$. ($X_t$ Markov)

I want to prove the next property: Let $X_t$ be a Markov process (so $\mathbb{E}(X_t|\mathcal{F}_s)=\mathbb{E}(X_t|X_s)$ where $\mathcal{F_t}=\sigma(X_s, s\leq t)$). Suppose that $Z_t=g(X_t)$ where ...
1
vote
1answer
34 views

Prove that $\tilde{X}_{\tilde{\theta}}(t)$ is a martingale

Let me introduce the objects: 0) $(\Omega, \mathcal{F},\Bbb{P})$ is a probability space 1)$S_N $ is the set of symmetric, non-negative definite $N\times N$ matrices 2)$a:[0, \infty) \times \Omega ...
1
vote
1answer
28 views

Motivation behind the definition of the Itô integral for elementary predictable processes

Let $(\Omega,\mathcal{A},\operatorname{P})$ be a probability space and $\mathbb{F}$ be a filtration on $(\Omega,\mathcal{A})$. A real-valued stochastic process $H=(H_t)_{t\ge 0}$ is called elementary ...
1
vote
1answer
31 views

Proving technique used to show an equivalence to the definition of a Markov process

Let $X=(X_t)_{t\in I}$ be Markov process with values in a Polish space $E$. I want to show, that there exists a stochastic kernel $\kappa:E\times\mathcal{B}(E)^{\otimes I}\to [0,1]$ such that ...
3
votes
1answer
27 views

Solving the Geometric Brownian Motion on a general interval.

I know that the Geometric Brownian Motion, with the expression $dX_t = v X_t dt + \sigma X_t dW_t$ has the next solution $$X_t = X_0 e^{\sigma W_t+ (v-\frac{\sigma ^2}{2})t}$$ on the interval $[0,T]$. ...
2
votes
1answer
41 views

(Elementary) Markov property of the Brownian motion

Let $B=(B_t)_{t\ge 0}$ be a Brownian motion on a probability space $(\Omega,\mathcal A,\operatorname{P})$, i.e. $B$ is a real-valued stochastic process with $B_0=0$ almost surely $B$ has independent ...
2
votes
0answers
30 views

A property of the space of rcll functions

Let $E$ be a locally compact separable metric space, $$\Omega=\{f:[0,\infty]\to E\mid f \text{ is rcll}\}$$ and $P$ be a probability on $\Omega$ which equiped the $\sigma$-algebra generated by ...
-1
votes
1answer
32 views

Prove that the increments of the Brownian motion are normally distributed

Let $B=(B_t)_{t\ge 0}$ be a Brownian motion on a probability space $(\Omega,\mathcal A,\operatorname{P})$, i.e. $B$ is a real-valued stochastic process with $B_0=0$ almost surely $B$ has independent ...
3
votes
0answers
64 views

Distribution of bounded summation of i.i.d random variables

We have a set of positive random variables $\boldsymbol X=\{X_1, X_2,\ldots\}$, where $X_1, X_2,\ldots$, are independent and identically distributed (i.i.d.). The CDF $F(x)$ and PDF $f(x)$ for $X_i$ ...
2
votes
1answer
48 views

Infinitesimal Generator of Ito Diffusion Process

Suppose one has the an Ito process of the form: $$dX_t = b(X_t)dt + \sigma(X_t)dW_t$$ The following is an excerpt from wikipedia My question is on how to derive this operator? It looks very ...
0
votes
1answer
37 views

Compound Poisson Process property:$\mathbb{P}(\sum^{N_{t_4}-N_{t_3}}_{i=1}J_i \leq n)=\mathbb{P}(\sum^{N_{t_4}}_{i=N_{t_3}+1}J_i \leq n)$

I am trying to demostrate that the Compound Poisson Process has independent increments, and I have a problen because I have to use that: :$$\mathbb{P}(\sum^{N_{t_4}-N_{t_3}}_{i=1}J_i \leq ...
1
vote
0answers
25 views

Is the Martingale property still true for $\xi$ not necessarily $C^1$?

Denote $$M(t) = f(t, \alpha(t))\exp \bigg\{-\int_0^t g(u, \alpha (u)) \, du - \int_0^t h(u, \alpha(u)) \, d\xi(u)\bigg\}$$ Here $\xi: [0,\infty) \times \Omega \to \Bbb{R}$. If for each $\omega$ the ...
1
vote
0answers
28 views

Understanding Quadratic Variation

I think part of the trouble a lot of people (or at least me personally) have with making the jump from calculus to stochastic calculus is the notion of quadratic variation. It doesn't have as much ...
1
vote
2answers
92 views

Reference request for this topics

I'm a second year undergraduate statistic student, I need a good reference to learn these topics Markov Chains in discrete time.    1.1. Classification of states, recurrence notions of transience. ...
0
votes
0answers
11 views

Non existence of probabilty measures.

We suppose $X$ solves our SDE $dX_{t}=-X_{t}dt+dW_{t}$ for $t\geq0$ with initial condition $X_{0}=0$ w.r.t to our measure $P$ on $(\Omega,\mathcal{F})$. $W_{t}$ ist standard Wiener. This solution is ...
2
votes
2answers
40 views

how do I parametrise a stochastic matrix

I have a matrix $\mathbf{t}$ that maps one $d$ dimensional probability distribution to another $\mathbf{t}^T x = q$, i.e. with $\sum\limits_i t_{ij} x_i = q_j$ and $\sum\limits_j t_{ij} = 1$ $\forall$ ...
1
vote
1answer
35 views

If $(B_t)_{t\ge 0}$ is a Brownian motion and $\tau$ is a stopping time, then the stopped process $(B_{\min(\tau,t)})_{t\ge 0}$ is integrable

Let $B=(B_t)_{t\ge 0}$ be a Brownian motion on a probability space $(\Omega,\mathcal A,\operatorname{P})$. By definition $B_t$ is normally distributed with mean $0$ and variance $t$. Now, let ...
3
votes
0answers
64 views

Bounded L2 increments for an Ornstein Uhlenbeck type process

Let $Z$ be an increasing Levy process (i.e. a subordinator). Let $\lambda>0$ and consider the Ornstein Uhlennbeck type SDE $$ d V_t = - \lambda V_t dt + d Z_{\lambda t } $$ where the integral can ...
3
votes
0answers
47 views

Probability that a birth--death process crosses level $n$ in $(0,T)$

This question is inspired by this question. Jobs arriving according to a Poisson process with rate $\lambda$. Jobs stay in the system for a fixed amount of time $d$ and depart thereafter. Let $X(t)$ ...
2
votes
2answers
55 views

Compound Poisson process property

Let $X_t=\sum_{i=1}^{N_t}J_i$ be a compound Poisson Process, where $J_i$ are independent and equidistributed. I have to prove that for every $0<t_1<t_2 \leq t_3<t_4$ : $X_{t_4}-X_{t_3}$ is ...
1
vote
1answer
60 views

Optional stopping/sampling for right-continuous supermartingales

Let $\mathbb{F}$ be a filtration $(X_t)_{t\ge 0}$ be a right-continuous $\mathbb{F}$-supermartingale $\sigma,\tau$ be bounded $\mathbb{F}$-stopping times with $\sigma\le \tau$ and ...
2
votes
1answer
41 views

Show that $W$ is a Gaussian process

I have the following problem: I want to prove that the vector $(W(1_{[t_0,t_1]}),...,W(1_{[t_{n-1},t_n]}))$ is normally distributed with mean $0$ and covariance matrix ...
3
votes
1answer
40 views

Variation processes and strong solutions of stochastic differential equations

Let $(\Omega,\mathcal{A},\operatorname{P})$ be a probability space $\mathbb{F}$ be a filtration on $(\Omega,\mathcal{A})$ $\tau$ be a $\mathbb{F}$-stopping time An $\mathbb{F}$-adapted, ...
0
votes
1answer
32 views

Power Spectral Density Approximation

Let $X_t$ be a zero-mean, stationary random process. Let $X_f$ be the Fourier transform of $X_t$; $X_f$ is also a random process, but as a function of $f$. Let us denote the power spectral density ...
0
votes
1answer
33 views

Recursive Variance

What will be the distribution or features about the following $x$? $x=\mu+\epsilon$ where $\epsilon\sim N(0,x^{-1})$. It seems interesting in econometrics if we allow $x$ being a time series and ...
2
votes
0answers
23 views

Infinitesimal Generator for Stochastic Processes

Suppose one has the an Ito process of the form: $$dX_t = b(X_t)dt + \sigma(X_t)dW_t$$ The infinitesimal generator $LV(x)$ is defined by: $$\lim_{t\rightarrow 0} \frac{E^x\left[V(X_t) ...
1
vote
0answers
20 views

Transient discrete time Markov chain on integers: can direction of flow be proven?

I'm not very familiar with the theory of Markov chains, and I'd like to learn how complicated the following problem actually is. Let there be a discrete time Markov chain on $\mathbb{Z}$, where the ...
2
votes
1answer
47 views

Doob decomposition of $|S_n|$ where $S_n$ is simple random walk.

Let $X_n$, $n\geqslant 1$ be iid Rademacher random variables, i.e. $X_1$ takes values $\pm 1$ each with probability $\frac12$. Define $S_0=0$ and $S_n=\sum_{i=0}^n X_i$, and $\mathcal F_n = ...
1
vote
0answers
29 views

Conditioning on Brownian motion

I was reading on conditional probability with respect to a partition of a sample space, and I came across the following example: Let $(N_t:t\geq0)$ be the Poisson process. Given fixed times $0\leq ...
0
votes
0answers
20 views

Markov Chain with dependence between users

I am looking for a Markov Chain model that describes the following problem. I have $N$ indifferent users in the system, each of them has three states: $A$, $B$, $C$, and I know the transition ...
1
vote
1answer
28 views

Infinitesimal Generator of Poisson process

I would like to compute the infinitesimal generator of a Poisson process $N$ with intensity $\lambda$. So I can write: $$\mathbb{E}[\ f(N_{t+s})-f(N_s)\ |\ \mathcal{F_t^0} \ ] = \mathbb{E}[\ ...
1
vote
1answer
38 views

If $(X_t,t\in I)$ is a process with values in $(E,\mathcal{E})$, are $\sigma(X_t,t\in I)$ and $\sigma(X)=X^{-1}(\mathcal{E}^{\otimes I})$ equal?

Let $(\Omega,\mathcal{A},\operatorname{P})$ be a probability space $E$ be a Polish space and $\mathcal{E}$ be the Borel $\sigma$-algebra on $E$ $I$ be an index set $X_t$ be a random variable on ...
-1
votes
1answer
23 views

Let $\{X_n; n\geq 0\}$ be a martingale with respect to $\{Y_n\}$. Prove for any set of integers $k\leq l<m$ that

Let $\{X_n; n\geq 0\}$ be a martingale with respect to $\{Y_n\}$. Prove for any set of integers $k\leq l<m$ that the difference $X_m-X_l$ is uncorrelated with $X_k$, that is, $$E[(X_m-X_l)X_k]=0.$$ ...
1
vote
2answers
42 views

Exchanging expectation and limits

Exchanging expectation and limits I have a stochastic process, ${b_t} \, (t=0, 1, 2, \ldots)$, which follows a random walk. Specifically, ${b_0} = 0$ and for $t$ greater than zero, $\displaystyle ...
1
vote
0answers
13 views

Doob's submartingale stopping theorem in the context of the submartingale problem

Let $$X^\omega_f (t, w) = f(w(t)) - f(w(t \wedge \tau)) - \frac{1}{2} \int_{t \wedge \tau}^t \Delta f(w(s))\, ds$$ be a $P^\tau_\omega$-submartingale. 1) Why Doob's submartingale stopping theorem ...
1
vote
1answer
38 views

Applying the Multivariate Ito Formula

I want to show that the stochastic process $$ S_t^i = S_0^i \exp\left( \int_0^t \left(\mu_s^i - \frac{1}{2} \sum_{j=1}^m (\sigma_s)^{ij} \right)^2 d s + \sum_{j=1}^m \sigma_t^{ij} S_t^i dW_t^j ...
1
vote
0answers
17 views

Aggregate arrivals from a renewal process

This is a follow-up question of the question "Aggregate arrivals from a Poisson Process". The inter-arrival time of a renewal process, t, conforms to a general distribution, denoted by PDF $f(t)$. ...
1
vote
1answer
33 views

Aggregate arrivals from a Poisson Process

The inter-arrival time of a Poisson Process, $t$, conforms to the exponential distribution, so the probability density function for $t$ is $f(t)=λe^{−λt},~t>0$. ($λ$ is the arrival rate of the ...
3
votes
3answers
36 views

Simulation of interacting Ornstein-Uhlenbeck processes

I would like to simulate the following system of interacting OU processes on $[0,T]$: $$dX_t^1=(X_t^2-X_t^1)\,dt+\sigma_1 \,dW_t^1,\quad X_0^1=x_1$$ $$dX_t^2=(X_t^1-X_t^2)\,dt+\sigma_2 ...
1
vote
0answers
40 views

Mean-Square Ergodicity of Certain Quantities?

I apologize in advance for my lack of mathematical knowledge, especially in the field of stochastic processes, but I will try my best to formulate my question in a mathematical way. Is it possible ...
1
vote
1answer
24 views

Working with the random variable $\log X$ instead of $X$

Suppose I have a positive stochastic process $X_t$. I'd like to compute certain properties about $X_t$, but suppose I can't and instead I can compute properties about $\log(X_t)$. Can I say anything ...
2
votes
0answers
24 views

Local Martingales in a Finite Time Horizon setting

I apologise if this question has been answered somewhere else. Consider the following definition. Let $T \in [0, \infty), d \in \mathbb{N}$, let $(\Omega, \mathcal{F}, P, (\mathbb{F}_t)_{t \in [0, ...