A stochastic, or random, process describes the correlation or evolution of random events. It is used to model stock market fluctuations and electronic/audio-visual/biological signals. Among the most well-known stochastic processes are random walks and Brownian motion.

learn more… | top users | synonyms

3
votes
1answer
2k views

Calculating stationary distribution of markov chain

I am asked to compute the stationary distribution of the markov chain with state space $E=\{0\dots,n\}$ and transition matrix below: \begin{bmatrix} 0 & 1 \\ \frac{1}{n} ...
2
votes
2answers
761 views

First hitting time for a brownian motion with a exponential boundary

Let $B_t$ be the standard Brownian Motion. Is the distribution/density of the first hitting time of $B_t$ for an exponential decaying boundary known? Trying to be more formal, if ...
1
vote
0answers
97 views

Estimation of a Ito's semi-martingale linear functional

Could someone check my solution for the following problem please? Or maybe propose a smarter/shorter solution. Consider a stochastic process $X=(X_t)_{t \in [0,1]}$ defined in a filtred ...
7
votes
2answers
551 views

Laplace transform of integrated geometric Brownian motion

Is there any closed form of the Laplace transform of an integrated geometric Brownian motion ? A geometric Brownian motion $X=(X_t)_{t \geq 0}$ satisifies $dX_t = \sigma X_t \, dW_t$ where ...
4
votes
3answers
371 views

When is a stochastic process defined via a SDE Markovian?

I was wondering when a stochastic process defined via a SDE is Markovian? The SDE may involved Ito integral, Lebesgue integral, jump component, and any other things. The reason I ask this question is ...
4
votes
2answers
584 views

How can a Markov chain be written as a measure-preserving dynamic system

From http://masi.cscs.lsa.umich.edu/~crshalizi/notabene/ergodic-theory.html irreducible Markov chains with finite state spaces are ergodic processes, since they have a unique invariant ...
4
votes
2answers
307 views

A probability question

Suppose $X_1, X_2, ...,$ are IID random variables with $P(X_n=1)=p$ and $P(X_n=2)=1-p$. Let $S_n=\sum_{i=1}^n X_i$. I was wondering how to find $P(S_n \neq z, \forall n \in \mathbb{N})$ for some ...
3
votes
0answers
68 views

No drift brownian motion problem

Given two same brownian motion with no drift and different variances: $$dG_1= \sigma_1 G_1 dW $$ $$dG_2= \sigma_2 G_2 dW $$ and two barriers $P_1 > P_2$ assuming that $ \sigma_1 > \sigma_2 $ ...
3
votes
2answers
1k views

A question regarding the hitting time formula in brownian motion

Let $\tau_a=\inf\{t: B_t=a\}$, the hitting time of the standard Brownian motion to reach the boundary $a$. This is easily derived $$E(e^{-\lambda \tau_a})=e^{-|a|\sqrt{2\lambda}}$$ But I am having ...
2
votes
2answers
31 views

What does it mean for a Poisson point process $\Phi$'s points in $A$, conditioned on $\Phi(A)=k$ to be uniform?

I've read that if $\Phi$ is a Poisson point process (on $\mathbb{R}^d$, say), then conditional on there being $k$ points in some $A \subseteq \mathbb{R}^d$, the positions $X_1,\ldots,X_k$ of these ...
1
vote
0answers
42 views

Why do people all the time exploiting almost sure properties of a stochastic process as if they were sure properties?

All the time, I see people working with a given Brownian motion $(B_t)_{t\ge 0}$ on a fixed probability space $(\Omega,\mathcal A,\operatorname P)$ and suddenly exploiting its almost sure properties ...
1
vote
1answer
114 views

Asymmetric Random Walk / Prove that $E[T:= \inf\{n: X_n = b\}] < \infty$

Given random variables $Y_1, Y_2, \ldots \stackrel{iid}{\sim} P(Y_i = 1) = p = 1 - q = 1 - P(Y_i = -1)$ where $p > q$ in a filtered probability space $(\Omega, \mathscr F, \{\mathscr F_n\}_{n \in ...
1
vote
2answers
171 views

Survival probability up to time $n$ in a branching process.

Let $\{Z_n : n=0,1,2,\ldots\}$ be a Galton-Watson branching process with time-homogeneous offspring distribution $$\mathbb P(Z_{n,j} = 0) = 1-p = 1 - \mathbb P(Z_{n,j}=2), $$ where $0<p<1$. That ...
1
vote
1answer
957 views

Scalar product of Gaussian process

Assume that $n(t)$ is a White Gaussian Noise (WGN) process with $E[n(t)]=0$, $E[n(t)^2]=\sigma^2$ and $x(t)$ a deterministic function defined in $[0,T]$. How can I compute from first principles the ...
7
votes
1answer
156 views

Must $n$ independent Wiener processes be simultaneously positive at some time?

Consider $n$ independent one-dimensional Wiener processes $(W_i)_{1\leqslant i\leqslant n}$. Is there with probability $1$ some time $t\in[0,1]$ such that $W_i(t)>0$ for every $1\leqslant ...
7
votes
1answer
771 views

Hölder Continuity of Fractional Brownian Motion

I would like to prove the following theorem: Let $H\in (0,1)$. The fractional Brownian motion $B_H$ admits a version whose sample paths are $a.s.$ Hölder continuous of order strict less than $H$. ...
6
votes
1answer
657 views

stopped filtration = filtration generated by stopped process?

I am interested in a proof of the following statement which seems intuitive, but is somehow really tricky: Let $X$ be a stochastic process and let $(\mathcal{F}(t) : t \geq 0)$ be the filtration ...
6
votes
2answers
953 views

Dominated convergence problems with Wald's identity for the Brownian Motion

In the course of proving Wald's second identity $E(B^2_T)=E(T)$, where $(B_t)_{t\geq0}$ is the Brownian motion and $T$ is a stopping time with $E(T)<\infty$, I got stuck with the following problem. ...
5
votes
1answer
1k views

Expectation value of a product of an Ito integral and a function of a Brownian motion

this problem has come up in my research and is confusing me immensely, any light you can shed would be deeply appreciated. Let $B(t)$ denote a standard Brownian motion (Wiener process), such that the ...
5
votes
1answer
507 views

Doob's inequality in probability

In the book "Optimal Stopping and Free-Boundary Problems" there is given Doob's inequality of the following form. Let $X = (X_t,F_t)$ be a submartingale. Then for any $\varepsilon>0$ and each ...
4
votes
1answer
191 views

The continuity of the expectation of a continuous stochastic procees

Let $X_t$ be a continuous stochastic process on a filtered space $(\Omega, \mathcal F, \mathcal F_t, \mathbb P)$. Is $\mathbb E[X_t]$ necessarily a continuous function? My first answer would be no. ...
4
votes
1answer
3k views

Expectation of Stopping Time w.r.t a Brownian Motion

How do you take the expectation of a stopping time with respect to a Brownian motion? The specific question is: $$ \tau = \inf\{ t \ge 0: B(t) \in \{-a, b\}\} $$ I understand the optional stopping ...
4
votes
1answer
2k views

Why does a time-homogeneous Markov process possess the Markov property?

Klenke defines (Definition 17.3, p. 346) a time-homogeneous Markov process independently, rather than as a special case of a stochastic process that possesses the Markov property (Definition 17.1, p. ...
3
votes
1answer
178 views

Why is the following example of a Markov process not strong Markov

$X(t) := 0 \;\; (t \leq \tau),\;\; t - \tau\;\;(t \geq \tau)$ with $\tau$ exponentially distributed. Then X has the Markov property but not Strong Markov Property. But why ???? Can someone kindly ...
3
votes
1answer
3k views

covariance function for Brownian motion

What would the covariance function be of $V(t) = (1-t) B[t/(1-t)]$ if $B(t)$ is standard Brownian motion. Also $t$ is between $0$ and $1$. Thanks for the help! EDIT: Here is where I am stuck: I ...
2
votes
1answer
34 views

Given a $C_c^∞(G)$-valued random variable, is $C_c^∞(G)∋φ↦\text E[\langle\xi,φ\rangle]$ an element of the dual space of $C_c^∞(G)$?

Let $G\subseteq\mathbb R^d$ and $$\mathcal D:=C_c^\infty(G)$$ be equipped with some topology $\tau$ $\mathcal D'$ be the dual space of $\mathcal D$ and $\langle\;\cdot\;,\;\cdot\;\rangle$ denote the ...
2
votes
1answer
98 views

Is $(B_t^2)$ Markov where $(B_t)$ is Brownian motion?

I am pretty sure $(B_{t}^{2})$ not Markov because the squared random walk is not. Showing the square of a Markov process is or isn't Markov I guess I can repeat the method since to be Markov it ...
2
votes
1answer
257 views

A bound for the probability that a Brownian motion stays in an interval

Suppose I have a Brownian motion $X_t$ with $X_0=0$. Let $T$ be the first exit time of the interval $[-1,1]$. I'm trying to get a "quick" lower bound for the probability that $T$ is very large which ...
2
votes
1answer
627 views

Limiting distribution and initial distribution of a Markov chain

For a Markov chain (can the following discussion be for either discrete time or continuous time, or just discrete time?), if for an initial distribution i.e. the distribution of $X_0$, there exists ...
2
votes
1answer
436 views

Probability distribution of sign changes in Brownian motion

Let us consider a 1d Brownian motion. Displacements in space will be positive or negative and this is a random variable $U(t)$ that characterizes a random process and that can take just the values ...
1
vote
1answer
50 views

positive martingale process

I would to like to prove that the process: $$e^{\int_{0}^{T}\theta _{s}\,dW_{s}-\frac{1}{2}\int_{0}^{T}\theta _{s}^2\,ds}$$ is a martingale which is positive and has a mean=1, where $\theta_s$ is ...
1
vote
1answer
57 views

Impossible stochastic process

I am trying to prove that a stochastic process with the following properties cannot exist. Let $\{X_t: 0 \leq t \leq 1 \}$ be a stochastic process such that i) $X_s$ and $X_t$ are independent ...
1
vote
1answer
45 views

The Continuity of Correlation Coefficient of a Continuous Stochastic Process

Given a continuous stochastic process with respect to time with finite variance at a given $t$. Does it necessarily imply, as $d\to 0$, 1) the covariance between $t$ and $t+d$ approaches the variance ...
1
vote
1answer
173 views

Evaluating Stratonovich integral from definition

$\bf 3.9.$ Suppose $f\in\mathcal V(0,T)$ and that $t\to f(t,\omega)$ is continuous for a.a. $\omega$. Then we have shown that $$\int\limits_0^T f(t,\omega)dB_t(\omega)=\lim_{\Delta ...
1
vote
1answer
1k views

When is a Markov process independent-increment?

An independent-increment stochastic process must be Markov. I am now wondering about the reverse case. Why do some Markov processes fail to be independent-increment? What are some examples of Markov ...
1
vote
2answers
225 views

Generating function of the stopping time

Let $X_t$ be a generalized Wiener process with drift rate $\mu$ and variance $\sigma^2$, and let $\tau$ be the stopping time $$\tau:=\inf \left\{ t\geq0: X_t= b\right\}, \quad b\geq0 $$ Can anyone ...
0
votes
1answer
52 views

Monte-Carlo simulation with sampling from uniform distribution

I used to work with Monte-Carlo simulations for a while. In my case, I generated random data for a variety of input parameters according to uniform distributions (with non-negative support), say for ...
0
votes
1answer
68 views

Symmetric Random Walk / Prove $S = \inf\{n : X_n = 7\}$ and $T = 10^{12} \wedge S$ are $\{\mathscr F_n^Y\}$-stopping times.

Given a filtered probability space $(\Omega, \mathscr F, \{\mathscr F_n\}_{n \in \mathbb N}, \mathbb P)$ where $\mathscr F_n = \mathscr F_n^Y$, let $Y_1, Y_2, ...$ be iid random variables w/ $P(Y_n = ...
0
votes
1answer
24 views

Characterizing superposition of two renewal processes

This is a follow-up question of "When superposition of two renewal processes is another renewal process?". How can we characterize the superposition of two renewal processes? The superposition ...
0
votes
1answer
78 views

Flea on a triangle

"A flea hops randomly on the vertices of a triangle with vertices labeled 1,2 and 3, hopping to each of the other vertices with equal probability. If the flea starts at vertex 1, find the probability ...
0
votes
0answers
65 views

Convergence in $L^2$ of the stochastic integral $\int\limits^{t}_{0}\frac{B_s}{e}1_{B_s\in(-e,e)}dB_s$

Let $e\in \mathbb{R}^+$ and $B_t$ 1-dimensional Brownian motion. Consider $$X_t=\int^{t}_{0}\frac{B_s}{e}1_{B_s\in(-e,e)}dB_s.$$ How to show that $X_t \to 0$ in $L^2$ as $e\to0$? Obviously the ...
0
votes
1answer
139 views

When do we have $E[X_{n+1}\mid X_n] = E[X_{n+1}\mid\mathscr{F}_n]$?

Under what conditions does it hold that $$E[X_{n+1}\mid X_n] = E[X_{n+1}\mid\mathscr{F}_n]$$ if we are given a stochastic process $X = (X_n)_{n \geq 0}$ on a filtered probability space $(\Omega, ...
0
votes
2answers
174 views

Prove $A_t := W_t^3-3t W_t$ a martingale

Given prob space $(\Omega, \mathscr{F}, P)$ and a Wiener process $(W_t)_{t \geq 0}$, define filtration $\mathscr{F}_t = \sigma(W_u : u \leq t)$ Let $(A_t)_{t \geq 0}$ where $A_t = W_t^3 - 3tW_t$. ...
0
votes
2answers
715 views

Generated $\sigma$-algebras with cylinder set doesn't contain the space of continuous functions

Consider $\mathbb R^{[0,1]}$ the space of all functions from $[0,1]$ to $\mathbb R$ and the cylindrical sigma algebra $\mathcal B$ on it. The question is: how to prove that $C[0,1]\notin \mathcal ...
0
votes
2answers
1k views

Pure Birth Process Question

I would appreciate any possible help for this question because I have no clue what to do! Thanks so much! Consider a population made of a fixed number (N) of people. At time t=0 there is only one ...
8
votes
1answer
428 views

PDE - Feynman-Kac vs. finite difference methods

I've heard that in greater than three dimensions, it's more efficient to solve a second-order parabolic PDE using a Monte-Carlo method based on the Feynman-Kac formula that it is to use finite ...
6
votes
2answers
4k views

How do you check if a sequence of numbers is truly random? [duplicate]

Suppose a source produces an indefinite sequence of positive integers. How can you check whether the numbers are generated truly randomly?
5
votes
1answer
980 views

Relations between Order Statistics of Uniform RVs and Exponential RVs

Say we have $U_1 \dots U_n$ i.i.d. random variables uniform on $[0,1]$ and $Y_1 \dots Y_{n+1}$ i.i.d. random variables distributed as $Y_i \sim Exp(1)$. I know that the joint distribution of the order ...
4
votes
1answer
79 views

Conditional probability branching process

Consider a discrete time branching process $X_{n}$ with $X_{0}=1.$ Establish the simple inequality $$P\{X_{n}>L\ \textrm{for some}\ 0\leq n\leq m\ |\ X_{m}=0 \}\leq [P\{X_{m}=0\}]^L$$ Note: This ...
4
votes
1answer
1k views

covariance of integral of Brownian

What is the covariance of the process $X(t) = \int_0^t B(u)\,du$ where $B$ is a standard Brownian motion? i.e., I wish to find $E[X(t)X(s)]$, for $0<s<t<\infty$. Any ideas? Thanks you very ...