A stochastic, or random, process describes the correlation or evolution of random events. It is used to model stock market fluctuations and electronic/audio-visual/biological signals. Among the most well-known stochastic processes are random walks and Brownian motion.

learn more… | top users | synonyms

2
votes
2answers
653 views

First hitting time for a brownian motion with a exponential boundary

Let $B_t$ be the standard Brownian Motion. Is the distribution/density of the first hitting time of $B_t$ for an exponential decaying boundary known? Trying to be more formal, if ...
1
vote
2answers
165 views

Survival probability up to time $n$ in a branching process.

Let $\{Z_n : n=0,1,2,\ldots\}$ be a Galton-Watson branching process with time-homogeneous offspring distribution $$\mathbb P(Z_{n,j} = 0) = 1-p = 1 - \mathbb P(Z_{n,j}=2), $$ where $0<p<1$. That ...
7
votes
1answer
149 views

Must $n$ independent Wiener processes be simultaneously positive at some time?

Consider $n$ independent one-dimensional Wiener processes $(W_i)_{1\leqslant i\leqslant n}$. Is there with probability $1$ some time $t\in[0,1]$ such that $W_i(t)>0$ for every $1\leqslant ...
7
votes
1answer
613 views

Hölder Continuity of Fractional Brownian Motion

I would like to prove the following theorem: Let $H\in (0,1)$. The fractional Brownian motion $B_H$ admits a version whose sample paths are $a.s.$ Hölder continuous of order strict less than $H$. ...
6
votes
1answer
583 views

stopped filtration = filtration generated by stopped process?

I am interested in a proof of the following statement which seems intuitive, but is somehow really tricky: Let $X$ be a stochastic process and let $(\mathcal{F}(t) : t \geq 0)$ be the filtration ...
5
votes
2answers
815 views

Dominated convergence problems with Wald's identity for the Brownian Motion

In the course of proving Wald's second identity $E(B^2_T)=E(T)$, where $(B_t)_{t\geq0}$ is the Brownian motion and $T$ is a stopping time with $E(T)<\infty$, I got stuck with the following problem. ...
4
votes
1answer
2k views

Expectation of Stopping Time w.r.t a Brownian Motion

How do you take the expectation of a stopping time with respect to a Brownian motion? The specific question is: $$ \tau = \inf\{ t \ge 0: B(t) \in \{-a, b\}\} $$ I understand the optional stopping ...
4
votes
2answers
513 views

How can a Markov chain be written as a measure-preserving dynamic system

From http://masi.cscs.lsa.umich.edu/~crshalizi/notabene/ergodic-theory.html irreducible Markov chains with finite state spaces are ergodic processes, since they have a unique invariant ...
3
votes
1answer
147 views

The continuity of the expectation of a continuous stochastic procees

Let $X_t$ be a continuous stochastic process on a filtered space $(\Omega, \mathcal F, \mathcal F_t, \mathbb P)$. Is $\mathbb E[X_t]$ necessarily a continuous function? My first answer would be no. ...
3
votes
2answers
1k views

A question regarding the hitting time formula in brownian motion

Let $\tau_a=\inf\{t: B_t=a\}$, the hitting time of the standard Brownian motion to reach the boundary $a$. This is easily derived $$E(e^{-\lambda \tau_a})=e^{-|a|\sqrt{2\lambda}}$$ But I am having ...
2
votes
1answer
2k views

covariance function for Brownian motion

What would the covariance function be of $V(t) = (1-t) B[t/(1-t)]$ if $B(t)$ is standard Brownian motion. Also $t$ is between $0$ and $1$. Thanks for the help! EDIT: Here is where I am stuck: I ...
1
vote
2answers
215 views

Generating function of the stopping time

Let $X_t$ be a generalized Wiener process with drift rate $\mu$ and variance $\sigma^2$, and let $\tau$ be the stopping time $$\tau:=\inf \left\{ t\geq0: X_t= b\right\}, \quad b\geq0 $$ Can anyone ...
1
vote
1answer
826 views

Scalar product of Gaussian process

Assume that $n(t)$ is a White Gaussian Noise (WGN) process with $E[n(t)]=0$, $E[n(t)^2]=\sigma^2$ and $x(t)$ a deterministic function defined in $[0,T]$. How can I compute from first principles the ...
0
votes
2answers
1k views

Pure Birth Process Question

I would appreciate any possible help for this question because I have no clue what to do! Thanks so much! Consider a population made of a fixed number (N) of people. At time t=0 there is only one ...
8
votes
1answer
387 views

PDE - Feynman-Kac vs. finite difference methods

I've heard that in greater than three dimensions, it's more efficient to solve a second-order parabolic PDE using a Monte-Carlo method based on the Feynman-Kac formula that it is to use finite ...
6
votes
2answers
3k views

How do you check if a sequence of numbers is truly random? [duplicate]

Suppose a source produces an indefinite sequence of positive integers. How can you check whether the numbers are generated truly randomly?
5
votes
1answer
1k views

Expectation value of a product of an Ito integral and a function of a Brownian motion

this problem has come up in my research and is confusing me immensely, any light you can shed would be deeply appreciated. Let $B(t)$ denote a standard Brownian motion (Wiener process), such that the ...
5
votes
1answer
861 views

Relations between Order Statistics of Uniform RVs and Exponential RVs

Say we have $U_1 \dots U_n$ i.i.d. random variables uniform on $[0,1]$ and $Y_1 \dots Y_{n+1}$ i.i.d. random variables distributed as $Y_i \sim Exp(1)$. I know that the joint distribution of the order ...
5
votes
1answer
482 views

Doob's inequality in probability

In the book "Optimal Stopping and Free-Boundary Problems" there is given Doob's inequality of the following form. Let $X = (X_t,F_t)$ be a submartingale. Then for any $\varepsilon>0$ and each ...
4
votes
1answer
66 views

Conditional probability branching process

Consider a discrete time branching process $X_{n}$ with $X_{0}=1.$ Establish the simple inequality $$P\{X_{n}>L\ \textrm{for some}\ 0\leq n\leq m\ |\ X_{m}=0 \}\leq [P\{X_{m}=0\}]^L$$ Note: This ...
4
votes
1answer
829 views

covariance of integral of Brownian

What is the covariance of the process $X(t) = \int_0^t B(u)\,du$ where $B$ is a standard Brownian motion? i.e., I wish to find $E[X(t)X(s)]$, for $0<s<t<\infty$. Any ideas? Thanks you very ...
4
votes
1answer
2k views

Why does a time-homogeneous Markov process possess the Markov property?

Klenke defines (Definition 17.3, p. 346) a time-homogeneous Markov process independently, rather than as a special case of a stochastic process that possesses the Markov property (Definition 17.1, p. ...
2
votes
1answer
86 views

Is $(B_t^2)$ Markov where $(B_t)$ is Brownian motion?

I am pretty sure $(B_{t}^{2})$ not Markov because the squared random walk is not. Showing the square of a Markov process is or isn't Markov I guess I can repeat the method since to be Markov it ...
2
votes
2answers
163 views

solution of SDE: $dS_t=(\alpha S_t+f(t))dW_t$

does someone know how to solve the following SDE $$dS_t=(\alpha S_t+f(t))dW_t, S_0=s$$ where $f(t)$ is a deterministic function and $W_t$ is a standard brownian motion. Is there a explicit solution ...
2
votes
1answer
214 views

A bound for the probability that a Brownian motion stays in an interval

Suppose I have a Brownian motion $X_t$ with $X_0=0$. Let $T$ be the first exit time of the interval $[-1,1]$. I'm trying to get a "quick" lower bound for the probability that $T$ is very large which ...
2
votes
1answer
586 views

Limiting distribution and initial distribution of a Markov chain

For a Markov chain (can the following discussion be for either discrete time or continuous time, or just discrete time?), if for an initial distribution i.e. the distribution of $X_0$, there exists ...
2
votes
1answer
287 views

Chebyshev Inequality for Martingales

Suppose $\{X_n\}_{n \geq 1}$ is a square-integrable martingale with $E(X_1)=0$. Then for $c>0$: $$P\left(\max_{i=1, \ldots, n} X_i \geq c\right) \leq ...
2
votes
1answer
221 views

Homogeneous Poisson processes

Suppose that $N$ is a homogeneous Poisson process with rate $\lambda$. For $0 \le s \le t < \infty$, how can we find $\mathbb E[N_s\cdot N_t]$?
2
votes
2answers
131 views

sub martingales and more

This is a problem on sub-martingales. Given : $X_n = X_0 \mathrm{e}^{\mu S_n}$, $n= 1,2,3,\ldots$, where $X_0 > 0$ and where $S_n$ is a symmetric random walk and $\mu$ is greater than zero. We ...
2
votes
1answer
394 views

Probability distribution of sign changes in Brownian motion

Let us consider a 1d Brownian motion. Displacements in space will be positive or negative and this is a random variable $U(t)$ that characterizes a random process and that can take just the values ...
1
vote
1answer
41 views

The Continuity of Correlation Coefficient of a Continuous Stochastic Process

Given a continuous stochastic process with respect to time with finite variance at a given $t$. Does it necessarily imply, as $d\to 0$, 1) the covariance between $t$ and $t+d$ approaches the variance ...
1
vote
1answer
87 views

Expected Number of points in Point Poisson Process

Let $\lambda$ be the intensity of points, distributed as point poisson process, in a square grid of area $A$. Then, the Cumulative disributive function is given by: $$ P(r \leq R) = 1 - e^{-\lambda ...
1
vote
1answer
70 views

Simple question about the definition of Brownian motion

I have a question concerning the definiton of Brownian motion. Usually (e.g. on Wikipdia) one demands a brownian motion $\lbrace B_t\rbrace_{t\in[0,\infty)}$ to satisfy the following condition: ...
1
vote
1answer
112 views

Evaluating Stratonovich integral from definition

$\bf 3.9.$ Suppose $f\in\mathcal V(0,T)$ and that $t\to f(t,\omega)$ is continuous for a.a. $\omega$. Then we have shown that $$\int\limits_0^T f(t,\omega)dB_t(\omega)=\lim_{\Delta ...
1
vote
0answers
146 views

Differential equation with random variable

How can I derive analytically or compute numerically the solution to following differential equation $$ dy/dt = y\cdot X\cdot (y\cdot X - g(y,X))\cdot X $$ where X is a random variable (e.g. from a ...
1
vote
1answer
759 views

Sum of 2 Brownian motions

Let's say, that $B_t$, $t\geq0$ is standard Brownian motion (Wiener process). Let's define process $$X_t=B_t+B_{t^2}\text{, }t\geq0$$ I need to find its variance, covariance, find out if it's ...
1
vote
1answer
1k views

When is a Markov process independent-increment?

An independent-increment stochastic process must be Markov. I am now wondering about the reverse case. Why do some Markov processes fail to be independent-increment? What are some examples of Markov ...
0
votes
1answer
40 views

positiv Martingale process

I would to like to prove that the process: $$e^{\int_{0}^{T}\theta _{s}dW_{s}-\frac{1}{2}\int_{0}^{T}\theta _{s}^2ds}$$ is a martingale which is positiv and has a mean=1 $$\theta is continuous ...
0
votes
1answer
69 views

Distribution of a transformed Brownian motion

Let $W$ be a standard Brownian motion. From an earlier proven result I know that $N_t = \exp\left\{a W_t - \frac12 a^2 t \right\}$ defines a martingale on the natural filtration of $W$ for all $a \in ...
0
votes
1answer
112 views

Prove $A_t := W_t^3-3t W_t$ a martingale

Given prob space $(\Omega, \mathscr{F}, P)$ and a Wiener process $(W_t)_{t \geq 0}$, define filtration $\mathscr{F}_t = \sigma(W_u : u \leq t)$ Let $(A_t)_{t \geq 0}$ where $A_t = W_t^3 - 3tW_t$. ...
0
votes
1answer
83 views

Including non-markovian processes in a birth-death process

Current model I want to model a stochastic system with a birth-death (Markovian) model. I therefore have this kind of $n$ times $n$ (where $n$ is the number of possible states) transition matrix: ...
0
votes
1answer
77 views

Brownian motion - Hölder continuity

Let $B$ stand for a Brownian motion on a finite interval $[0,1]$. If I am not wrong, I think that there exists a positive constant $c$, such that almost surely, for $h$ small enough , for all $0< t ...
0
votes
1answer
55 views

Simulate simple non-homogeneous Poisson proces

Consider a Poisson process whose conditional intensity is $$\lambda(t) = \alpha e^{-t}$$ starting at time $t=0$ for some parameter $\alpha>0$. I would like to simulate arrival/event/failure ...
0
votes
1answer
68 views

Relation between autocorrelation and mean of a stochastic process

It is said that if the autocorrelation approaches zero as $\tau$ tends to zero, then the mean of the stochastic process is also zero. I am having trouble understanding the above concept. Say we have ...
0
votes
1answer
89 views

Showing the square of a Markov process is or isn't Markov

Hi I am trying to show that if $X_n$ is a markov process, whether or not $X_n^2$ is a markov process. $X_n$ is a markov process if $P\{X_k = a_k|X_{k-1} = a_{k-1}, X_{k-2} = a_{k-2}, ..., X_k = a_1 ...
0
votes
1answer
130 views

Determining computational complexity of stochastic processes

I have an program which implements a Markov chain Monte Carlo process on a system of N bits, stopping when the process converges. Let's use T to denote the average number of steps made by the Markov ...
-1
votes
1answer
61 views

What is the integral of a family of diffusion processes? [closed]

Let $S$ be an infinite subset of $[0,1]$. For all $s \in S$, let W_s(t) be a standard Wiener process. Definite P(s)_t = \mu(P,s,t) dt + \sigma(P,s,t) dW^s_t Can we characterize? $$F_t= \int_S P(s)_t ...
20
votes
1answer
3k views

What is the Kolmogorov Extension Theorem good for?

The Kolmogorov Extension Theorem says, essentially, that one can get a process on $\mathbb{R}^T$ for $T$ being an arbitrary, non-empty index set, by specifying all finite dimensional distributions in ...
45
votes
5answers
7k views

Convergence of $np(n)$ where $p(n)=\sum_{j=\lceil n/2\rceil}^{n-1} {p(j)\over j}$

Some years ago I was interested in the following Markov chain whose state space is the positive integers. The chain begins at state "1", and from state "n" the chain next jumps to a state uniformly ...
18
votes
5answers
4k views

Good introductory book for Markov processes

Which is a good introductory book for Markov chains and Markov processes? Thank you.