A stochastic, or random, process describes the correlation or evolution of random events. It is used to model stock market fluctuations and electronic/audio-visual/biological signals. Among the most well-known stochastic processes are random walks and Brownian motion.

learn more… | top users | synonyms

51
votes
4answers
3k views

Why did my friend lose all his money?

Not sure if this is a question for math.se or stats.se, but here we go: Our MUD (Multi-User-Dungeon, a sort of textbased world of warcraft) has a casino where players can play a simple roulette. My ...
42
votes
5answers
7k views

Convergence of $np(n)$ where $p(n)=\sum_{j=\lceil n/2\rceil}^{n-1} {p(j)\over j}$

Some years ago I was interested in the following Markov chain whose state space is the positive integers. The chain begins at state "1", and from state "n" the chain next jumps to a state uniformly ...
34
votes
7answers
6k views

Proving that 1- and 2-d simple symmetric random walks return to the origin with probability 1

How does one prove that a simple (steps of length $1$ in directions parallel to the axes) symmetric (each possible direction is equally likely) random walk in $1$ or $2$ dimensions returns to the ...
25
votes
1answer
448 views

Zombie outbreak on a $k$-regular graph

Suppose we have a zombie outbreak on a connected $k$-regular graph of order $n$. There are $n_0$ initially infected zombie nodes, and each turn, each zombie infects its neighbors with probability ...
23
votes
2answers
889 views

Drunkard's walk on the $n^{th}$ roots of unity.

Fix an integer $n\geq 2$. Suppose we start at the origin in the complex plane, and on each step we choose an $n^{th}$ root of unity at random, and go $1$ unit distance in that direction. Let ...
23
votes
1answer
2k views

Going to the Movies!

I was looking at movie times today and was struck by the oddly-spaced showing times. For example, at the local Loew's Theater "Tron: Legacy 3D" (127 min.) is playing on two screens at the following ...
18
votes
5answers
2k views

What is a Markov Chain?

What is a intuitive explanation of a Markov Chain, and how they work? Please provide at least one practical example.
18
votes
2answers
521 views

Does Brownian motion visit every point uncountably many times?

Let $B_t$ be a one-dimensional standard Brownian motion. Is it true that, almost surely, for every $x \in \mathbb{R}$ the set $\{t : B_t = x\}$ is uncountable? Let $A_x$ be the event that $\{t : ...
17
votes
1answer
2k views

What is the Kolmogorov Extension Theorem good for?

The Kolmogorov Extension Theorem says, essentially, that one can get a process on $\mathbb{R}^T$ for $T$ being an arbitrary, non-empty index set, by specifying all finite dimensional distributions in ...
16
votes
1answer
623 views

Slowest frog on a ladder amongst many, how fast does it climb and how much is it lagging below the others?

In English: Frogs are climbing up a ladder. Each frog jumps to the next level of the ladder at unit rate and independently of the other frogs and of the level it is at. All the frogs start at level ...
16
votes
5answers
3k views

Good introductory book for Markov processes

Which is a good introductory book for Markov chains and Markov processes? Thank you.
15
votes
5answers
909 views

Ant in a circle

An ant is sitting in the middle of a circle of radius 3 meters. Every minute, the ant picks a random direction and moves straight 1 meter. On average, how long does it take the ant to leave the ...
15
votes
2answers
921 views

Brownian bridge expression for a Brownian motion

Let $B_t$ be a standard Brownian motion in $\mathbb R$, then the Brownian bridge on $[0,1]$ is defined as $$ Y_t = a(1-t)+bt+(1-t)\int\limits_0^t\frac{\mathrm dB_s}{1-s} $$ for $0\leq t<1$. Here ...
15
votes
1answer
659 views

Stochastic interpretation of Einstein Equations

Einsteins theory of gravitation, general relativity, is a purely geometric theory. In a recent question I wanted to know what the relation of Brownian Motion to the Helmholtz equation is and got a ...
14
votes
1answer
505 views

Hilbert's Barber Shop

Hilbert opens a barber shop with an infinite number of chairs and an infinite number of barbers. Customers arrive via a Poisson random process with an expected 1 person every 10 minutes. Upon arrival, ...
13
votes
3answers
2k views

The Laplace transform of the first hitting time of Brownian motion

Let $B_t$ be the standard Brownian motion process, $a > 0$, and let $H_a = \inf \{ t : B_t > a \}$ be a stopping time. I want to show that the Laplace transform of $H_a$ is ...
12
votes
4answers
395 views

Roadmap to SPDEs

I'm trying to learn about the Kushner-Stratonovich-Pardoux equations in filtering theory. I'm familiar with Itô calculus at the level of Øksendal's book (but struggle with much of Karatzas and ...
12
votes
5answers
6k views

What's the difference between stochastic and random?

What's the difference between stochastic and random? I've read in the portuguese wikipedia that there's a difference, but I still didn't see this point on english wikipedia.
12
votes
2answers
999 views

Random walk on n-cycle

For a graph G, let W be the (random) vertex occupied at the first time the random walk has visited every vertex. That is, W is the last new vertex to be visited by the random walk. Prove the following ...
12
votes
3answers
205 views

How to generate points uniformly distributed on the surface of an ellipsoid?

I am trying to find a way to generate random points uniformly distributed on the surface of an ellipsoid. If it was a sphere there is a neat way of doing it: Generate three $N(0,1)$ variables ...
12
votes
2answers
425 views

Difference in probability distributions from two different kernels

I wonder if the probability kernels of Markov processes on the same state space are close enough, does it also hold for the probabilities of the event that depend only on first $n$ values of the ...
12
votes
3answers
363 views

Limit of a Wiener integral

How to show that $$ \lim _{\alpha \rightarrow \infty } \sup_{t \in \left [0,T \right]} \left | e^{-\alpha t} \int _ 0 ^t e^{\alpha s} ~ dB_s \right | =0, \ \ \text{a.e.} $$ where $\left (B_s ...
12
votes
1answer
1k views

What is meant by a continuous-time white noise process?

What is meant by a continuous-time white noise process? In a discussion following a question a few months ago, I stated that as an engineer, I am used to thinking of a continuous-time ...
11
votes
3answers
2k views

Can I apply the Girsanov theorem to an Ornstein-Uhlenbeck process?

Let $W_t$ be a standard Brownian motion, and $X_t$ a measurable adapted process. Girsanov's theorem says that under certain conditions, the Brownian motion with drift $Y_t = W_t - \int_0^t X_s\,ds$ ...
11
votes
2answers
2k views

Nice references on Markov chains/processes?

I am currently learning about Markov chains and Markov processes, as part of my study on stochastic processes. I feel there are so many properties about Markov chain, but the book that I have makes ...
11
votes
1answer
364 views

Does this modified random walk (2D) return with probability 1?

Pólya showed that a random walk (with the directions at each step uniformly distributed) on the integer lattice returns with probability 1. What if instead we consider the random walk where we are ...
11
votes
2answers
261 views

Filtration and measure change

I'm reading Steven E. Shreve's "Stochastic calculus for finance II", and find myself not really understand the concept of "filtration". Yes, the definition of filtration is straight forward, it's ...
11
votes
1answer
426 views

Motivation of Feynman-Kac formula and its relation to Kolmogorov backward/forward equations?

Kolmogorov backward/forward equations are pdes, derived for the semigroups constructed from the Markov transition kernels. Feynman-Kac formula is also a pde corresponding to a stochastic process ...
11
votes
1answer
671 views

Probability density function of the integral of a continuous stochastic process

I am interested in whether there is a general method to calculate the pdf of the integral of a stochastic process that is continuous in time. My specific example: I am studying a stochastic given ...
10
votes
2answers
616 views

Relation of Brownian Motion to Helmholtz Equation

one can obtain solutions to the Laplace equation $$\Delta\psi(x) = 0$$ or even for the Poisson equation $\Delta\psi(x)=\varphi(x)$ in a Dirichlet boundary value problem using a random-walk approach, ...
10
votes
2answers
514 views

What is the importance of the infinitesimal generator of Brownian motion?

I have read that the infinitesimal generator of Brownian motion is $\frac{1}{2}\small\triangle$. Unfortunately, I have no background in semigroup theory, and the expositions of semigroup theory I have ...
10
votes
4answers
540 views

Probability of global epidemic

Consider $\mathbb{Z}^2$ as a graph, where each node has four neighbours. 4 signals are emitted from $(0,0)$ in each of four directions (1 per direction) . A node that receives one signal (or more) at ...
10
votes
2answers
321 views

Area enclosed by 2-dimensional random curve

Consider a 2-dimensional Wiener process $(W_t)_{t \in [0,1]}$. Color every area which is enclosed by the line parametrised by $W_t$ (this means that, when the Wiener process makes a loop and ...
10
votes
2answers
263 views

A sequence of order statistics from an iid sequence

Given a sequence of iid random variables $X_i$ (without loss of generality from $U(0,1)$), an integer $k \ge 1$ and some $p \in (0,1)$, construct the sequence of random vectors $Z^{(j)}$, $j=0,1,...$ ...
10
votes
1answer
200 views

Ruin time for a two-input “risk only” slot machine

Imagine a "risk only" slot machine that takes 'coins' corresponding to some real number fraction of a dollar $p$, returns the coin with probability $p$, and eats the coin with probability $(1-p)$. ...
10
votes
1answer
411 views

Is a Markov process a random dynamic system?

A random dynamic system is defined in Wikipedia. Its definition, which is not included in this post for the sake of clarity, reminds me how similar a Markov process is to a random dynamic system just ...
10
votes
0answers
166 views

Removing deterministic discontinuities from semi-martingales

Let $X:=(X_t)_{0 \le t \le T}$ be a solution of the SDE $$ X_t = X_0 + \int_0^t \sigma(s,X_s) dW_s + \sum_{i=1}^n f_i(X_{t_i^-}) 1_{\{t > t_i\}}$$ where $t_1,\cdots,t_n \in [0,T]$ and $(f_i)_{1 \le ...
10
votes
2answers
482 views

Given particle undergoing Geometric Brownian Motion, want to find formula for probability that max-min > z after n days

Consider a particle undergoing geometric brownian motion with drift $\mu$ and volatility $\sigma$ e.g. as in here. Let $W_t$ denote this geometric brownian motion with drift at time $t$. I am looking ...
9
votes
4answers
1k views

Showing that Brownian motion is bounded with non-zero probability

How do you show, that for every bound $\epsilon$, there is a non-zero probability that the motion is bounded on a finite interval. i.e. $$\mathbb{P} (\sup_{t\in[0,1]} |B(t)| < \epsilon) > 0$$ I ...
9
votes
2answers
246 views

A planar Brownian motion has area zero

I'm looking for proofs of Paul Lévy's theorem that a planar Brownian motion has Lebesgue measure $0$. I know of only two proofs: one is in Lévy's original paper (Théorème 12, p. 532) and the other is ...
9
votes
2answers
2k views

Considering Brownian bridge as conditioned Brownian motion

Let $B$ be a standard Brownian motion. Define a Brownian bridge $b$ by $b_t=B_t-tB_1$. Let $\mathbb{W'}$ be the law of this process. According to Wikipedia, A Brownian bridge is a ...
9
votes
2answers
609 views

Joint moments of Brownian motion

My approach to this SE question uses the following joint moments of Brownian motion. For $n=1,2$ they are obvious and well-known, the others are not terribly hard to work out. Is there a reference ...
9
votes
2answers
464 views

SDE with no strong solutions and Euler-Maruyama

Tanaka's SDE [see wikipedia article] $\text{d}X_t = \operatorname{sgn}( X_t ) \; \text{d}B_t$ with $X_0 = 0$, where $\operatorname{sgn}(x) = 1$ if $ x\ge 0$ and $\operatorname{sgn}(x) = -1$ if ...
9
votes
2answers
1k views

Hitting time of Brownian Motion with a drift

Let $X_t =x+bt+\sqrt{2}W_t$, where $W_t$ is a standard Brownian motion. Let $T=\inf\{t: |X_t|=1\}$. I am trying to find $\mathbb{E}[T]$ for the case $b\neq0$. Firstly, I am going to apply Girsanov to ...
9
votes
0answers
367 views

Expected value of the distance square

Given two points $X,Y$ on two sides of square $[0,1]\times [0,1]$ ($X:(0,1/2),Y:(1,1/2)$ (PS: My original question is $X,Y$ on opposite of a square, but I think that's not the real case) )and $n$ ...
9
votes
1answer
1k views

Quadratic variation of Brownian motion and almost-sure convergence

Say that $W(t)$ is a Brownian motion. The quadratic variation $[W,W](t)$ is defined in terms of a partition $\Pi = \{0 = t_0 < t_1 < \cdots < t_n = t\}$ by $$ \begin{split} [W,W](t) &= ...
8
votes
2answers
542 views

Sobolev meets Wiener

Even though the Wiener process (Brownian motion) is continuous, it has no derivative at any point. Does it at least have weak derivatives?
8
votes
3answers
952 views

Criteria for being a true martingale

Could you kindly list here all the criteria you know which guarantee that a continuous local martingale is in fact a true martingale? Which of these are valid for a general local martingale (non ...
8
votes
2answers
818 views

Prokhorov metric vs. total variation norm

Let $(S,d)$ be a metric space and let $\mathcal P(S)$ denote the space of Borel probability measures on $S$ endowed with the Prokhorov metric $\pi:\mathcal P(S)\times \mathcal P(S)\to \mathbb R_+$ ...
8
votes
1answer
415 views

A question about stochastic processes and stopping times

Working through the book "Brownian Motion & Stochastic Processes" by Karatzas and Shreve, I found the following problem (page 6, Problem 2.2): Let $ X $ be a stochastic process and $ T $ a ...