A stochastic, or random, process describes the correlation or evolution of random events. It is used to model stock market fluctuations and electronic/audio-visual/biological signals. Among the most well-known stochastic processes are random walks and Brownian motion.

learn more… | top users | synonyms

1
vote
2answers
207 views

Generating function of the stopping time

Let $X_t$ be a generalized Wiener process with drift rate $\mu$ and variance $\sigma^2$, and let $\tau$ be the stopping time $$\tau:=\inf \left\{ t\geq0: X_t= b\right\}, \quad b\geq0 $$ Can anyone ...
1
vote
1answer
732 views

Scalar product of Gaussian process

Assume that $n(t)$ is a White Gaussian Noise (WGN) process with $E[n(t)]=0$, $E[n(t)^2]=\sigma^2$ and $x(t)$ a deterministic function defined in $[0,T]$. How can I compute from first principles the ...
0
votes
2answers
1k views

Pure Birth Process Question

I would appreciate any possible help for this question because I have no clue what to do! Thanks so much! Consider a population made of a fixed number (N) of people. At time t=0 there is only one ...
8
votes
1answer
352 views

PDE - Feynman-Kac vs. finite difference methods

I've heard that in greater than three dimensions, it's more efficient to solve a second-order parabolic PDE using a Monte-Carlo method based on the Feynman-Kac formula that it is to use finite ...
5
votes
2answers
3k views

How do you check if a sequence of numbers is truly random? [duplicate]

Suppose a source produces an indefinite sequence of positive integers. How can you check whether the numbers are generated truly randomly?
4
votes
1answer
1k views

Why does a time-homogeneous Markov process possess the Markov property?

Klenke defines (Definition 17.3, p. 346) a time-homogeneous Markov process independently, rather than as a special case of a stochastic process that possesses the Markov property (Definition 17.1, p. ...
4
votes
1answer
1k views

Expectation value of a product of an Ito integral and a function of a Brownian motion

this problem has come up in my research and is confusing me immensely, any light you can shed would be deeply appreciated. Let $B(t)$ denote a standard Brownian motion (Wiener process), such that the ...
4
votes
1answer
811 views

Relations between Order Statistics of Uniform RVs and Exponential RVs

Say we have $U_1 \dots U_n$ i.i.d. random variables uniform on $[0,1]$ and $Y_1 \dots Y_{n+1}$ i.i.d. random variables distributed as $Y_i \sim Exp(1)$. I know that the joint distribution of the order ...
4
votes
1answer
461 views

Doob's inequality in probability

In the book "Optimal Stopping and Free-Boundary Problems" there is given Doob's inequality of the following form. Let $X = (X_t,F_t)$ be a submartingale. Then for any $\varepsilon>0$ and each ...
3
votes
1answer
385 views

Random walk $< 0$

Suppose ${X_t}$ is a random walk with mean zero. (either discrete or continuous time) Fix a time $T$. What is: $P[X_t < 0 \text{ for all } t \leq T]$? In words, what's the probability the random ...
2
votes
1answer
77 views

Is $(B_t^2)$ Markov where $(B_t)$ is Brownian motion?

I am pretty sure $(B_{t}^{2})$ not Markov because the squared random walk is not. Showing the square of a Markov process is or isn't Markov I guess I can repeat the method since to be Markov it ...
2
votes
1answer
138 views

solution of SDE: $dS_t=(\alpha S_t+f(t))dW_t$

does someone know how to solve the following SDE $$dS_t=(\alpha S_t+f(t))dW_t, S_0=s$$ where $f(t)$ is a deterministic function and $W_t$ is a standard brownian motion. Is there a explicit solution ...
2
votes
1answer
174 views

A bound for the probability that a Brownian motion stays in an interval

Suppose I have a Brownian motion $X_t$ with $X_0=0$. Let $T$ be the first exit time of the interval $[-1,1]$. I'm trying to get a "quick" lower bound for the probability that $T$ is very large which ...
2
votes
1answer
561 views

Limiting distribution and initial distribution of a Markov chain

For a Markov chain (can the following discussion be for either discrete time or continuous time, or just discrete time?), if for an initial distribution i.e. the distribution of $X_0$, there exists ...
2
votes
1answer
273 views

Chebyshev Inequality for Martingales

Suppose $\{X_n\}_{n \geq 1}$ is a square-integrable martingale with $E(X_1)=0$. Then for $c>0$: $$P\left(\max_{i=1, \ldots, n} X_i \geq c\right) \leq ...
2
votes
1answer
217 views

Homogeneous Poisson processes

Suppose that $N$ is a homogeneous Poisson process with rate $\lambda$. For $0 \le s \le t < \infty$, how can we find $\mathbb E[N_s\cdot N_t]$?
2
votes
2answers
130 views

sub martingales and more

This is a problem on sub-martingales. Given : $X_n = X_0 \mathrm{e}^{\mu S_n}$, $n= 1,2,3,\ldots$, where $X_0 > 0$ and where $S_n$ is a symmetric random walk and $\mu$ is greater than zero. We ...
2
votes
1answer
378 views

Probability distribution of sign changes in Brownian motion

Let us consider a 1d Brownian motion. Displacements in space will be positive or negative and this is a random variable $U(t)$ that characterizes a random process and that can take just the values ...
1
vote
1answer
33 views

The Continuity of Correlation Coefficient of a Continuous Stochastic Process

Given a continuous stochastic process with respect to time with finite variance at a given $t$. Does it necessarily imply, as $d\to 0$, 1) the covariance between $t$ and $t+d$ approaches the variance ...
1
vote
1answer
83 views

Expected Number of points in Point Poisson Process

Let $\lambda$ be the intensity of points, distributed as point poisson process, in a square grid of area $A$. Then, the Cumulative disributive function is given by: $$ P(r \leq R) = 1 - e^{-\lambda ...
1
vote
1answer
54 views

Simulate simple non-homogeneous Poisson proces

Consider a Poisson process whose conditional intensity is $$\lambda(t) = \alpha e^{-t}$$ starting at time $t=0$ for some parameter $\alpha>0$. I would like to simulate arrival/event/failure ...
1
vote
1answer
85 views

Evaluating Stratonovich integral from definition

$\bf 3.9.$ Suppose $f\in\mathcal V(0,T)$ and that $t\to f(t,\omega)$ is continuous for a.a. $\omega$. Then we have shown that $$\int\limits_0^T f(t,\omega)dB_t(\omega)=\lim_{\Delta ...
1
vote
0answers
135 views

Differential equation with random variable

How can I derive analytically or compute numerically the solution to following differential equation $$ dy/dt = y\cdot X\cdot (y\cdot X - g(y,X))\cdot X $$ where X is a random variable (e.g. from a ...
1
vote
1answer
640 views

Sum of 2 Brownian motions

Let's say, that $B_t$, $t\geq0$ is standard Brownian motion (Wiener process). Let's define process $$X_t=B_t+B_{t^2}\text{, }t\geq0$$ I need to find its variance, covariance, find out if it's ...
1
vote
1answer
956 views

When is a Markov process independent-increment?

An independent-increment stochastic process must be Markov. I am now wondering about the reverse case. Why do some Markov processes fail to be independent-increment? What are some examples of Markov ...
0
votes
1answer
75 views

Including non-markovian processes in a birth-death process

Current model I want to model a stochastic system with a birth-death (Markovian) model. I therefore have this kind of $n$ times $n$ (where $n$ is the number of possible states) transition matrix: ...
0
votes
1answer
70 views

Brownian motion - Hölder continuity

Let $B$ stand for a Brownian motion on a finite interval $[0,1]$. If I am not wrong, I think that there exists a positive constant $c$, such that almost surely, for $h$ small enough , for all $0< t ...
0
votes
1answer
52 views

Relation between autocorrelation and mean of a stochastic process

It is said that if the autocorrelation approaches zero as $\tau$ tends to zero, then the mean of the stochastic process is also zero. I am having trouble understanding the above concept. Say we have ...
0
votes
1answer
83 views

Showing the square of a Markov process is or isn't Markov

Hi I am trying to show that if $X_n$ is a markov process, whether or not $X_n^2$ is a markov process. $X_n$ is a markov process if $P\{X_k = a_k|X_{k-1} = a_{k-1}, X_{k-2} = a_{k-2}, ..., X_k = a_1 ...
0
votes
1answer
129 views

Determining computational complexity of stochastic processes

I have an program which implements a Markov chain Monte Carlo process on a system of N bits, stopping when the process converges. Let's use T to denote the average number of steps made by the Markov ...
18
votes
1answer
3k views

What is the Kolmogorov Extension Theorem good for?

The Kolmogorov Extension Theorem says, essentially, that one can get a process on $\mathbb{R}^T$ for $T$ being an arbitrary, non-empty index set, by specifying all finite dimensional distributions in ...
43
votes
5answers
7k views

Convergence of $np(n)$ where $p(n)=\sum_{j=\lceil n/2\rceil}^{n-1} {p(j)\over j}$

Some years ago I was interested in the following Markov chain whose state space is the positive integers. The chain begins at state "1", and from state "n" the chain next jumps to a state uniformly ...
17
votes
5answers
4k views

Good introductory book for Markov processes

Which is a good introductory book for Markov chains and Markov processes? Thank you.
8
votes
1answer
2k views

What are some open research problems in Stochastic Processes?

I was wondering, what are some of the open problems in the domain of Stochastic Processes. By Stochastic Processes. Any examples or recent papers or similar would be appreciated. The motivation for ...
7
votes
3answers
467 views

Is $(B_{t}+t)^{2}$ a Markov process?

Let $B_{t}$ be a Brownian motion relative to a filtration $F_{t}$, is $(B_{t}+t)^{2}$ a Markov process? Thanks!
13
votes
3answers
2k views

The Laplace transform of the first hitting time of Brownian motion

Let $B_t$ be the standard Brownian motion process, $a > 0$, and let $H_a = \inf \{ t : B_t > a \}$ be a stopping time. I want to show that the Laplace transform of $H_a$ is ...
9
votes
3answers
1k views

Criteria for being a true martingale

Could you kindly list here all the criteria you know which guarantee that a continuous local martingale is in fact a true martingale? Which of these are valid for a general local martingale (non ...
8
votes
1answer
2k views

Concept of Random Walk

Reading the Wikipedia page for Random Walk, I was wondering what is the definition for a general random walk as a random process, so that all the concepts such as random walk on $\mathbb{Z}^d$, ...
4
votes
4answers
3k views

What is more elementary than: Introduction to Stochastic Processes by Lawler

I have trouble to reading this book! What book is more elementary/preliminary than this book: Introduction to Stochastic Processes by Lawler
10
votes
2answers
642 views

Relation of Brownian Motion to Helmholtz Equation

one can obtain solutions to the Laplace equation $$\Delta\psi(x) = 0$$ or even for the Poisson equation $\Delta\psi(x)=\varphi(x)$ in a Dirichlet boundary value problem using a random-walk approach, ...
8
votes
1answer
352 views

Definition of the Brownian motion

The way I understood the definition of a Brownian motion $B_t$ in $\mathbb R$ is that it consists of two parts: We first define the finite-dimensional distributions $$ ...
5
votes
0answers
177 views

In stochastic calculus, why do we have $(dt)^2=0$ and other results?

I'm doing actuarial problems of Exam MFE and it covers some of the stochastic calculus (like Ito's Lemma). One of the frequently used results are the so-called "multiplication rules": $(dt)^2=0$ ...
4
votes
1answer
175 views

Is there a standard proof for $\mathbb P(S^X_n\text{ hits }A\text{ before }B) >\mathbb P(S^Y_n\text{ hits }A\text{ before }B)$?

Let $X_i$ and $Y_i$ be two continuous random variables on $\mathbb{R}$ having distribution functions $F$ and $G$, respectively satisfying $G(y)>F(y)$ for all $y$. Let futhermore $S^X_n=\sum_{i=1}^n ...
7
votes
3answers
1k views

Why is stopping time defined as a random variable?

I've been given a crash course in stochastic processes and martingales for the purposes of a semester project on them. The guy I'm working with has been, I feel, a little vague in the definition of ...
12
votes
2answers
328 views

A planar Brownian motion has area zero

I'm looking for proofs of Paul Lévy's theorem that a planar Brownian motion has Lebesgue measure $0$. I know of only two proofs: one is in Lévy's original paper (Théorème 12, p. 532) and the other is ...
7
votes
1answer
281 views

Properties of Markov chains

We covered Markov chains in class and after going through the details, I still have a few questions. (I encourage you to give short answers to the question, as this may become very cumbersome ...
5
votes
2answers
92 views

“Back to square one” problem

There's a problem I've been stuck on in preparation for junior programming contest I'm going to participate in. It is as follows: The "back to square one" problem is played on a board that has ...
5
votes
2answers
883 views

Intuition for random variable being $\sigma$-algebra measurable?

Is there some sort of intuition or a good ilustrative example for random variables being $\sigma$-algebra measurable? I understand the definition, but when looking at martingales, the meaning of ...
5
votes
1answer
420 views

$\int_0^tB_s^2\ dB_s$ - Gaussian Process and independent increments?

For $(B_t)_{t\ge0}$ a standard Brownian motion (Wiener process) define the stochastic process $X_t:=\int_0^tB_s^2\ dB_s$. I am currently trying to assess if $(X_t)_{t\ge0}$ is a Gaussian process and ...
4
votes
3answers
174 views

What is in clear mathematical terms the definition for a sequence of integers, to be called *random*?

Sequences of integers might be ordered, totally ordered,... For all such attributes we find definitions in clear mathematical terms. (1) But what is in clear mathematical terms the established and ...