Use this tag only if your question is about the modern theoretical footing for probability, for example probability spaces, random variables, law of large numbers, and central limit theorems. Use [tag:probability] instead for specific problems and explicit computations. Use ...

learn more… | top users | synonyms (1)

0
votes
0answers
2 views

Is Gaussian (X_1, X_2) optimal for $h(a_1X_1+ a_2X_2+Z_1) - \mu h( b_1X_1+b_2X_2+ Z_2)$?

Let \begin{align} W &= h(X_1+Z_1) - \mu h( X_2+ Z_2) \quad (1) \end{align} where $h(\cdot)$ is the differential entropy function, $\mu\ge 1 $ is a scalar, and $Z_1$ and $Z_2$ are independent ...
1
vote
0answers
16 views

Understanding a proof of the strong Markov property of Lévy processes

I don't understand the the last sentence of a proof of the Markov property for Lévy processes given in Jochen Wengenroth's textbook "Wahrscheinlichkeitstheorie" (de Gruyter, 2008). I will appreciate ...
2
votes
1answer
16 views

Conditional probability with max(X, Y)

Let $Y_n=$ the outcome of the $n$-th die roll, let $X_{n+1} = \max \{X_n, Y_{n+1}\}$ with $X_1=Y_1$. What is $P(X_{n+1}=j \ | X_1=i_1, ..., X_n=i)$? I know that it is $P(\max \{X_n, Y_{n+1} \}=j \ | ...
1
vote
1answer
26 views

Proving a statement about probability theory

Let X be arandom variable. Consider any constant $c\gt 0$ how to prove the following satement $$\sum P(|X|\ge cn) \lt \infty \iff E(|X|)\lt \infty $$ My answer trail: $E[|X|]=\sum_X|X|P_x(X)\lt ...
1
vote
1answer
26 views

Bayes theorem - is it applicable in any case?

I'm studying the Bayes' Theorem and I have a doubt. In this wikipedia page there's an example of application for the following events: ...
2
votes
0answers
6 views

Techniques to prove FDD convergence

When examining a sequence of stochastic processes $(\textbf{X}_n)$, $n\geq1$ convergence of marginals, i.e. $\mathbf{X}_n(t)\to\mathbf{X}(t)$ (in distribution) is often not too hard to establish for ...
0
votes
1answer
38 views

some properties of $\nu$ measure

For any given function $F$ satisfying the following properties $0\le F(x)\le1,\forall x\in\mathbb R$ $F(x)\le F(y),x\le y$ $\lim_{x\to-\infty}F(x)=0,\lim_{x\to\infty}F(x)=1$ $F$ is continuous from ...
2
votes
0answers
26 views

Hoeffding’s inequality extension

In Hoeffding’s inequality we assume that the random variables $X_i$ ,$i=1,..,n$ are i.i.d. and bounded . Is there any extension to Hoeffding’s inequality for the case that $X_i$ are identically ...
1
vote
0answers
12 views

bias reduction when the bias depends on the true parameter

Let's say we estimate a parameter, $\theta$, by $\hat{\theta}$. For this estimator we have the following property that $$\hat{\theta}\to_{p}\theta+f(\theta)$$ where $\to_{p}$ denotes convergence in ...
5
votes
1answer
46 views

A number-theoretic random walk on the integers

Suppose a random walker starts at $S_0 = 2$, and walks according to the following transition probabilities: If the walker is on the $n$th prime number $p_n$, she moves to either $p_n + 1$ or ...
2
votes
0answers
25 views

normal squared characteristic function derivation

I'm trying to derive the normal squared characteristic function, there's already a question on this but the answer has a part which is "proved as an excercise" which I try to do here. Is my proof ...
3
votes
0answers
29 views

Why is this class closed under difference?

We have two independent random variables $X\perp Y$ involving three spaces: $(\Omega,\mathcal{A},P), (E,\mathcal{E}), (F,\mathcal{F}).$: $$X:\Omega \rightarrow E,\ Y:\Omega\rightarrow F$$ My book says ...
1
vote
2answers
29 views

Eigenvalues of a transition probability matrix

I have read that, for $$I - \alpha P$$ where $I$ is the $n\times n$ identity matrix, $\alpha \in (0,1]$, and $P$ is the transition probability matrix with dimensions $n \times n$, $I - \alpha P$ is an ...
1
vote
1answer
37 views

Where is the dominated convergence theorem being used? (crosspost).

I am cross-posting a question I asked on cross-validated here. It is a mathematical doubt on the application of the dominated convergence theorem in the time series setting. I leave the ...
2
votes
1answer
24 views

Total variation distance is complete

For a given measurable space $X$, $\mathcal{P}(X)$ denotes the space of all the probability measures on $X$. The total variation distance $\rho$ on $\mathcal{P}(X)$ is defined by: for $\mu, \nu \in ...
0
votes
1answer
46 views

Question about Measure Theory [on hold]

Let $(\Omega, U, P)$ be a measure space and X be random variable and its distribution function $F_x(x)=P(\{\omega: X(\omega)\le x\})=P(-\infty , x]$ and the function F is continuous at x. If the ...
1
vote
1answer
35 views

interpreting wording of probability question

Two dice are rolled, and the sum of the face values is six. What is the probability that at least one ofnthe dice came up a three? I want to make sure that I am interpreting the language right when ...
0
votes
0answers
56 views

What is the probability that 5 randomly chosen cards in a deck add up to 40 or more? [on hold]

I have made a probability game, where you have to pull out any 5 cards without looking (from a deck of 52 cards), and if all five cards add up to 40 or more, they player pulling the 5 cards from the ...
1
vote
1answer
25 views

Notation: the $\sigma$-algebra $\mathcal{F}_\tau^+$

I'm reading a probability textbook on stochastic processes (Jochen Wengenroth's "Wahrscheinlichkeitstheorie", de Gruyter 2008) and the following notation: "$\mathcal{F}_\tau^+$" came up in the ...
0
votes
1answer
34 views

Pareto distribution

So I'm given a Pareto distribution with parameters $\alpha >0$ and $k>0$ which is the form of \begin{equation*} f(x) = \frac{\alpha k^\alpha}{x^{\alpha+1}},~x > k. \end{equation*} I found ...
1
vote
1answer
33 views

Measurability of a set

This question is from Karatzas's Brownian Motion and Stochastic Calculus page 108. Let $W_t$ be standard one-dimensional Brownian motion then it concludes that the set ...
2
votes
0answers
28 views

Branching Process in simple random walk

Suppose we have a simple random walk on $\mathbb{Z}$ which stars at $1$, i.e. we have iid increment $X_n$ valued in $+1,-1$ with probability $\frac{1}{2}$ each and the sum $S_n=\sum_{i=1}^{n}X_n+S_0$ ...
0
votes
0answers
22 views

Question concerning invariant distribution

Let us consider the Markov chain $(X_n)_{n \in \mathbb{N}}$ with state space $I = \{0,1\}^m$ and transition probabilities $$ p_{xy} = \begin{cases} m^{-1} &\mbox{if } \vert x - y \vert = 1 \\ 0 ...
0
votes
0answers
9 views

probability generating function moments for the multivariate case

Suppose ${\bf X} = (X_1, \ldots, X_d)$ is a non-negative integer-valued random vector, with pmf $p$, I tried to extend the results of the univariate generating function to the multivariate case, is ...
0
votes
2answers
38 views

proof of conditional probabilities

show that if the conditional probabilities exist then $$p(A_1\cap A_2 \cap \cdots \cap A_n) = p(A_1)p(A_2\mid A_1)p(A_3\mid A_1\cap A_2)\cdots p(A_n\mid A_1\cap A_2 \cap A_3\cap\cdots\cap A_{n-1})$$ ...
1
vote
1answer
29 views

probability of 26 letters

A monkey at a typewriter types each if the 26 letters of the alphabet exactly once, the order being random. A. What is the probanility that the word HAMLET appears somewhere in the string if letters? ...
0
votes
1answer
52 views

A measure theory question-1 [on hold]

Let $ (\Omega, \mathcal U, P)$ be a measure space and any events $A_1, A_2, A_3 \in \mathcal{U}$ And $ B$ is defined as event of occurrence of at least one of these three events. First I need to ...
0
votes
2answers
42 views

A probability theory question [on hold]

let X be a rondom variable and coonsider a non-negative function $g: \Bbb R \to \Bbb R^+$ Please help me sshowing this following statement; for $r\in \Bbb R^+ $, $$P(g(X)\gt r) ...
2
votes
3answers
31 views

If two different linear combinations of two random variables are Gaussian, can we deduct both of them are Gaussian.

If two different linear combinations of two random variables are Gaussian, can we deduct both of them are Gaussian. Mathematically, if we know that $a_1X+b_1Y$ and $a_2X+b_2Y$ have Gaussian ...
-2
votes
2answers
54 views

A question related to measura space

Let a real value $X$ be a random variable and consider $\int_{\Omega}|X|dP \lt \infty $. I need to show that \begin{equation*} nP(|X|\gt n)\to_{n\to \infty} 0. \end{equation*} please help me ...
0
votes
0answers
30 views

$\overline{X} \rightarrow c$ in probability $\Rightarrow g(\overline{X}) \rightarrow g(c)$ in probability

Prove that if $\overline{X} \rightarrow c$ in probability and if g is a continuous function, then $g(\overline{X}) \rightarrow g(c)$ in probability. Once I think in the situation $|g|<M$, it is ...
1
vote
0answers
22 views

Dvoretzky–Kiefer–Wolfowitz inequality holds for discrete distributions?

I am wondering whether Dvoretzky–Kiefer–Wolfowitz inequality holds for discrete distributions? Any comments or references would be greatly appreciated.
0
votes
2answers
21 views

Can't find intersection of two probabilities.

I have the following problem: While producing goods, defect through event A has 3% probability and defect through event B has 4% probability. Total goods that are not defected - 95%. Find correlation ...
2
votes
0answers
26 views

If $X_n$ are i.i.d. $Uniform(0,1)$ then show that $S_n$ converges a.s. to $\infty$

Suppose $\{X_n\}$ is an i.i.d. $Uniform(0,1)$ sequence of random variables. Define $S_n=X_1+X_2+...+X_n$. Show that $S_n\to\infty$ almost surely. I believe I have solved the problem and I wish ...
2
votes
1answer
30 views

Intuition/proof that $E(X)= \int X(w) dP = \int x d\alpha$, where $\alpha$ is the cumulative distribution function of X

Looking for more intuition/help explaining the equivalence of the following two integrals. I know that the push-forward measure, or the CDF, of a random variable $X$ on a prob. space $(\Omega, \cal ...
0
votes
2answers
28 views

Determing a transition probability matrix

I need some support with this homework exercise: An urn contains at most $N$ balls. Let $X_n$ be the number of balls in the urn after the $n$-th execution of the following procedure: If the urn is not ...
0
votes
1answer
18 views

independence and characteristic functions [duplicate]

Why is it that \begin{equation*} \mathbf{E} [e^{i t_1 X_1} e^{i t_2 X_2}] =\mathbf{E} [e^{i t_1 X_1}]\mathbf{E} [e^{i t_2 X_2}] \end{equation*} for RVs $X_1, X_2$ and all $t_1, t_2\in\mathbb{R}$ ...
1
vote
0answers
23 views

First moment inequality and time-average limits

Suppose $\{A(t)\}_{t \geq 0}$ and $\{B(t)\}_{t \geq 0}$ are two non-negative stochastic processes such that $$ \frac{1}{T} \int_{s=0}^T A(s) \, {\rm d} s \stackrel{\text{a.s.}}{\rightarrow} a \in ...
1
vote
1answer
19 views

Show intersection of two algebras are not a $\sigma$-algebra

I have the following question: $\textbf{Question}:$ Let $\mathcal{F}_1$ and $\mathcal{F}_2$ be two algebras. Is $\mathcal{F}_1 \cap \mathcal{F}_2$ a $\sigma$-algebra? I believe the answer is no. I ...
0
votes
1answer
13 views

convergence of continuous mapped RVs

This is an extension of the result in my textbook, I'm wondering if it's true and if there are any references to it's proof. Let $X_n$ be a sequence of random vectors in $\mathbb{R}^d$, let $g : ...
1
vote
1answer
103 views

Confidence Interval for Pareto Distribution

A random variable is said to have probability density function $$f_X(x)=\frac{\alpha k^\alpha}{x^{\alpha +1}},\quad \alpha , k>0 \; \text{ and }\; x>k.$$ 1. Compute the MLE estimators ...
3
votes
2answers
63 views

What are the odds of any role of a 24 sided die occurring 4 or more times in 10 rolls?

Note that I am not asking about the odds of a chosen roll happening 4 times in 10 rolls, (this has a probability of 0.000517 according to a binomial calculator), rather, the odds of ANY roll happening ...
0
votes
2answers
31 views

Two-dimensional Brownian motion

Let $B_1$ and $B_2$ be two $\mathbb{R}$-valued Brownian motions with $$\langle B_1,B_2\rangle=\int_0^t\rho_s ds,$$ where $\rho$ is progressively measurable with values in $(-1,1)$. We define ...
1
vote
1answer
33 views

Intuition behind variance in terms of $L^P$ norms?

I've just started working through Varadhan's Probability lecture notes, and I was wondering if there's any intuitive connection between the variance formula and Holder's inequality/ $L^p$ norms in ...
0
votes
0answers
17 views

Proving that each element in reservoir have equal probability of been selected in reservoir sampling?

Here is the description of the algorithm and proof of the correctness The algorithm creates a "reservoir" array of size $k$ and populates it with the first $k$ items of $S$. It then iterates through ...
-2
votes
1answer
30 views

Limit moment generating function

For n a natural number let $X_{n}$ have discrete uniform distribution on interval {1,2...,n} and $Y_{n} =\frac{1}{n} X_{n}$. I need to show that for all t(real number) the $\lim_{n \to \infty} ...
1
vote
0answers
11 views

Understanding the difference between convergence in distribution and convergence almost surely

I know that the sum of $\sum_{i=0}^nZ_i$ where $Z\sim N(0,1)$ has a distribution of a Chi squared distribution with $n$ degrees of freedom which in my understand means that $Z^2$ converges in ...
0
votes
1answer
21 views

A die is thrown $n$ times. $X_1$-number of times a number from $\{1,2,3\}$…

.. $X_2$ number of numbers that fell from $\{4,5\}$, $X_3$ number of $6's$ that fell. Find $$P\{ X_1=k\mid X_2=m\};0\leq m \leq n.$$ Now, I believe that $X_3$ is completely irrelevant here. What I ...
0
votes
2answers
23 views

In a box which has balls numbered 1..100 , 5 balls are drawn.

$X$- random variable that represents the largest number of the 5 drawn. Find the distribution of $X$. Now, it seems that this random variable is of discrete type. What I have trouble it defining it ...
0
votes
0answers
20 views

Questions on Kolmogorov Zero-One Law Proof

Here is the proof of the Kolmogorov Zero-One Law and the lemmas used to prove it in Rosenthal's Probability book: Here are my questions: Question 1: In the first red box, does the fact that Q ...