Questions on the Gaussian, or normal probability distribution, which may include multi-dimensional normal distribution.

learn more… | top users | synonyms

39
votes
9answers
6k views

What do $\pi$ and $e$ stand for in the normal distribution formula?

I'm a very beginner in mathematics and there is one thing I've been wondering recently. The formula for the normal distribution is: ...
36
votes
2answers
12k views

Expectation of the maximum of gaussian random variables

Is there an exact or good approximate expression for the expectation, variance or other moments of the maximum of $n$ independent, identically distributed gaussian random variables where $n$ is large? ...
31
votes
2answers
5k views

Why is the error function defined as it is?

$\newcommand{\erf}{\operatorname{erf}}$ This may be a very naïve question, but here goes. The error function $\erf$ is defined by $$\erf(x) = \frac{2}{\sqrt{\pi}} \int_0^x e^{-t^2}dt.$$ Of ...
19
votes
4answers
33k views

Is the product of two Gaussian random variables also a Gaussian?

Say I have $X \sim \mathcal N(a, b)$ and $Y\sim \mathcal N(c, d)$. Is $XY$ also normally distributed? Is the answer any different if we know that $X$ and $Y$ are independent?
15
votes
3answers
408 views

How to generate points uniformly distributed on the surface of an ellipsoid?

I am trying to find a way to generate random points uniformly distributed on the surface of an ellipsoid. If it was a sphere there is a neat way of doing it: Generate three $N(0,1)$ variables ...
13
votes
3answers
248 views

If $A$ is positive definite, then $\int_{\mathbb{R}^n}\mathrm{e}^{-\langle Ax,x\rangle}\text{d}x=\left|\det\left({\pi}^{-1}A\right)\right|^{-1/2}$

Let $A$ be a positive definite real $n\times n$ matrix. How can I prove that $$ \int_{\mathbb{R}^n}\mathrm{e}^{-\langle ...
12
votes
1answer
2k views

How was the normal distribution derived?

Abraham de Moivre, when he came up with this formula, had to assure that the points of inflection were exactly one standard deviation away from the center, and so that it was bell-shaped, as well as ...
11
votes
1answer
1k views

Cool examples of the Central Limit Theorem in action

Sir Francis Galton has described the Central Limit Theorem as follows. I know of scarcely anything so apt to impress the imagination as the wonderful form of cosmic order expressed by the "Law of ...
10
votes
3answers
22k views

How to calculate the integral in normal distribution?

The factory is making products with this normal distribution: $\mathcal{N}(0, 25)$. What should be the maximum error accepted with the probability of 0.90? [Result is 8.225 millimetre] How will I ...
9
votes
2answers
953 views

Why don't we allow the canonical Gaussian distribution in infinite dimensional Hilbert space?

I'm looking at Gaussian distributions in infinite-dimensional Hilbert space, and the sources I've seen so far say that the covariance matrix has to be of trace class (i.e. the trace must be finite). ...
9
votes
3answers
697 views

Is the mean of the truncated normal distribution monotone in $\mu$?

I am wondering whether the mean of the truncated normal distribution is always increasing in $\mu$. The untruncated distribution of $x$ is $\mathcal{N}(\mu,\sigma^2)$. The mean of the truncated ...
9
votes
1answer
285 views

Solution of differential equation related to Normal density

Let $\phi:\mathbb{R}\mapsto\mathbb{R}$ be the standard normal density, $$\phi(x)=\frac1{\sqrt{2\pi}}e^{-\frac{x^2}{2}}, \forall x\in\mathbb{R}.$$ Given $0<\sigma\le 1$. I wish to know whether there ...
9
votes
1answer
125 views

Characterization of normal distribution

I am sorry if this question is vague since I am completely unfamiliar with probability theory. Suppose that we have a family of real-valued random variables $X_n$ (say, all of them have mean 0) on ...
9
votes
1answer
438 views

length of Gaussian Random Vector

Suppose I have a random vector $x=[x_1,...,x_k]$ s.t. $x∼N(\mu,\sum)$. How is the length or magnitude of $x$ distributed? I know that if $k=2$ and $\sigma_1=\sigma_2$ and $\sigma_{12}=0$ ($x_1$ and ...
9
votes
1answer
122 views

Inequality for $N(0,1)$ CDF: $|\log F(v)|\leq |\log F(0)|+|v|+|v|^2$

Suppose that $F$ is the CDF of a standard normal distribution. Hayashi (2000) claims that the following is true $$ |\log F(v)|\leq |\log F(0)|+|v|+|v|^2\quad\text{for all}\quad v. $$ How does ...
9
votes
1answer
541 views

Volume of the intersection of ellipsoids

How do I compute the volume of the intersection of two $n$-dimensional ellipsoids? Given an $n$-vector $c$ and a symmetric positive-definite $n\times n$ matrix $A$, define the ellipsoid ...
9
votes
0answers
92 views

Looking for references related to an inequality in order statistics

I was reading the paper "on the minimum of several random variables". In example 10 item (ii) it states: Let $1\leq k\leq n$. Let $g_i,i\leq n$, be independent $N(0,1)$ Gaussian random variables. ...
8
votes
1answer
13k views

Calculation of the n-th central moment of the normal distribution $\mathcal{N}(\mu,\sigma^2)$

Since integration is not my strong suit I need some feedback on this, please: Let $Y$ be $\mathcal{N}(\mu,\sigma^2)$, the normal distrubution with parameters $\mu$ and $\sigma^2$. I know $\mu$ is the ...
8
votes
2answers
7k views

Product of Two Multivariate Gaussians Distributions

Given two multi-variate gaussians distrubtions, given by mean & covariance, G1(m1,sigma1) & G2(m2,sigma2), what are the formulae to find the product i.e G1 * G2 ? And if one was looking to ...
8
votes
2answers
205 views

Joint distribution of the signs of the partial sums of independent standard normal random variables

Consider some i.i.d. standard normal random variables. What is the joint distribution of the signs of their partial sums? More formally, define a sequence of random variables ...
8
votes
2answers
307 views

Computing the Gaussian integral with step functions

Say, we are interested in deriving $$\int_{-\infty}^{\infty}e^{-x^2}=\sqrt{\pi}\tag{1}$$ There are many well known ways to do it, for example: by polar coordinates via the gamma function, etc. ...
8
votes
2answers
504 views

Why should Gaussian noise have fractal dimension of 1.5?

In a paper I'm trying to understand, the following time series is generated as "simulated data": $$Y(i)=\sum_{j=1}^{1000+i}Z(j) \:\:\: ; \:\:\: (i=1,2,...,N)$$ where $Z(j)$ is a Gaussian noise with ...
7
votes
1answer
7k views

Probability of a point taken from a certain normal distribution will be greater than a point taken from another?

Let's say I have one point that will be taken randomly from a normal distribution with mean $\mu_1$ and standard deviation $\sigma_1$. Let's say I have another point that is taken much in the same ...
7
votes
3answers
4k views

Derivation of the density function of student t-distribution from this big integral.

My lecturer posed a question where we derive the density function of the student t-distribution from the Chi-square and Standard normal distribution. I worked on this question for days, and I am ...
7
votes
1answer
173 views

Concentration of measure bounds for multivariate Gaussian distributions (fixed)

Let $\gamma_n$ denote the standard Gaussian measure on $\mathbb{R}^n$. It is known (see for example Cor 2.3 here: http://www.math.lsa.umich.edu/~barvinok/total710.pdf) that ...
7
votes
0answers
331 views

What is the distribution of $\sqrt{X^2+Y^2}$ when $X$ and $Y$ are Gaussian but correlated?

If $Z = \sqrt{X^2+Y^2}$, and $X$ and $Y$ are zero-mean i.i.d. normally-distributed random variables, then $Z$ is Rayleigh distributed. What is the distribution of $Z$ if $X$ and $Y$ are correlated ...
6
votes
3answers
238 views

How do I evaluate $\int \limits_{-\infty}^{a} e^{−t^2}dt$?

I know that $$I \equiv \int \limits_{-\infty}^\infty e^{−t^2} \, dt=\sqrt{\pi},\text{ and }\int \limits_{-\infty}^0 e^{−t^2} \, dt=\frac{\sqrt{\pi}}{2}.$$ However, I don't understand if (or how) I ...
6
votes
4answers
109 views

If $X \sim N(0,1)$, why is $E(X^2)=1$?

If $X$ is a normally distributed with mean $0$ and variance $1$, expectation of $X$ equals $0$ but why is $E(X^2)=1$?
6
votes
1answer
171 views

An interesting inequality about the cdf of the normal distribution

When approaching this other question I came out with the inequality: $$\frac{1}{4+x^2}e^{-x^2/2} \leq\Phi(x)\Phi(-x)\leq \frac{1}{4}e^{-x^2/2},\tag{1}$$ where $\Phi(x)$ is the cdf of the standard ...
6
votes
1answer
924 views

Can the product of two non-independent Gaussians be Gaussian?

We recently discussed this: Is the product of two Gaussian random variables also a Gaussian? What was established was that in nontrivial cases (i.e., ruling out zero-variance Gaussians, which are ...
6
votes
1answer
86 views

Estimates for the normal approximation of the binomial distribution

I'm interested in estimates of the normal approximation for binomial distributions, i.e. in estimates of $$\sup_{x\in\mathbb R}\left|P\left(\frac{B(p,n)-np}{\sqrt{npq}} \le x\right) - ...
6
votes
1answer
280 views

Fractional Part of Sum of Sequence of Independent Normal Random Variables

I'm trying to prove that if $X_n$ iid normal $S_n = \sum_1^n X_i$ $U_n=S_n-\lfloor S_n\rfloor$ then $U_n$ is asymptotically uniform in distribution. I've got no idea how to approach this, and it's ...
6
votes
0answers
96 views

Normalizing factor for product of Gaussian densities - interpretation with Bayes theorem

The normalizing factor for the product of two multivariate Gaussian densities, $f(x)$ and $g(x)$ with mean vectors $a$ and $b$ respectively, and covariance matrices $A$ and $B$ respectively, is itself ...
5
votes
4answers
607 views

Sampling from a $2$d normal with a given covariance matrix

How would one sample from the $2$-dimensional normal distribution with mean $0$ and covariance matrix $$\begin{bmatrix} a & b\\b & c \end{bmatrix}$$ given the ability to sample from the ...
5
votes
1answer
13k views

What is the expectation of $ X^2$ where $ X$ is distributed normally?

I know that if $X$ were distributed as a standard normal, then $X^2$ would be distributed as chi-squared, and hence have expectation $1$, but I'm not sure about for a general normal. Thanks
5
votes
4answers
6k views

Asymmetric Normal Probability Distribution

I'm looking for a continuous probability distribution a little bit like the normal distribution but asymmetric. In my opinion this distribution applies to phenomenons related to response time in ...
5
votes
3answers
166 views

How to Make a PDF 'Look' Uniform?

Let $X$ be a normally-distributed random variable with mean zero and variance $\sigma^2$: $X \sim N(0,\sigma^2)$. Let $Y$ be a mapping from $X$ onto the interval $(0,1)$ using the sigmoid function: ...
5
votes
1answer
151 views

Estimating a gaussian distribution from a GMM

Suppose that we have a Gaussian mixture model (GMM) in n-dimensional space: $$P_1(x) = \sum_{i=1}^{C}\pi(c_i)\mathcal{N}(\mu_i,\Sigma_i)$$ We want to estimate a single Gaussian distribution from ...
5
votes
2answers
189 views

expectation equations

I am just trying to understand the following three equations. $\phi(x)$ denotes the standard Gaussian cumulative distribution function and $X$~$N(\mu,\sigma^2)$ (1) $\mathbb{E}[e^{tX}f(X)]=e^{\mu ...
5
votes
1answer
3k views

Linear transformation applied to a multivariate Gaussian random variable - what is the mean vector and covariance matrix of the new variable?

Given a random vector $\mathbf x \sim N(\mathbf{\bar x}, \mathbf{C_x})$ with normal distribution. $\mathbf{\bar x}$ is the mean value vector and $\mathbf{C_x}$ is the covariance matrix of ...
5
votes
1answer
2k views

Multivariate Normal Difference Distribution

Since the distribution of a difference of two normally distributed variates X and Y with means and variances $(\mu_x,\sigma_x^2)$ and $(\mu_y,\sigma_y^2)$ respectively is given by another normal ...
5
votes
1answer
454 views

$\int_0^tB_s^2\ dB_s$ - Gaussian Process and independent increments?

For $(B_t)_{t\ge0}$ a standard Brownian motion (Wiener process) define the stochastic process $X_t:=\int_0^tB_s^2\ dB_s$. I am currently trying to assess if $(X_t)_{t\ge0}$ is a Gaussian process and ...
5
votes
2answers
492 views

Convergence of a sequence involving the maximum of i.i.d. Gaussian random variables

It's well known that, for a sequence of $n$ i.i.d. standard Gaussian random variables $X_1,\ldots,X_n$, where $X_\max=\max(X_1,\ldots,X_n)$, the following convergence result holds: ...
5
votes
3answers
340 views

Central Limit Theorem Definition

My friend and I have a bet going about the definition of the Central Limit Theorem. If we define an example as a number drawn at random from some probability density function where the function has a ...
5
votes
1answer
4k views

X,Y are independent standard normal distributed then what is the distribution of $\frac{X}{X+Y}$

X, Y are independent standard normal random variables, what is the distribution of $$ \frac{X}{X+Y} $$ Could anyone help me with this? Thanks. I have worked the problem by multivariable ...
5
votes
2answers
33 views

correlation between $\sum_{i=1}^{98}X_i$ and $\sum_{i=3}^{100}X_i$

Let $X_1,...,X_{100}$ be iid $N(0,1)$ random variables. The correlation between $\sum\limits_{i=1}^{98}X_i$ and $\sum\limits_{i=3}^{100}X_i$ is equal to (A) $0$ (B) $\dfrac{96}{98}$ (C) ...
5
votes
2answers
126 views

Convolution with Gaussian, without distribution theory, part 1

I only know basic $L^p$ theory (nothing about distributions) and am trying to prove the following: Let $t>0$, $f\in L^{p}(\mathbb{R}^n,m)$, $\Gamma(t,x)=(4\pi t)^{-n/2}e^{-|x|^2/4t}$ and $$ ...
5
votes
1answer
216 views

Expectations containing normal CDF

Suppose that $X\sim\mathcal{N}\left(0,1\right)$ (i.e., $X$ is a standard normal random variable) and $a,b,$ and $c$ are some real constant. Does any of the following expectations have a closed-form? ...
5
votes
1answer
63 views

Checking the Lindeberg condition (central limit theorem)

Problem. Let $W_1, W_2,...$ be independent and identically distributed random variables such that $E(W_1)=0$ and $\sigma^2 := V(W_1) \in (0,\infty)$. Let $T_n = \frac{1}{\sqrt{n}} \sum_{j=1}^n a_j ...
5
votes
1answer
102 views

Berry-Esseen bound for binomial distribution

From the Berry-Essen theorem I can deduce $$\sup_{x\in\mathbb R}\left|P\left(\frac{B(p,n)-np}{\sqrt{npq}} \le x\right) - \Phi(x)\right| \le \frac{C(p^2+q^2)}{\sqrt{npq}}$$ with $C \le 0.4748$. My ...