Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

The characteristic function of a random variable X is given by $$\Phi_X(\omega) = \mathbb{E}e^{j\omega X}=\int_{-\infty}^\infty e^{j\omega x}f_X(x) dx.$$ One can easily capture the similarity between this integral and the Fourier transform.

For a standard normal random variable, the characteristic function can be found as follows: $$\Phi_X(\omega)= \int_{-\infty}^\infty \frac{1}{\sqrt{2\pi}}e^{-\frac{x^2}{2}}e^{j\omega x} dx = \int_{-\infty}^\infty \frac{1}{\sqrt{2\pi}}\exp\left(-\frac{(x^2-2j\omega x)}{2}\right)dx $$

I know that the answer must be $\Phi_X(\omega) = \exp(-\omega^2/2)$, but can you explain how to evaluate the integral with a complex number in the exponent?

share|improve this question
1  
You can take the derivative with respect to $\omega$, and integrate by parts to get a differential equation. –  Davide Giraudo Nov 27 '11 at 13:32
    
Is it a good way to use the fact that "If $f$ and $g$ are real functions then $\int (f + i g) = \int f + i \int g$" math.stackexchange.com/q/85941/1281 ? –  Tim Nov 27 '11 at 13:40
add comment

1 Answer

up vote 11 down vote accepted

I will give two answers:

Do it without complex numbers, notice that

$$ \begin{eqnarray} \mathcal{F}(\omega) = \int_{-\infty}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \mathrm{e}^{j \omega x} \mathrm{d} x &=& \int_{0}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \mathrm{e}^{j \omega x} \mathrm{d} x + \int_{-\infty}^0 \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \mathrm{e}^{j \omega x} \mathrm{d} x \\ &=& \int_{0}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \mathrm{e}^{j \omega x} \mathrm{d} x + \int_{0}^{\infty} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \mathrm{e}^{-j \omega x} \mathrm{d} x \\ &=& 2 \int_{0}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \cos(\omega x) \mathrm{d} x \end{eqnarray} $$ Now, compute $\mathcal{F}^\prime(\omega)$, and integrate by parts: $$\begin{eqnarray} \mathcal{F}^\prime(\omega) &=& -\frac{2}{\sqrt{2\pi}} \int_0^\infty \mathrm{e}^{-\frac{x^2}{2}} x \sin(\omega x) \mathrm{d} x = \frac{2}{\sqrt{2\pi}} \int_0^\infty \sin(\omega x) \mathrm{d} \left( \mathrm{e}^{-\frac{x^2}{2}} \right) \\ &=& \frac{2}{\sqrt{2\pi}} \left. \mathrm{e}^{-\frac{x^2}{2}} \sin(\omega x) \right|_0^\infty - \frac{2}{\sqrt{2\pi}} \int_0^\infty \mathrm{e}^{-\frac{x^2}{2}} \omega \cos(\omega x) \mathrm{d} x \\ &=& - \omega \mathcal{F}(\omega) \end{eqnarray} $$ The solution to so obtained ODE, $\mathcal{F}^\prime(\omega) = - \omega \mathcal{F}(\omega)$ is $\mathcal{F}(\omega) = c \exp\left( - \frac{\omega^2}{2} \right)$, and the integration constant is seen to be one from normalization requirement $\mathcal{F}(0)=1$ of the Gaussian probability density.

Complex integration: As you have started, complete the square: $$ \left( -\frac{x^2}{2} + j \omega x \right) = \left( -\frac{x^2}{2} + j \omega x + \frac{\omega^2}{2} \right) - \frac{\omega^2}{2} = -\frac{1}{2} \left( x - j \omega \right)^2 - \frac{\omega^2}{2} $$ We then have: $$ \mathcal{F}(\omega) = \mathrm{e}^{-\frac{\omega^2}{2}} \cdot \int_{-\infty}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{1}{2} \left( x - j \omega \right)^2 } \mathrm{d} x $$ The integral $I = \int_{-\infty}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{1}{2} \left( x - j \omega \right)^2 } \mathrm{d} x$ is indeed $1$. To see this, consider $$ \begin{eqnarray} I_L &=& \int_{-L}^L \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{1}{2} \left( x - j \omega \right)^2 } \mathrm{d} x = \int_{-L-j \omega}^{L-j \omega} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z \\ &=& \left(\int_{-L-j \omega}^{L-j \omega} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z - \int_{-L}^{L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z\right) + \int_{-L}^{L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z \\ &=& \left(\int_{-L-j \omega}^{L-j \omega} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z - \int_{-L}^{L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z\right) + \mathcal{I}_L \end{eqnarray} $$ Here we denoted $\mathcal{I}_L = \int_{-L}^{L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z$. Notice that $\lim\limits_{L \to \infty} \mathcal{I}_L = 1$.

Consider a complex contour $\mathcal{C}$, $ -L \to L \to L - j \omega \to -L - j \omega \to -L$: $$ \begin{eqnarray} I_L - \mathcal{I}_L &=&\left(\int_{-L-j \omega}^{L-j \omega} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z - \int_{-L}^{L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z\right) \\ &=& -\int_\mathcal{C} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z - \int_{L}^{L-j \omega} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z - \int_{-L-j \omega}^{-L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z \end{eqnarray} $$ The integral over $\mathcal{C}$ is zero, since the integrand is holomorphic. Therefore: $$ I-1 = \lim_{L \to \infty} (I_L-\mathcal{I}_L) = \lim_{L \to \infty} \left( - \int_{L}^{L-j \omega} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z - \int_{-L-j \omega}^{-L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z \right) $$ And the limit above is easily seen to vanish. Indeed: $$ \lim_{L\to\infty} \left| \mathrm{e}^{-\frac{-(-L - j \omega t)^2}{2}} \right| = \lim_{L\to\infty} \left| \mathrm{e}^{-\frac{-(L^2 + \omega^2 t^2)}{2}} \right| =0. $$

share|improve this answer
    
+1. Thanks! Why instead of directly computing $\int_{0}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \cos(\omega x) \mathrm{d} x $ (btw, I don't know how to directly integrate it), you solved it indirectly by constructing a ODE? –  Tim Nov 27 '11 at 14:14
    
@Tim It seemed like the simplest approach. The only two other approaches I am aware of are 1) to write $\cos(\omega x)$ into Taylor series and integrate term-wise, 2) use Mellin-convolution theorem. Neither is simpler. –  Sasha Nov 27 '11 at 14:24
    
Sasha: the $+1$ term which appears at the third line in the computation of $I_L$ should read $1+o(1)$, I believe. –  Did Dec 10 '11 at 21:35
    
@DidierPiau Welcome back and thank you for the feedback. I have edited the post to make the equation precise. –  Sasha Dec 10 '11 at 22:17
    
how in the first method, is moving d/dw into the integral justified? –  DinkyDoe Nov 13 '12 at 0:19
show 1 more comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.