Suppose that $X_1,X_2,...,X_n$ and $Y_1,Y_2,...,Y_n$ are all i.i.d. Normal$(0,\theta ^2)$.

What is the distribution of the random variable $T_i=X_i^2+Y_i^2$?

And what is the maximum likelihood estimate of $\theta$?

I know that usually the sum of normal random variables is still normal but I don't know if that applies here. I'm not really sure exactly what the question is asking me to do..

  • $\begingroup$ Do you know tha Chi-square distribution? $\endgroup$ – sinbadh Feb 26 '16 at 21:00
  • $\begingroup$ Yes I've seen it a little bit $\endgroup$ – Si.0788 Feb 26 '16 at 21:13
  • $\begingroup$ In order to answer the part about the MLE, you need to clarify what the data are. Do you mean $T_1, T_2, \dots, T_n?$ $\endgroup$ – BruceET Feb 26 '16 at 22:48

First, $U = X_i/\theta \sim Norm(0,1)$ and $V = Y_i/\theta \sim Norm(0,1).$ Then $U^2$ and $V^2$ are independently distributed as $Chisq(df=1).$ Moreover, $$U^2 + V^2 = (X^2 + Y^2)/\theta^2 = T/\theta^2 \sim Chisq(df = 2).$$

Following the Comment by @sinbadh, please see Wikipedia or your text (about the chi-squared family of distributions) for proofs of two facts used above, which can be done using moment generating functions:

(a) If $Z \sim Norm(0,1),$ then $Z^2 \sim Chisq(df=1).$

(b) If $Q_m \sim Chisq(df=m)$ and $Q_n \sim Chisq(df=n)$, then $Q_n + Q_m \sim Chisq(df= m+n).$

A result related to your second question is that if $X_1, X_2, \dots, X_n$ are a random sample from $Norm(\mu, \sigma^2),$ where $\mu$ is known, then the MLE of $\sigma^2$ is $\frac{1}{n}\sum_{i=1}^n (X-\mu)^2.$ And the MLE of $\sigma$ is $\sqrt{\frac{1}{n}\sum_{i=1}^n (X-\mu)^2}.$ The derivation of the MLE is routine.

For a contrast between this and the case where $\mu$ is $unknown,$ please see this related page.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.