Tell me more ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

The question is as follows, apologies in advance, I don't know how to do the LaTex thing in posts.

Let $X_1,\ldots,X_n, Y_1,\ldots,Y_n$ be independent random variables such that $X_i \sim N(\mu_1,\sigma^2)$ and $Y_j \sim N(\mu_2,\sigma^2)$. Both $\mu_1$ and $\mu_2$ are known but $\sigma^2$ is not.

Find the maximum likelihood estimator for $\sigma^2$ based on all $n+m$ observations. Show all working.

I am trying to work through with this but I am getting some horrible results when I get to the log-likelihood function. Any help in deriving the log-likelihood function would be appreciated.

Cheers.

share|improve this question
1  
Sounds a lot like a homework problem, and if so, pelase add the homework tag. Hint: Given observations $x_1,x_2,\ldots, x_m, y_1,y_2,\ldots,y_n$, replace each $x_i$ by $x_i-\mu_1$ and each $y_j$ by $y_j-\mu_2$. Now, you have $m+n$ observations of a zero-mean normal random variable of unknown variance $\sigma^2$. What is the likelihood function? What choice of value of $\sigma^2$ maximizes the likelihood function? Garnish and serve. – Dilip Sarwate Mar 11 at 2:59
Ok thanks for letting me know about the homework tag, I added that in. I can see what you are saying, but I am having trouble with writing down the likelihood function and taking the log of the likelihood, the product throws me out. – Stephen Mar 11 at 3:11
You mean you don't know a formula for the joint density of $m+n$ zero-mean independent normal random variables with common variance $\sigma^2$? Do you know the density of a single zero-mean normal random variable of variance $\sigma^2$? If so, can you use independence to figure out the rest? Also, maybe it isn't necessary to take logarithms? What is so hard about differentiating $av^{-m-n}\exp(-b/v)$ with respect to $v$ to figure out where the derivative is zero? – Dilip Sarwate Mar 11 at 3:19
I have given this question many attempts and still cannot work out how to get anything meaningful from what I have written. I think I have some gaps in my knowledge and despite by best attempts to bridge those gaps I don't really seem to be progressing. Approaching my lecturer has not been helpful. Anyways thank you for your suggestions, if you have anything else to add then please feel free to do so. – Stephen Mar 11 at 12:45

Know someone who can answer? Share a link to this question via email, Google+, Twitter, or Facebook.

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.