Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

I am having a hard time trying to solve this problem. I don't know how to start it. Any help would be greatly appreciated.

Let T be any unbiased estimator of $\tau(\theta),$ and let $W$ be a sufficient statistic for theta. Define $\phi(W)=E[T|W]$. Show that $\phi(W)$ is an unbiased estimator of $\tau(\theta),$ and $\mathrm{Var}(T)=\mathrm{Var}\left(\phi(W)\right) + E\left[\mathrm{Var}(T|W)\right]$.

The only thing I know is that this may be a part of the Rao-Blackwell Thm.

share|improve this question

1 Answer 1

up vote 3 down vote accepted

We want to show that $E(\phi(W))=\tau(\theta)$.
Start with the definition:
$$ \begin{align*} E(\phi(W))&=E[E(T|W)]\\ &=E[T]\\ &=\tau(\theta) \end{align*} $$

where the last equality holds, because $T$ is an unbiased estimator for $\tau(\theta).$ Hence $\phi(W)$ is unbiased for $\tau(\theta).$

For the second part, use the fact that for any two random variables, $X$ and $Y$,
$$\mathrm{Var}(X)=\mathrm{Var}\left[E(X|Y)\right]+E\left[\mathrm{Var}(X|Y)\right].$$


Added:
As noted by @guy, for the first part, we also need to show that $\phi(W)$ is an estimator of $\theta$. But this is obvious. See comments below.

share|improve this answer
    
One thing to add: you have shown $\phi(W)$ is unbiased, but not that $\phi(W)$ is an estimator, i.e. we need $\phi(W)$ not to depend on $\theta$. It is trivial, of course, but this is where sufficiency comes in, and it is easy miss. –  guy Jul 9 '11 at 22:08
    
@guy: I thought it was obvious since $W$ is a sufficient statistic for $\theta$, $\phi(\theta)$ is a function only of the sample and does not depend on $\theta$. Thanks for pointing it out though. I'll add to my answer. –  Nana Jul 9 '11 at 22:18
    
Thanks to you both! –  Betty Jul 10 '11 at 3:48

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.