I know that the Rao-Blackwell theorem states that an unbiased estimator given a sufficient statistic will yield the best unbiased estimator. Is the only difference between Lehmann-Scheffé and Rao-Blackwell that in Lehmann-Scheffé, you need an unbiased estimator that is based on a complete sufficient statistic? I am also having a hard time conceptually understanding the definition of a complete statistic.
- Anybody can ask a question
- Anybody can answer
- The best answers are voted up and rise to the top
Rao-Blackwell says the conditional expected value of an unbiased estimator given a sufficient statistic is another unbiased estimator that's at least as good. (I seem to recall that you can drop the assumption of unbiasedness and all you lose is the conclusion of unbiasedness; you still improve the estimator. So you can apply it to MLEs and other possibly biased estimators.) In examples that are commonly exhibited, the Rao-Blackwell estimator is immensely better than the estimator that you start with. That's because you usually start with something really crude, because it's easy to find, and you know that the Rao-Blackwell estimator will be pretty good no matter how crude the thing you start with is.
The Lehmann-Scheffe theorem has an additional hypothesis that the sufficient statistic is complete, i.e. it admits no unbiased estimators of zero. It also has an additional conclusion: the estimator you get is the unique best unbiased estimator.
So if an estimator is complete, unbiased, and sufficient, then it's the best possible unbiased estimator. Lehmann-Scheffe gives you that conclusion, but Rao-Blackwell does not. So the statement in the question about what Rao-Blackwell says is incorrect.
It should also be remembered that in some cases it's far better to use a biased estimator than an unbiased estimator.