4
$\begingroup$

In a statistics book i'm reading, it is postulated that asymptotic normality of an estimator implies consistency. That is $$ \hat{\theta}_n \stackrel{as}{\sim} \mathcal{N}(\theta_0, \frac{1}{n}\sigma(\theta_0)) \Rightarrow P_{\theta_0}(|\hat{\theta}_n - \theta_0|>\epsilon ) \to 0 $$ when $n\to\infty$, for all $\theta_0 \in \Theta$ and $\epsilon>0$.

I am trying to prove this, but i can't seem to get a breakthrough.

If anyone could shed some light on how this is proven, i would be very grateful.

|cite|improve this question
$\endgroup$
4
$\begingroup$

If the distribution of $X_n$ is $\mathcal N(x,\sigma_n^2)$ and $\sigma_n^2\to0$, then $X_n\to x$ in probability, that is, $P[|X_n-x|\geqslant\epsilon]\to0$ for every positive $\epsilon$.

To prove this, an easy route is to use Bienaymé-Chebyhev inequality, to the effect that $E[X_n]=x$ and $\mathrm{var}(X_n)=\sigma_n^2$ hence $$ P[|X_n-x|\geqslant\epsilon]=P[|X_n-E[X_n]|\geqslant\epsilon]\leqslant\frac{\mathrm{var}(X_n)}{\epsilon^2}=\frac{\sigma_n^2}{\epsilon^2}. $$

|cite|improve this answer
$\endgroup$
  • 1
    $\begingroup$ Thanks for the quick response. The only thing that i cant comprehend is that in order to use Chebyshev's inequality i need to know that the variance of $X_n$ is in fact $\sigma^2_n$, and i'm not really sure what argument i need to make in order to use it on something that has an asymptotic variance. $\endgroup$ – Martin Jun 2 '13 at 17:09
  • 1
    $\begingroup$ Isn't this an assumption in your question? $\endgroup$ – Did Jun 2 '13 at 17:27
  • 1
    $\begingroup$ Correct me if i am wrong, but as i have understood it when $$ X_n \stackrel{as}{\sim} N (x , \sigma^2_n) $$ Then $Var(X_n)\neq \sigma^2_n$ (equality only holds in the limit.) And as i see it i need to use Chebyshev's inequality before taking the limit in n. Correct me if im wrong, but really sure about this. $\endgroup$ – Martin Jun 2 '13 at 17:43
  • $\begingroup$ not really sure about this* $\endgroup$ – Martin Jun 2 '13 at 17:49
  • $\begingroup$ Which limit? Since $\sigma_n^2\to0$, in the limit $n\to\infty$, $X_n\sim$... what exactly? It seems you need to seriously explain what you mean by this hypothesis if not what I considered in my post. $\endgroup$ – Did Jun 2 '13 at 19:04
2
$\begingroup$

A more concise answer follows using the $O_p$ and $o_p$ notation for stochastic orders. Your premise is that

$$\sqrt{n}(\theta_n-\theta_0)\overset{d}{\rightarrow}Z$$

where $Z$ is normally distributed with mean $0$ and variance $\sigma(\theta_0)$. Therefore

$$\theta_n-\theta_0=O_p\left(\frac{1}{\sqrt{n}}\right)\Rightarrow \theta_n-\theta_0= o_p(1)$$

hence $\theta_n-\theta_0\overset{p}{\rightarrow}0$, which finishes the proof.

|cite|improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.