Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

The forumlae for standard deviation seems to be the square root of the sum of the squared deviation from mean divided by $N-1$.

Why isn't it simply the square root of the mean of the squared deviation from mean? i.e, divided by $N$.

Why is it divided by $N-1$ rather than $N$?

share|improve this question
3  
To prevent bias, as explained here and here. –  William DeMeo Mar 14 '12 at 11:43
    
This might help: stats.stackexchange.com/questions/3931/… –  Byron Schmuland Mar 14 '12 at 12:26
    
The reason is because it gives you an unbiased estimator. But, do not confuse this with giving the best estimator. In my time series class, my professor tells me that in time series you usually divide by n instead, because it's actually a better approximation. I couldn't explain to you why or anything. –  Graphth Mar 14 '12 at 12:42
    
Well, one thing is that the samples are not independent in time series... I'm sure that has something to do with it. –  Graphth Mar 14 '12 at 12:51
add comment

1 Answer

up vote 0 down vote accepted

If you have n samples, the variance is defined as: $$s^2=\frac{\sum_{i=1}^n (X_i-m)^2}{n}$$ where $m$ is the average of the distribution. In order to have an estimator non $biased$ you have to have: $$E(s^2)=\sigma^2$$ where $\sigma$ is the real unknown value of the variance. It's possible to show that $$E(s^2)=E\left(\frac{\sum_{i=1}^n (X_i-m)^2}{n} \right)=\frac{n}{n-1}\sigma^2$$ So if you want to estimate the 'real' value of $\sigma^2$ you must divide by $n-1$

share|improve this answer
    
The sample variance uses the sample average, not $m$. –  Byron Schmuland Mar 14 '12 at 12:34
    
If m is the mean of the X's (cosidered iid) the estimator you wrote is unbiased. The fact of dividing by n-1 comes up when you dont know the mean and you need to estimate it (with sample average) in order to define the estimator of the variance. This requires you to pull down the numbers of degree of freedom. –  Kolmo Mar 14 '12 at 14:08
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.