4
$\begingroup$

What I know to begin with is that the sum will be 0 if there is a y-intercept b0 , why is that? my book doesnt say and can't figure it out. I also know that an importantant assumption for the OLS estimators to be BlUE is that x and the erros can't be corralated otherwise the estimators would be biased. This correlation assumption may entail problems so we take one step further and we assert that by combining E(u)=0 ( an assumption that the book doesnt explain where it comes from) + E(u|x) - the average value of u doesnt depend on the value of x) , we get E(u)=0=E(u|x). so this assumption is somehow related to that the sum of residuals should be 0. But how do I mathematically prove that?

Sorry if I have been a bit unclear but I am a quite confused, it seems all this topic quite redundant to me , like of the assumptions that jusify the method are infered from the method itself..

$\endgroup$
1
  • $\begingroup$ Can you edit your title to "Why does the expected value of the error equal 0 when an intercept is included in OLS estimation"? Note that this question and answer does not have to do with residuals (estimators), but rather the regression error. $\endgroup$ Sep 26, 2014 at 20:37

1 Answer 1

11
$\begingroup$

I have answered the other question of yours about why the OLS residuals are zero, when an intercept is included in the regression.

The stochastic assumptions on the error term, (not on the residuals) $E(u) = 0$ or $E(u\mid X) = 0$ assumption (depending on whether you treat the regressors as deterministic or stochastic) are in fact justified by the same action that guarantees that the OLS residuals will be zero: by including in the regression a constant term ("intercept").

Consider the specification

$$y_i = b_0 + b_1x_i + u_i\,,\; E(u) = 0$$

Consider the alternative specification

$$y_i = b_1x_i + \varepsilon_i\,,\; E(\varepsilon_i) = b_0 $$

The expected value of $y$ in these two different specifications is the same -and it is the expected value of $y$ that we are essentially estimating in an OLS regression(see this post).

In other words, the constant term plays the role of, (or absorbs together with other constants coming from the theory behind the model) the non-zero mean of the error term, and permits us to assume safely that the "remaining" error-term has a zero mean (and this is why it is strongly advised from every corner to always run a regression including a constant term).

And then, it also gives us that the sum of OLS residuals will be zero. What more to ask from a constant?

$\endgroup$
2
  • $\begingroup$ Thank you for your answer! You say the intercept essentially "absorbs" $E(u)$, however I don't understand how this happens. Doesn't this depend on our choice of intercept? So if $x_0=1$ (a constant), how does it "absorb" $E(u)$? I posted a similar question: math.stackexchange.com/questions/951498/… $\endgroup$ Sep 29, 2014 at 19:18
  • $\begingroup$ @Mathemanic I posted an answer to your question. $\endgroup$ Sep 29, 2014 at 20:00

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .