What I know to begin with is that the sum will be 0 if there is a y-intercept b0 , why is that? my book doesnt say and can't figure it out. I also know that an importantant assumption for the OLS estimators to be BlUE is that x and the erros can't be corralated otherwise the estimators would be biased. This correlation assumption may entail problems so we take one step further and we assert that by combining E(u)=0 ( an assumption that the book doesnt explain where it comes from) + E(u|x) - the average value of u doesnt depend on the value of x) , we get E(u)=0=E(u|x). so this assumption is somehow related to that the sum of residuals should be 0. But how do I mathematically prove that?

Sorry if I have been a bit unclear but I am a quite confused, it seems all this topic quite redundant to me , like of the assumptions that jusify the method are infered from the method itself..

  • $\begingroup$ Can you edit your title to "Why does the expected value of the error equal 0 when an intercept is included in OLS estimation"? Note that this question and answer does not have to do with residuals (estimators), but rather the regression error. $\endgroup$ – Mathemanic Sep 26 '14 at 20:37

I have answered the other question of yours about why the OLS residuals are zero, when an intercept is included in the regression.

The stochastic assumptions on the error term, (not on the residuals) $E(u) = 0$ or $E(u\mid X) = 0$ assumption (depending on whether you treat the regressors as deterministic or stochastic) are in fact justified by the same action that guarantees that the OLS residuals will be zero: by including in the regression a constant term ("intercept").

Consider the specification

$$y_i = b_0 + b_1x_i + u_i\,,\; E(u) = 0$$

Consider the alternative specification

$$y_i = b_1x_i + \varepsilon_i\,,\; E(\varepsilon_i) = b_0 $$

The expected value of $y$ in these two different specifications is the same -and it is the expected value of $y$ that we are essentially estimating in an OLS regression(see this post).

In other words, the constant term plays the role of, (or absorbs together with other constants coming from the theory behind the model) the non-zero mean of the error term, and permits us to assume safely that the "remaining" error-term has a zero mean (and this is why it is strongly advised from every corner to always run a regression including a constant term).

And then, it also gives us that the sum of OLS residuals will be zero. What more to ask from a constant?

  • $\begingroup$ Thank you for your answer! You say the intercept essentially "absorbs" $E(u)$, however I don't understand how this happens. Doesn't this depend on our choice of intercept? So if $x_0=1$ (a constant), how does it "absorb" $E(u)$? I posted a similar question: math.stackexchange.com/questions/951498/… $\endgroup$ – Mathemanic Sep 29 '14 at 19:18
  • $\begingroup$ @Mathemanic I posted an answer to your question. $\endgroup$ – Alecos Papadopoulos Sep 29 '14 at 20:00

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.