Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

On the Wikipedia law of large numbers site, they mention "Kolmogorov's strong law of large numbers", which works even if the random variables are not identically distributed.

Where can I find this theorem shown and proven? I know that a reference is provided on the Wikipedia site, but that book is out of availability. Are there any other references out there?

(Interestingly, Allan Gut's book "Probability: A Graduate Course", has a theorem by the name of "Kolmogorov's strong law", but in his book, the random variables have to be identically distributed. Any ideas why this is?)

share|cite|improve this question
up vote 7 down vote accepted

It does not work, in general, if the summands are not iid. Both "independent" and "identically distributed" can be weakened, but you can't dispense with either of them entirely and still get the result without giving up something else.

The result that they cite as "Kolmogorov's Strong Law" is not what I always refer to as Kolmogorov's Strong Law (I suspect that what I refer to as Kolmogorov's Strong Law is the same thing that Allan Gut does). The result given on Wikipedia requires a finite second moment and that $\sum \frac{\mbox{Var} X_k}{k^2} < \infty$, but in exchange you can drop the requirement of being identically distributed. The proof of this version I think is actually pretty easy, the sketch being: because the series converges we can apply the Khintchine-Kolmogorov convergence theorem so that $\sum \frac{(X_k - \mu_k)}{k}$ converges almost surely, and the result follows after an application of Kronecker's Lemma.

share|cite|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.