# Sum of variances of experiments does not equal variance of joint experiment

Say I make 3 independent experiments and these are the outputs:

O/P of $1$st exp : $1,2,3$
O/P of $2$nd exp : $4,5,6$
O/P of $3$rd exp : $7,8,9$

In general ${\rm Var}(A+B+C) = {\rm Var}( A ) + {\rm Var}( B ) + {\rm Var}( C )$

In this case ${\rm Var}(\text{1st}) + {\rm Var}(\text{2nd}) + {\rm Var}(\text{3rd}) \ne {\rm Var}(1,2,3,4,5,6,7,8,9)$

Why ?

-
Informally, the set $\{1,2,\dots,9\}$ has more "wiggle" about its mean. The sum of the means of $A$, $B$, $C$ is $15$, maximum value is $18$, for a maximum wiggle of $3$ about the mean. For the numbers $1$ to $9$, the mean is $5$, maximum wiggle is $4$. Of course maximum wiggle doesn't tell us variance, but it gives some indication as to why the second variance might be larger. This is particularly the case because we are squaring the deviations from the mean, and $4^2$ is a lot bigger than $3^2$. –  André Nicolas Oct 8 '12 at 22:04

The independence is in the "population" of all possible outcomes of the experiments, but only one outcome---not all possible outcomes---eventuated for each experiment.

Say we do two independent experiments. Each time, the possible outcome is $1$, $2$, or $3$. Let's say the "population" or possible outcomes is distributed as follows: $$\begin{array}{|c|c|c|c|c|c|} \hline & 1 & 2 & 3 \\ \hline 1 & 1/12 & 2/12 & 1/12 & & 4/12=1/3 \\ \hline 2 & 1/12 & 2/12 & 1/12 & & 4/12 = 1/3 \\ \hline 3 & 1/12 & 2/12 & 1/12 & & 4/12=1/3 \\ \hline \\ \hline \\ & 3/12 = 1/4 & 6/12 = 1/2 & 3/12 = 1/4 \\ \hline \end{array}$$ (For example, $1/12$ of the time, both experiments yield a $1$.)

The sum of the two random numbers is $$\begin{cases} 2 & \text{with probability }1/12 \\ 3 & \text{with probability }3/12 \\ 4 & \text{with probability }4/12 \\ 5 & \text{with probability }3/12 \\ 6 & \text{with probability }1/12 \end{cases}$$

So compute a variance based on $1/3,1/3,1/3$ as probabilities of $1,2,3$ respectively, and compute a variance based on $1/4,1/2,1/4$ as probabilities of $1,2,3$ respectively, and add them together. Also compute a variance based on probabilities $1/12,3/12,4/12,3/12,1/12$ as probabilities of $2,3,4,5,6$ respectively. This last one should be the sum of the first two. That's what it means to say that the variance of the sum of two (or more) independent random variables is the sum of the variances. But if you do each of the experiments once and get, for example, $2$ the first time and $3$ the second time, what would it mean to say you have a variance for each one and you can add them together?

-

The definition of variance is

$$Var(X)=E(X^2)-E(X)^2$$

I assume the first experiment can have 3 equiprobable outcomes: 1, 2 and 3.

It's variance is

$$Var(A)=\frac{1^2+2^2+3^2}{3}-\left(\frac{1+2+3}{3}\right)^2=\frac{2}{3}$$

Make the same calculation for B and C.

The variance of the outcome of the sum of the 3 experiments (do the 3 experiments, add the 3 experiments and add the results) is equal to the sum of the variances.

$$Var( A+B+C) = Var( A ) + Var( B ) + Var ( C )$$

-