# Distribution of sample variance of Cauchy distributed variables

Assume $$X_i,i\in\left\{1,...,n\right\}$$ are i.i.d. standard Cauchy distributed random variables.

I know that $$\bar{X}_n:=\frac{1}{n}\sum_{i=1}^n X_i$$ is standard Cauchy distributed.

I would like to know the distribution of the sample variance $$\frac{1}{n}\sum_{i=1}^n \left(X_i-\bar{X}_n\right)^2 .$$

My foreknowledge:

I know that moments like $$\mathbb{E}(X),\mathbb{V}(X)$$ do not exist for Cauchy distributed $$X$$. I know that linear combinations of independent Cauchy random variables is Cauchy distributed as well.

Weaker question:

If nobody knows the exact distribution of the sample variance, it would be interesting if the distribution is independent of number of samples $$n$$? Like the distribution of the sample mean $$\bar{X}_n$$ does not depend on $$n$$ as it is always standard Cauchy for all $$n$$. In the Cauchy distribution Wikipedia article it says:

Similarly, calculating the sample variance will result in values that grow larger as more observations are taken.

but I think this statement is not correct, because they use a similar (in my opinion very bad) formulation for the sample mean:

the sample mean will become increasingly variable as more observations are taken

which is not a correct statement, as the distribution of the sample mean $$\bar{X}_n$$ does not depend on $$n$$.

Although the sample values $$x_{i}$$ will be concentrated about the central value $$x_{0}$$, the sample mean will become increasingly variable as more observations are taken, because of the increased probability of encountering sample points with a large absolute value. In fact, the distribution of the sample mean will be equal to the distribution of the observations themselves; i.e., the sample mean of a large sample is no better (or worse) an estimator of $$x_{0}$$ than any single observation from the sample. Similarly, calculating the sample variance will result in values that grow larger as more observations are taken.

I am really not sure what the author of this article wanted to express how the distribution of the sample variance depends on the number of samples $$n$$.

Do you know more about the distribution of the sample variance of $$n$$ i.i.d Cauchy distributed random variables?

• If $X_1,\ldots,X_n$ are i.i.d. with a standard Cauchy distribution (standard = median $0$ and IQR $2$) then $\overline X_n = (X_1+\cdots+X_n)/n$ also has the same Cauchy distribution, i.e. median $0$ and IQR $2.$ That can be readily shown by using characteristic functions. Jan 2, 2020 at 18:55

You are asking (among other things) how it can be that the sequence of means $$(\overline{X}_n)_{n\geq 1}$$ can become "increasingly variable" given that each element has the same distribution.
In fact, this statement is not a contradiction - it depends on what is precisely meant by the phrase "increasingly variable". The intuition is that a Cauchy random variable $$X$$ can take very huge values with a probability that decays slowly to zero. This is because $$\mathbb P(X>t)\approx (\pi t)^{-1}$$ as $$t\to\infty$$, so among $$X_1,\ldots,X_n$$ the probability that at least one is greater than some huge number $$N$$ grows like $$n/N$$. Say $$N$$ is a million for the sake of illustration. While you would be very surprised to see $$X_1$$ or $$X_2$$ be larger than $$N$$ (probabilities on the order of 1 in a million), you would expect to see values of size around a million among the outliers in $$X_1,\ldots,X_{N}$$. When we take the sample mean, it gets overly dominated by these outlier terms - the mean doesn't care if most of your numbers are tiny, just a few outliers taking values in the millions are enough to skew the entire sample mean.
Keep in mind what happened here: we started with a sequence of Cauchy random variables $$(X_n)_{n\geq 1}$$ and we obtained a new sequence $$(\overline{X}_n)_{n\geq 1}$$ of Cauchy random variables. But the two random sequences do not have the same distribution: the former has independent elements, the latter does not.
An interesting question if you want to explore this topic further is to consider the asymptotics of the distribution of the running maxima for the sequences $$M_n=\max_{1\leq k\leq n}|X_n|$$ and $$\overline{M}_n=\max_{1\leq k\leq n}|\overline{X}_n|$$.
Answering your weaker question, the sample variances do not have the same distribution. For example, when $$n=1$$ it is zero and for $$n=2$$ we have a quantity related to the difference of two iid Cauchy random variables. For larger $$n$$ we need to do more work to show that the distributions change, one way is to compute sufficiently detailed asymptotics for the characteristic functions.