Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

In probability theory we often used the existence of a sequence $(X_n)_n$ of independent and identically distributed random variables. This was already discussed here. One of the answers says:

As Ahriman has pointed out, if you are given a random variable $X:\Omega\to E$ it may not be possible to construct the whole sequence on $\Omega$ as the latter may be quite a poor space, so you would have to go for a richer space.

My question is the following: How could I "enrich" my given probability space $\Omega$ such that I can ensure the existence of iid random variables on this probability space?

My idea was the following: Assume that I have a given probability space $(\Omega_1,\mathcal{A}_1,\mathbb{P}_1)$ and a random variable $X:\Omega_1 \to E$. Now I can construct a probability space $(\Omega_2,\mathcal{A}_2,\mathbb{P}_2)$ such that there exists a sequence of iid random variables $X_n: \Omega_2 \to E$. Let $(\Omega,\mathcal{A},\mathbb{P}) := (\Omega_1,\mathcal{A}_1,\mathbb{P}_1) \otimes (\Omega_2,\mathcal{A}_2,\mathbb{P}_2)$ the product space, then

$$X_n'(w_1,w_2) := X_n(w_2) \qquad \qquad X'(w_1,w_2) := X(w_1)$$

would still fulfill $X' \sim X$, $X_n' \sim X_n$ and the random variables $X_n'$ would be independent. Is this correct...?

share|cite|improve this question
I have used this approach without trouble for simple cases, where $X$ and $E$ would be something easy, e.g. $\mathbb{R}^d$ or Markov chains on finite graphs etc. However, I cannot attest that it is correct if $\Omega_1$ or $\Omega_2$ are some weird constructs, my skills in measure theory are not good enough ;-) (if I remember correctly, even the existence of product space is not trivial). – dtldarek Dec 3 '12 at 19:05
See e.g. the construction of the product of two $\sigma$-finite measure spaces in Rudin, "Real and Complex Analysis", chapter 7. – Robert Israel Dec 3 '12 at 19:29
@dtldarek FYI, a sufficient condition (which is certainly satisfied here by our probability measures) to construct a product space out of two measure spaces is that the measures be sigma finite. This is the one I operate under, and I believe that it is what most working analysts use. You can always construct the product space of arbitrary cardinality index set if you ignore the 3rd coordinate of data: the measure. But if you want the measure too, then you need some regularity conditions and for the measures to be probability measures if the index set of the product is infinite. – Jeff Dec 25 '14 at 1:55
up vote 2 down vote accepted

To give this a simple answer:

Yes, the approach described in the question works fine.

share|cite|improve this answer

I cannot comment yet, so I'm posting this as an answer.$\def\ci{\perp\!\!\!\perp}$

This is probably not what you were asking, but I think it's interesting and relevant enough to post.

It's known possible to construct arbitrary distributions from uniform variables. Furthermore, given a $\mathcal U[0,1]$ variable, it's possible to produce from it an i.i.d sequence of such variables, which can then be used to obtain more general distributions. We can always extend a space to obtain such variables by$$\hat{\Omega}=\Omega\times[0,1]\text{, }\hat{\mathscr{A}}=\mathscr{A}\otimes\mathscr{B}\text{, }\hat{P}=P\otimes\lambda $$ in which case $\vartheta(\omega,t):= t$ is $\mathcal{U}[0,1]$ and $\vartheta\ci \mathscr{A}$.

For more details see Kallenberg - Foundations of Modern Probability (2002), in particular the discussion before Theorem 6.10 (transfer).

share|cite|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.