3
$\begingroup$

I have a bit of trouble proving a statement expressing the expectation of a function of random variables as the conditional expectation, namely:

$$\mathbb{E}g(X,Y) = \int_{\mathbb{R}^n} \int_{\mathbb{R}^m} g(x,y) f(y|x) \, dy \cdot f_X(x) \, dx = \mathbb{E}(\mathbb{E}[g(X,Y)|X])$$

with $X,Y$ appropriately dimensioned real-valued random variables, $f(y|x) := \frac{f_{X,Y}(x,y)}{f_X(x)}$ being the conditional density of $f_{X,Y}$ with respect to $(X,Y)$ and $f_{X}$ to $X$.

There is a statement leading up to this claim in my notes:

$$\forall A \in \mathcal{B}^n, B \in \mathcal{B}^m: \mathbb{P}(X \in A, Y \in B) = \int_{A}\int_{B} f(y|x) \, dy f_{X}(x) \, dx$$

I have already seen and proven a similar statement for a single random variable, but how does it work out in the multivariate case? Can it also be done using the fact that $\mathcal{B}^i$ is generated by half open box sets? I played around with the idea and using the integral representation of the densities cdf's, but the fact that there are multiple variables to be considered leaves me stumped.

As a bonus: How do any of the equalities in the first paragraph make any sense?? They are stated as is in my notes without any further exposition. I know all of the listed quantities and a couple of identities for the conditional expectation.

Thank you for reading!

$\endgroup$
2
  • $\begingroup$ $\mathbb{E}(g(X,Y))=\iint g(x,y) f(x,y) dx dy$ now use the fact that $f(x,y)=f(y|x) f_X(x)$ and change order of integration. This gives $\int \left( \int g(x,y) f(y|x)dy \right)f_X(x) dx=\mathbb{E}\mathbb{E}(g(X,Y)|X)$, no? $\endgroup$ Mar 6, 2022 at 16:16
  • $\begingroup$ Sorry for the late response. Yes, that was a bit blind-eyed on my part. My issue is/was more or less the second equality, because my conditional expectation knowledge is a bit rusty. But thank you for noting it anyway. $\endgroup$
    – TheOutZ
    Mar 7, 2022 at 11:42

1 Answer 1

3
$\begingroup$

The comment of @NapD.Lover provides a useful hint. Let $X:\Omega \to \mathbb{R}^n,Y:\Omega \to \mathbb{R}^m$ be measurable random variables. Let $A \in X^{-1}(\mathcal{B}(\mathbb{R}^n))=:\sigma(X)$. Then if $A \in \sigma(X),\,\exists B \in \mathcal{B}(\mathbb{R}^n):A=X^{-1}(B)$. Let $E[|g(X,Y)|]<\infty$. So, to prove that $h(X)=\int_{\mathbb{R}^m}g(X,y)f_{Y|X}(X,y)dy$ is s.t. $h(X)=E[g(X,Y)|X]$ a.e. we use: $$\begin{aligned} \int_Ag(X,Y)dP&=\int_{X^{-1}(B)}g(X,Y)dP=\\ &=\int_{\Omega}\mathbf{1}_{X^{-1}(B)}(\omega)g(X(\omega),Y(\omega))P(d\omega)\\ &=\int_{\mathbb{R}^n\times \mathbb{R}^m} \mathbf{1}_{B\times \mathbb{R}^m}(x,y)g(x,y)P_{X,Y}(dx,dy)=\\ &=\int_{\mathbb{R}^n}\int_{\mathbb{R}^m} \mathbf{1}_{B\times \mathbb{R}^m}(x,y)g(x,y)f_{X,Y}(x,y)dxdy=\\ &=\int_{\mathbb{R}^n}\int_{\mathbb{R}^m} \mathbf{1}_{B\times \mathbb{R}^m}(x,y)g(x,y)f_{Y|X}(x,y)f_X(x)dxdy=\\ &=\int_{B}\bigg(\int_{\mathbb{R}^m} g(x,y)f_{Y|X}(x,y)dy\bigg)f_X(x)dx=\\ &=\int_{X^{-1}(B)}h(X)dP=\\ &=\int_Ah(X)dP \end{aligned}$$ where we used Fubini-Tonelli for the measurability and integrability of $h(X)$ and for the double integral representation. The claim follows from $E[g(X,Y)]=E[E[g(X,Y)|X]]=E[h(X)]$. To prove the first equality, we use the tower property and the fact that $\sigma(X)\supseteq \{\emptyset,\Omega\}$ and $E[g(X,Y)|\{\emptyset,\Omega\}]=E[g(X,Y)]$.

$\endgroup$
4
  • $\begingroup$ Thank you! I think I understand it to a good degree, but since my notes leave so much stuff out, I think it is more reasonable to not go more in depth than you have done here and just use this as a future reference. Just a small potential improvement: Doesn't the claim already follow from noting that $\Omega = X^{-1}(\mathbb{R})$ and applying the above identity with $A = \Omega$? $\endgroup$
    – TheOutZ
    Mar 7, 2022 at 11:39
  • $\begingroup$ @TheOutZ To show that a function is a version of a conditional expectation we must in particular show the above for arbitrary sets in the conditional $\sigma$-algebra. In this case, for arbitrary $A \in \sigma(X)$. $\endgroup$
    – Snoop
    Mar 7, 2022 at 11:46
  • $\begingroup$ Yes, of course, I should have been more careful with my phrasing. That is indeed needed. I meant that after proving $h(X) = \mathbb{E}[g(X,Y)|X]$ that we can just go back and set $A = \Omega$, which should yield the first equality. $\endgroup$
    – TheOutZ
    Mar 7, 2022 at 12:03
  • $\begingroup$ @TheOutZ yes, it is correct $\endgroup$
    – Snoop
    Mar 7, 2022 at 12:19

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .