I am struggling to understand the following. Let $X_1$, $W_1$, and $Z_1$ be mutually independent discrete random variables with finite alphabets, $S_1 := X_1 + W_1$, and $f(\cdot)$ be some deterministic scalar function.

Is it true that $I[f(S_1)+Z_1;X_1] \leq I[S_1+Z_1;X_1]$, where $I[\cdot]$ denotes mutual information?

I have tried a number of things but I have not been able to show it. The function $f(S_1)$ is a clustering-type of function, i.e., it groups elements of the alphabet of $S_1$ and assigns the average of them as an element of the alphabet of $f(S_1)$.

Any hint would be very appreciated it. Cheers, Carlos.

migrated from meta.mathoverflow.net Oct 31 at 10:42

This question came from our discussion, support, and feature requests site for professional mathematicians.

Your Answer


By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Browse other questions tagged or ask your own question.