# Tagged Questions

The science of compressing and communicating information. It is a branch of applied mathematics and electrical engineering. Though originally the focus was on digital communications and computing, it now finds wide use in biology, physics and other sciences.

23 views

### Compressing bitchains

Let there be a bit-chain consisting of $n$ characters with the following rules: The probabilities of the first character being $0$ and $1$ are $1/2$. From then on the probabilities are $p$ when the ...
22 views

### Lower bound on conditional entropy over multiple random variables

I am trying to compute the best subset of features for a given random variable $X_i$ from the set of given $n$ random variables. For that I am using conditional entropy to determine the best subset, ...
23 views

### Data processing inequality for four variable markov chain

I came across this result in one of my lectures and I've been trying to prove it: If $U \rightarrow X \rightarrow Y \rightarrow Z$, then $$I \left( U; Z\right) \leq I \left(X;Y\right).$$ Can ...