Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

A conditional entropy can be expressed in the following way, $H_{V_t}(V_s) = -\sum_{s,t}p(s,t)\log{p_t(s)} = -\sum_{s,t}p(s,t)\log{\frac{p(s,t)}{\sum_{s'}{p(s',t)}}}$

$s$ and $t$ are defined on finite domain, say $s,t\in{\{00,01,11,10\}}$. Each value of $p(s,t)$ is an independent variable. Is conditional entropy a convex function under this circumstances?

share|cite|improve this question
As it stands, I can see three disconcerting things: 1) I think there is a minus missing in the formula of conditional entropy. 2) If $p_s(t)$ stands for the conditional probability, then the denominator in the last expression should be summed over the other variable (here $t$) 3) A function is convex in some variable. The variable is not clear here. – Ashok Feb 9 '12 at 6:36
variable is $p(s,t)$, not $s$ and $t$. The question is also improved accordingly. – Richard Feb 13 '12 at 21:37

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.