Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Let $x=(x_i)$ be a probability measure on $\{1,\ldots,n\}$. Suppose $1<p<\infty$. The Rényi entropy of $x$ is $$ H^p(x)=\frac{1}{1-p}\log \sum_{i} x_i^p. $$

Does there exist a formula for $H^p(x)$ using a derivative and a norm ($\ell_{p,q}$, Orlicz,...) of $x$?

Remark: I know that for the classical entropy $H(x)=-\sum_{i}\log(x_i) x_i$, we have $$ H(x)=\left. \frac{d}{dp}\right|_{p=1}\vert\vert x \vert\vert^p_{\ell_p} $$

share|improve this question
    
Zouba, could you provide a pointer for your remark? –  Euclean Jul 3 '12 at 13:22
1  
@Zouba: I don't think $H(x)=\left. \frac{d}{dp}\right|_{p=1}\vert\vert x \vert\vert^p_{\ell_p}$ is true. All we have $\lim_{p\to 1}H^p(x)=H(x)$. Your question is also not clear to me. Can you elaborate on what your question exactly is? –  Ashok Jul 6 '12 at 9:23
add comment

Know someone who can answer? Share a link to this question via email, Google+, Twitter, or Facebook.

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.