3
votes
4answers
56 views

A general definition of Entropy (i.e. may or may not be expectation of the Log of the probabilities) [closed]

Entropy may be defined as Entropy = Σ G(p(x)) Where 'G' is any function that goes asymptotically to plus infinity as it approaches zero from the positive side and is monotonic between 0 and 1 ...
2
votes
1answer
49 views

How to prove the function is logarithmic with coefficience

I am given a set of properties for an unknown function $f(x)$. In particular, not constantly zero, not negative, additive and continues for any $x$ between 0 and 1. I am asked to show equivalence ...
0
votes
1answer
173 views

Information theory entropy equation

I'm studying information theory, and working through this document. On page 17, it shows that, with the function that gets the entropy of a probability $I$ and a probability $p$, that $I(p^a) = a * ...