Tagged Questions
1
vote
1answer
45 views
What is the CONCEPT when we speak of maximum entropy?
What is an intuitive interpretation of the concept of maximum entropy? I want to understand this concept better but what I'm finding is too "advanced" right now. Can anyone simplify it ... imagine I'm ...
2
votes
1answer
81 views
Intuition about the relation of combinations and entropy
It is not difficult to show that
$${n \choose \lambda n} \leq 2^{H(\lambda)n}$$
where $H$ is the binary entropy function:
$$H(\alpha) = -\alpha \lg \alpha - (1-\alpha)\lg (1-\alpha)$$
I was ...
