Tagged Questions
0
votes
1answer
34 views
Help deciphering Levenshtein formula
I am trying to completely understand the Levenschtein formula, and I have been reading the Wikipedia article on this. However, the description of the mathematical formula confuses me:
...
0
votes
1answer
57 views
Entropy Problem: mutual information
I have a problem about entropy and mutual information that I have attempted, but would like feedback on.
30% Boas
20% Anaconda
50% Cobra
Half of the Cobras were medium sized, and the other half were ...
1
vote
1answer
111 views
Simple trace distance problem
I am self studying a course on information theory and came with the following question:
$A$ and $B$ represent two possibly different probability distributions representing two different independent ...
0
votes
0answers
45 views
Mutual information, handling start and end
In my homework, I am supposed to use Brown algorithm to compute word classes. I need to compute mutual information for some data and looking in my results and official results, I am probably making ...
1
vote
1answer
138 views
Cover & Thomas textbook notation
Exercise 2.27 in Elements of Information Theory (2nd ed.) reads:
Let $\mathbf{p} = (p_{1}, p_{2}, \ldots, p_{m})$ be a probability
distribution on $m$ elements (i.e., $p_{i} \geq 0$ and
...
