I am learning Stanford CS224N: natural language processing with Deep Learning.

the professor said something and claim that what he said was about 200 bits of information.

how to compute how many bits of information about a given sentense ?

  • $\begingroup$ If you google "entropy of English language" you might find some relevant information. $\endgroup$ – awkward Apr 14 '19 at 13:52

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.