Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

What is the information content of a sentence S like 'one has a successor'. To me, it looks like if we assume no a priori knowledge, both S and it's negation will have equal probablity 1/2. This is to say that one could work with S as an axiom or equally with its negation as an axiom. In a real world parallel, the situation could be of a calculator that overflows at 1+1 and another which does not.So the information content of S would appear to be just One unit. With that reasoning ,the information content of sentence U 'Every number has a successor' would be infinite,or an associated probability of 0. Is it that it would be inappropriate to speak of information content of a mathematical axiom like S or U above?

share|cite|improve this question
Have a look at algorithmic information theory. One could also try figuring out the information needed to specify that set of models out of all models, but I don't think that idea has gotten much traction. – ShyPerson Nov 1 '13 at 21:34
AIT appears to me about information more in a syntactic context. My question is about information in a semantic context. With no a priori information, ' John is intelligent', conveys a bit of information, if John being intelligent and not intelligent are equally probable. In that sense, can we speak of the information content of any particular axiom of a mathematical theory? – Sudhir Nov 2 '13 at 6:25

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.