At least in physicist's thinking, information, vaguely, is something that allows one to select a subset from a set.

Say, a system can be in states A and B, we have done a measurement on it (extracted information), then it is in either A or B. Now we are able to say, in which state among all the possible states is the system in.

Now, consider numbers, say number e. One can write many digits to specify the boundaries of an interval to which e belongs. In fact, arbitrarily good precision can take arbitrarily large amount of information to specify the decimal representation of the number.

Now, however, one can also write an expression for e, say $e = \sum_{n}\dfrac{1}{n!}$, and it seems like e is defined to an arbitrary precision straight away. That is to say, here we have something, for which we would have needed infinite amount of information.

The question then: does this expression contain infinity of information/any information at all? Or, can information be defined at all for expressions?

One might surely argue that given an expression, one still has to perform infinite number of evaluations to obtation a decimal expression of the number. But then a number of other questions would arrive: "Is it evaluations of faculties and additions then that produce information?", "Is the information only about decimal representations of numbers, but not the numbers themselves?", and perhaps many more.

  • 2
    $\begingroup$ Perhaps you want this? en.wikipedia.org/wiki/Kolmogorov_complexity $\endgroup$ – Potato Oct 11 '13 at 13:52
  • $\begingroup$ @Potato: Indeed looks very relevent. Thank you (10^10 times)! $\endgroup$ – Alexey Bobrick Oct 11 '13 at 13:57
  • 1
    $\begingroup$ Dear @AbdulhKhazzakGustavElFakiri, your link is really interesting and somewhat relevant to my question. However, it is far from obvious to me, how exactly does it provide the answer. Can you please kindly state it more explicitly? $\endgroup$ – Alexey Bobrick Oct 20 '13 at 21:46
  • 1
    $\begingroup$ @AbdulhKhazzakGustavElFakiri: So, is it meaningful to assign the concept of information to an expression? And why does the informational content of an expression (seemingly compact) seem to differ so much from that of an irrational number (seemingly infinite)? $\endgroup$ – Alexey Bobrick Oct 21 '13 at 23:06
  • 1
    $\begingroup$ @AbdulhKhazzakGustavElFakiri: Nevertheless, the concept of encoding seems so much more obvious, when applied to strings, rather than exressions. Latter tend to have a complex underlying structure. Saying 1.0000.. is not the same as writing all the zeros, for example. Here you use a convention, that zeros continue. $\endgroup$ – Alexey Bobrick Oct 22 '13 at 21:00

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.