1
$\begingroup$

Are there any good books on the mathematics of information, under whose umbrella would fall cryptography, information storing, data processing (i.e. data to information), mathematics of artificial intelligence. I understand that many of these topics have originated in computer science, but I want resources on the mathematical foundations of these topics.

Maybe even some mathematics of information as related to quantum computing.

I've also read a little bit of Marcus Hutter's paper 'AIXI' aka 'Universal Artificial Intelligence'.

$\endgroup$
2
  • $\begingroup$ This doesn't cover cryptography, but is relevant to AI and the other fields. Cover & Thomas, Elements of Information Theory. amazon.com/… $\endgroup$
    – johnnyb
    Oct 17, 2022 at 1:41
  • $\begingroup$ did you see my answer? any reactions/comments? $\endgroup$
    – kodlu
    Oct 20, 2022 at 14:02

1 Answer 1

Reset to default
1
$\begingroup$

I think the following make a good start:

  1. Cover and Thomas, Elements of Information Theory

This is at an intermediate mathematical level, but has quite a broad coverage, including more chapters on network information theory in later editions (e.g., ed. 3)

  1. R G Gallager, Information Theory and Reliable Communication

A classic, very mathematical, and still very enjoyable to read. Deeper than Cover and Thomas but narrower. However it does cover some algebraic coding theory which TCover and Thomas doesn't.

  1. D MacKay, Information Theory, Inference and Learning Algorithms

Quite different than the two above, this focuses more on implementations, and links to learning theory and inference. First to cover LDPC codes in detail [which were invented by Gallager in his PhD thesis in the early 60s]

  1. R E Blahut, Theory of Remote Image Formation
  2. R E Blahut, Algebraic Codes for Data Transmission
  3. R E Blahut, Cryptography and Secure Communication
  4. R E Blahut, Principles and Practice of Information Theory

Blahut's books form a nice ensemble, mathematically similar to Cover and Thomas.

  1. R Vershynin, High Dimensional Probability

Good for statistics/probability of large data sets.

  1. D G Luenberger, Information Science

Gentler level of mathematics, interesting broad coverage across different applications of information.

$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .