Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Lets pretend I have no experience with statistics...

what books, in what order, will get me to the point of being able to understand Bayesian probability fastest.

share|cite|improve this question
Do you have experience with probability? How much? What do you mean by Bayesian probability? Almost any probability text will mention some form of Bayes Rule. – deinst Apr 18 '12 at 1:12
Bayesian probability as in Bayes' rule is described in almost any probability textbook and is noncontroversial even among hard core frequentists (or so I believe). On the other hand, Bayesian statistics and Bayesian inference and the like are a different matter. – Dilip Sarwate Apr 18 '12 at 15:12
up vote 5 down vote accepted

The folks at LessWrong have put together a couple of resources that can be helpful for the complete beginner. They are also useful if you've only taken a single course in probability and basically just memorized formulas to get through it.

For two more advanced books that cover practical matters in great detail (and require a bit more mathematical maturity) see:

My own opinion is that learning the formula for Bayes' theorem is elementary; it's something that almost always precedes even a first introduction to common discrete random variables. The real "starting point" for seeing the difference in Bayesian methods is when you start needing to compute Maximum Likelihood Estimators (MLE). Then you can directly compare the output of an MLE with the alternative output if you had set up a prior and chased the computation out all the way to a posterior distribution.

There's nothing special about MLEs, of course, but that just happens to be one of the first places where a student is really forced to say, "Gee, I'd really like to have the whole posterior distribution, but it's really hard to compute." Once a student sees the value in that, they are usually ready to start learning about acceptance/rejection, Metropolis-Hastings, and Gibbs sampling, which are the gateway drugs of Bayesian analysis.

share|cite|improve this answer

EE, Peter M., 2004. Bayesian Statistics: An Introduction, Hodder Arnold.

share|cite|improve this answer
LEE rather then EE – Henry Apr 18 '12 at 1:33

Reference Book: Bayesian Theory by José M. Bernardo and Adrian F. M. Smith

Read: Notes from MIT OCW

Presentation: Tutorial from Stanford

Watch videos on Youtube (about Bayesian Probability)

share|cite|improve this answer

Here is a good list. There are lots of material online too, and some excellent q&a right here on stackexchange.

share|cite|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.