What's the difference between Maximum a posteriori and Bayes' rule? They look similar, except that I do understand Bayes' rule and I don't understand MAP. The people I asked - who work in math and computer science - have never heard about Maximum a posteriori.
1 Answer
MAP estimator (or maximum a posteriori) is indeed Bayesian estimator. It minimizes Bayes risk for a "hit-or-miss" cost function. MAP is very close to MLE (indeed if the amount of samples goes to infinity then MAP and MLE equivalent). MAP is generally used because in some cases it allows to perform numerically efficient estimations, comparing to MLE or others. For more details you can turn to some textbooks (Kay S.M. "Fundamentals of statistical signal processing estimation theory", for example). It is said there (Ch. 11.3), that minimization of the Bayes risk with quadratic error/"hit-or-miss" error (cost function) turns to MMSE/MAP.
-
$\begingroup$ I just came across this question and I was surprised to see that the first sentence of the only answer is wrong. MAP estimator is NOT a Bayesian estimator. Instead, it is a rough approximation of a Bayesian procedure. For anyone interested, read more here. $\endgroup$– MakondoMay 20, 2018 at 14:26