In lots of Bayesian papers, people use variational approximation. In lots of them they call it "mean-field variational approximation". Does anyone know what is the meaning of mean-field in this context?
- Anybody can ask a question
- Anybody can answer
- The best answers are voted up and rise to the top
I found some intuitions that might answer this; based on the definition of "mean-field" at Wikipedia, mean field theory (MFT also known as self-consistent field theory) studies the behaviour of large and complex stochastic models by studying a simpler model. Such models consider a large large number of small interacting individuals who interact with each other. The effect of all the other individuals on any given individual is approximated by a single averaged effect, thus reducing a many-body problem to a one-body problem.
So basically approximating the inference and learning problem, using independence assumptions and decomposition into several products, brings the notion of "mean-field" approximation.