Gibbs Free Energy, Belief Propagation, and Markov Random Fields
Correspondence Between Free Energy, Belief Propagation, and Markov Random Field Models As a slight digression from previous posts – re-reading the paper by Yedidia et al. on this morning on Understanding Belief Propagation and its Generalizations – which explains the close connection between Belief Propagation (BP) methods and the Bethe approximation (a more generalized version of the simple bistate Ising model that I’ve been using) in statistical thermodynamics. The important point that Yedidia et al. make is that their work…