Browsed by
Category: Free Energy

Good Read on Modeling Social Emergent Phenomena – But Still Not There Yet!

Good Read on Modeling Social Emergent Phenomena – But Still Not There Yet!

Philip Ball – Critical Mass The most important thing we can do right now – given the huge changes ahead of us – both in society, the world, and technology – is to get some sort of “handle” on what’s coming up. By that, I mean a good set of models. And as a result, I’m on a search for good models. Those that I know, those that are new. Those that make sense, and those that don’t. (We need…

Read More Read More

Analytic Single-Point Solution for Cluster Variation Method Variables (at x1=x2=0.5)

Analytic Single-Point Solution for Cluster Variation Method Variables (at x1=x2=0.5)

Single-Point Analytic Cluster Variation Method Solution: Solving Set of Three Nonlinear, Coupled Equations The Cluster Variation Method, first introduced by Kikuchi in 1951 (“A theory of cooperative phenomena,” Phys. Rev. 81 (6), 988-1003), provides a means for computing the free energy of a system where the entropy term takes into account distributions of particles into local configurations as well as the distribution into “on/off” binary states. As the equations are more complex, numerical solutions for the cluster variation variables are…

Read More Read More

Gibbs Free Energy, Belief Propagation, and Markov Random Fields

Gibbs Free Energy, Belief Propagation, and Markov Random Fields

Correspondence Between Free Energy, Belief Propagation, and Markov Random Field Models As a slight digression from previous posts – re-reading the paper by Yedidia et al. on this morning on Understanding Belief Propagation and its Generalizations – which explains the close connection between Belief Propagation (BP) methods and the Bethe approximation (a more generalized version of the simple bistate Ising model that I’ve been using) in statistical thermodynamics. The important point that Yedidia et al. make is that their work…

Read More Read More

What Makes a Metastable State Happen?

What Makes a Metastable State Happen?

Metastable States – the Meltdown Precursors I’ve just read a recent column by JL, one of the editors from Taipan Daily. He states, in his column “There Will Be Blood in Europe”: Stepping back a bit: What is so frightening right now, not just in Europe but China and America and Japan too, is the presence of fraud-fueled “Lehman 2.0” catalysts threatening to explode. One could say that the 2008 financial crisis was the mother of all wake-up calls. But…

Read More Read More

"What is X?" – Modeling the Meltdown

"What is X?" – Modeling the Meltdown

“What is X?” – Modeling the 2008-2009 Financial Systems Meltdown We’re about to start a detailed walkthrough of applying a “simple” statistical thermodynamic model to the Wall Street players in the 2007-2009 timeframe. The two kinds of information that I’ll be joining together for this will be a description of Wall Street dynamics, based largely on Chasing Goldman Sachs (see previous blogposts for link), and the two-state Ising thermodynamic model that I’ve been presenting over the past several posts. The…

Read More Read More

Modeling Nonlinear Phenomena

Modeling Nonlinear Phenomena

Modeling Nonlinear Phenomena – What is “X”? Many of us grew up hating word problems in algebra. (Some of us found them interesting, sometimes easy, and sometimes fun. We were the minority.) For most of us, even if we understood the mathematical formulas, there was a big “gap” in our understanding and intuition when it came to applying the formulas to some real-world situation. In the problem, we’d be given a set of statements, and then told to find “something.”…

Read More Read More

"The Origin of Wealth" – Revisited

"The Origin of Wealth" – Revisited

The Origin of Wealth – and Phase Transitions in Complex, Nonlinear Systems Once again, after a nearly two-year hiatus (off by only a week from my first posting on this in May of 2010), I’m getting back to one of my great passions in life – emergent behavior in complex, adaptive systems. And I’m once again starting a discussion/blog-theme referencing Eric Beinhocker’s work, The Origin of Wealth. Since this book was originally published (in 2006), we’ve seen an ongoing series…

Read More Read More

The Beauty of Phase Spaces

The Beauty of Phase Spaces

Phase Spaces: Mapping Complex Systems I’ve spent the day on cloud computing. Yes, there will be a course on it at GMU this Fall of 2010. And cloud computing is simply a technology; a means of getting stuff done. In and of itself, I think there are more exciting things in the world — such as phase spaces. One of the classic nonlinear systems is the Ising spin glass model. This system is composed of only two kind of particles;…

Read More Read More

Graph Theory — Becoming "Organizing Framework"

Graph Theory — Becoming "Organizing Framework"

Something I’ve been noting — both on my own, and in conversations with Jenn Sleeman , who’s in touch with the academic world at UMBC — Graph theory is growing in centrality as a fundamental organizing framework for many current and emerging computational processes. Specifically, anything more complex than a simple “tuple” (RDF or OWL, etc.), needs to be matched against a graph or partial graph. One good “integrative” paper is Understanding Belief Propagation and its Generalizations by J.S. Yedidia,…

Read More Read More

Non-Equilibrium Information Theory (DARPA group)

Non-Equilibrium Information Theory (DARPA group)

Of possible interest — DARPA group attempting to use non-equilibrium information theory to study mobile ad hoc wireless networks (MANETs). Lots of information theory pubs, not too sure yet they’re really on to what constitutes “non-equilibrium,” worth investigating.