Chapter 7: Energy-Based Neural Networks

This is the first time that I’m sharing an excerpt from the book-in-progress, Statistical Mechanics, Neural Networks, and Artificial Intelligence.

This excerpt covers the Hopfield neural network only; I’m still revising / editing / adding-to the remaining sections on the (general and restricted) Boltzmann machine.

Get the pdf using the pdf link in the citation below:

• Maren, A.J. (In progress). Chapter 7: Introduction to Energy-Based Neural Networks: The Hopfield Network and the (Restricted) Boltzmann Machine (DRAFT / EXCERPT), Statistical Mechanics, Neural Networks, and Artificial Intelligence. pdf

Your Inputs, Please and Thank You!

This particular subject, the Hopfield neural network, is the lead-in for the more interesting restricted Boltzmann machine (RBM), which is the foundation for deep learning.

Please give me your early feedback by commenting:

• Overall approach: Is this approach – starting with quick extracts from the original papers, and building the connection between equations and network structure, useful for you?
• Figures & diagrams: Are these working for you? Too much, too little? Want other types?
• Equations: How’s the explanation for the equations? Too much, too little, just right?

Anything else that you need to see?

Your help right now will be so helpful and very much appreciated!

Right now is the stage when I can most easily incorporate your early feedback, and make sure that this book is something that will be most useful to you. Thank you! – AJM

Live free or die, my friend –

AJ Maren

Live free or die: Death is not the worst of evils.
Attr. to Gen. John Stark, American Revolutionary War

Resources

Link to The Book Page

• Book: Statistical Mechanics, Neural Networks, and Artificial Intelligence