Are you an AI expert, or are you planning to be? There are three fundamental challenges that will underlie the major AI evolutions over the next decade. These are the three areas where you NEED to understand the fundamentals – before AI moves so fast that you’ll never catch up. Let them guide your deep study for the year ahead. Check them out in this new YouTube post: Live free or die, my friend – AJ Maren Live free or…
Working Through Salakhutdinov and Hinton’s “An Efficient Learning Procedure for Deep Boltzmann Machines” We can accomplish a lot, using multiple layers trained with backpropagation. However (as we all know), there are limits to how many layers that we can train at once, if we’re relying strictly on backpropagation (or any other gradient-descent learning rule). This is what stalled out the neural networks community, from the mid-1990’s to the mid-2000’s. The breakthrough came from Hinton and his group, with a…
It’s been a lovely Christmas day. More social than any that I can remember, for a very long time. (Wonderful morning visit with my next-door neighbor. Great mid-day party. A sweet restorative nap afterwards.) And now, the thoughts that have been buzzing through and around my head for the past 48 hours — how to get started with deep learning. Of course there are all sorts of entry points. Historical, functional, mathematical… But what came to me, over these past…
Continuing with Beinhocker’s Origin of Wealth, it is important to distinguish carefully between some of the ideas that Beinhocker is expounding. While overall, he is doing a good job of bringing in many related thoughts and ideas, there is a slight tendency towards “mushing.” In that note, I’d like to suggest that we discern carefully between ideas involving utility (Origins, hardcover; pp. 34 & 37), and equilibrium. On pg. 34, Beinhocker begins a discussion of how utility is an underlying…