Labor Day Reading and Academic Year Kick-Off

Labor Day Reading and Academic Year Kick-Off

Deep Learning / Machine Learning Reading and Study Guide:

 

Several of you have been asking for guided reading lists. This makes sense.

 

Your Starting Point for Neural Networks, Deep Learning, and Machine Learning

 

Your study program (reading and code) depends on where you are.

What you need to read and study in neural networks, deep learning, and machine learning depends on where you are.
What you need to read and study in deep learning and machine learning depends on where you are.
  1. Starting out (High-grass country; St. Louis to Alcove Springs): Basic neural networks and deep learning; architecture for common networks, such as CNNs (convolutional neural networks); learning rules and architecture design.
  2. Well on the way (Short-grass Great Plains; Alcove Springs to Fort Laramie): Deeper understanding of all the fundamental architectures and starting to understand the energy-based models.
  3. High-level topics (The Rocky Mountains; Fort Laramie to Fort Vancouver): The really tough mathematical / abstract materials.

 

The Biggest Challenge

 

There are challenges at every point of this journey.

Perils along the way caused many would-be emigrants to turn back … Nearly one in ten who set off on the Oregon Trail did not survive. Oregon-California Trails Association

See also: The Complete Guide to the Modern Oregon Trail

The biggest danger in the whole trek is getting caught in a Donner’s Pass. This means: getting lost in the high-altitude topics, not knowing which direction will get you out safely, and running out of resources – time, energy, money.

My focus is on getting you through the Rockies; through the most dangerous high-altitude topics. (That’s why we’ve got the Seven Essential Equations; that’s a guide through the mountains.) We’re going to know our route, and we’ll be expeditious; we’ll avoid getting trapped in the passes. This is why I’m working on my Cribsheet; it’s going to be a legend to go with the Seven Equations map.

 

Annotated Readings-and-Resources Lists

 

This weekend, though, I’m organizing some reading materials – Readings and Resources. They include YouTube vids and short courses. My lists will be annotated, so you’ll get a sense of what to do first, second, and third.

9 thoughts on “Labor Day Reading and Academic Year Kick-Off

  1. Thanks for posting! For anyone interested in a great ‘beginner through to intermediate’ course, the Coursera course by Andrew Ng has been fantastic. I’m only about 3/4 of the way through the first class (out of five in the cert program), but it’s a very good introduction that covers both the coding aspect (in python and tensor flow) as well as the calculus and matrix multiplication foundations, in a way that is accessible to someone with out a very math-intensive background.

    1. Hey, Matt – thanks for chiming in right away, and we’re on the same page here – I was putting in the link to Andy Ng’s video and looking for his Stanford materials, as well as a link to Yann LeCun’s full course materials as you were posting this – thank you!

      I’m going to find his basic introductory YouTube vid next; lots of people have been praising that one.

      Congrats on pushing through in your self-study!

  2. Dr. Maren – This is completely new to me. Yet I am intrigued with your overland journey metaphor and what to read first so as to not get snagged upstream. Looking forward to the “light” reading. Thanks. Kim M.

    1. You’re most welcome, Kim, and thank you!

      There’s a lot in that “light reading” section that is very readable, and the industry news reports (starting over a year ago) are why so many people are getting into data science & machine learning; it’s the new “gold rush.”

    1. Hey, Topher – good to hear from you, and … in your newly-incarnated life (since you didn’t quite make it to being a 49’er the last time) – are you going to be a Silicon Valley maven?
      Nothing like trying the second, and third, time around!

  3. Thanks Rahul, this is a great choice!

    Fabulous to get your hands on Python and deep learning methods at the same time. Starting — VERY SOON — you’ll have your hands on my code also; will greatly appreciate your feedback – and kudos to you for getting an early start with fast.ai!

Leave a Reply to AJMaren Cancel reply

Your email address will not be published. Required fields are marked *