I just watched Jeremy explain deep learning using an Excel spreadsheet. This is really worth a look. Along the way he explains and implements various learning strategies including AdaGrad and momentum. It looks so very simple when explained this way.