Olivier Bousquet's "Introduction to Learning Theory"
Watch this lecture, working through the provided on the right-hand side of the screen as you listen. After you watch, you should have a general understanding of "learning theory," be able to differentiate between deduction and induction, and describe, in general terms, the concept of probability and Bayes' rule.
Click http://videolectures.net/mlss06au_bousquet_ilt/ link to open resource.