Sparse Learning and Boosting

Winnow

https://en.wikipedia.org/wiki/Winnow_(algorithm)

Strong Learnability

Probably Approximately Correct (PAC)

https://en.wikipedia.org/wiki/Probably_approximately_correct_learning

Almost certainly generalizes really well

Weak Learning

Has a slight chance of generalizing slighly better than chance.

Boosting

https://en.wikipedia.org/wiki/Boosting_(machine_learning)

ADAboost

https://en.wikipedia.org/wiki/AdaBoost