**CSE 427: Machine Learning**

This is a foundational course on Machine Learning. The first part of the course discusses PAC Learning and different learnability paradigms. We try to understand what is a learnable problem. The next part of the course focuses on traditional algorithms. The course is highly mathematical and meant to give students a very strong foundation for higher studies in machine learning and related subjects.

**Marking**

Anybody who understands this course, does the homework, and comes to class very regularly, should get a very good grade. The marking is as follows

- Attendance & Participation: 25%,
- Homework & Quizzes: 25%,
- Midterm 20%,
- Final 30%.

Because, this is in some sense a hard course, attendance is extremely important. Students who don’t attend class should expect to be lost. If you cannot attend class because you or your parents are very sick, or are traveling, send me a message on the Slack message group before the class to be missed.

**Class structure**

There is a Slack message group for this class. All announcements and homework and discussions will be on Slack. Homework will be given every two weeks. Late homework will be heavily penalized.

Course Book:

- Understanding Machine Learning: From Theory to Algorithms, by Shai Shalev-Shwartz and Shai Ben-David, Cambridge University Press

We will follow this book very closely. There are plenty of other books on ML such as

- Introduction to Statistical Learning by James, Witten, Hastie, and Tibshirani, Springer Verlag.
- Machine Learning by Barber, Cambridge University Press
- Machine Learning: The Art and Science of Algorithms that Make Sense of Data by Flach, Cambridge University Press
- Introduction to Machine Learning by Alpaydin, MIT Press.

Nowadays, a student’s best friend is YouTube. You can learn almost anything from YouTube or various other online resources. Some very useful lectures online are:

- Shai Ben-David’s Waterloo lectures
- Lots and lots of other stuff online…

Some resources for the needed mathematical background are the texts

**Machine Learning: Spring 2018**

BRACU Class | Date | Time | Room |
---|---|---|---|

CSE 427: Machine Learning: Section 1 | Su, Tu | 12:30 - 1:50 (Su) 2:00 - 3:20 (Tu) | UB20201 (Su) UB30403 (Tu) |

CSE 427: Machine Learning: Section 2 | Su, Tu | 5:15 - 8:00 | UB30103 |

**Lecture Notes**

**Problem Sets**

- Problem Set 1: Problems 33-66 of Chapter 3 end of chapter exercises of Durrett
- Problem Set 2:

**Lectures**

- What is Machine Learning? Examples and Motivation.
- Continued Motivation and Basic Definitions
- ERM Predictors
- PAC Learnability
- Uniform Convergence and PAC Learning
- No Free Lunch Theorem
- Problem Solving Class Finding m.
- Problem Solving Class: More examples