Weekly Schedule

The schedule along with the list of topics to be covered are tentative and subject to change.

Week DateModuleTopicAssignment
1T1/20IntroductionWelcome and course overviewPost a note on Teams to introduce yourself.
Review the Syllabus.
 R1/22 Linear algebra basics; Numpy and PyTorch basicsSetup software and development environment for the course (see here)
2T1/27Linear Neural Networks for RegressionLinear regression 
 R1/29 Linear regressionAssignment 1 released
3T2/3 Linear regression implementation from scratch 
 R2/5 Computational graphs and backpropagation; Linear regression implementation with PyTorch 
4T2/10 Generalization, overfitting, and regularization 
 R2/12Linear Neural Networks for ClassificationLogistic regressionAssignment 2 released
5T2/17 Softmax regression 
 R2/19 Softmax regression implementation from scratch and with PyTorch 
6T2/24Non-linear Neural NetworksMulti-layer perceptrons 
 R2/26 Multi-layer perceptron implementation from scratch and with PyTorchAssignment 3 released
7T3/3 Network initialization; Dropout 
 R3/5Convolutional Neural Networks (CNNs)Introduction 
8T3/10 CNN details 
 R3/12 Mid-term Exam in Wagar 133 
9T3/17 No class: Spring recess 
 R3/19 No class: Spring recess 
10T3/24 The LeNet CNN 
 R3/26Modern CNNsAlexNet and VGGs 
11T3/31 Batch Normalization 
 R4/2 ResNets + Talk by Amy Cailene from the Career CenterAssignment 4 released
12T4/7Recurrent Neural NetworksIntroduction 
 R4/9 LSTMs for text classification 
13T4/14TransformersThe attention mechanism 
 R4/16 Transformer architecture; Transformers for text generation and classificationAssignment 5 released
14T4/21 Large language models (LLMs) 
 R4/23Reinforcement Learning (RL)Introduction 
15T4/28 RL with neural networks 
 R4/30Additional TopicsWhat did we miss? 
16T5/5 Review (by Austin and Sifat) 
 R5/7 Can we trust AI? 
17T5/12 Final Exam in Wagar 133 (9:40-11:40 am)