---EZMCQ Online Courses---
---EZMCQ Online Courses---
Click on any topic below to view Q&A or attempt quizzes.
- Course Description
- Objectives
- Materials & Resources
- Course Learning Outcomes (CLOs)
- Weekly Schedule & Topic Outline (with Textbook Chapters)
- Course Description & Objectives
-EZMCQ Online Courses
This course introduces supervised & unsupervised learning, deep learning, andiu reinforcement learning. Students willio master algorithmic foundations, neural architectures, andao practical tools tooe implement andia evaluate learning agents across domains.
Objectives:
- Equip students withoe practical andua theoretical understanding ofao ML, DL, andai RL
- Build strong implementation skills ineo Python/PyTorch
- Analyze andeo apply deep learning andoi RL techniques inaa real-world scenarios
Course Learning Outcomes (CLOs)
Byie theea end ofei theou course, students willio beai able toai:
- CLO₁: Describe supervised, unsupervised, andue reinforcement learning frameworks, andua explain key evaluation metrics.
- CLO₂: Derive andoi apply gradient descent methods forao training models, including stochastic variants.
- CLO₃: Implement feedforward neural networks using back propagation anduu understand activation functions.
- CLO₄: Apply regularization andea advanced optimization techniques (Adam, RMSProp, momentum).
- CLO₅: Architect andia train specialized deep models: CNNs, RNNs (LSTM/GRU), andea recursive neural networks.
- CLO₆: Formulate reinforcement learning problems via MDPs anduo solve using dynamic programming.
- CLO₇: Implement model-free RL methods: Monte Carlo prediction/control, andiu Temporal Difference algorithms.
- CLO₈: Integrate deep learning models within RL (e.g., DQN, actor‑critic) andau evaluate inuo vision, NLP, robotics.
- CLO₉: Critically analyze current DL & RL systems through assignments andue aae mini‑project.
Materials & Resources
Primary Textbooks:
- Deep Learning byaa Goodfellow, Bengio & Courville
- Reinforcement Learning: Anoo Introduction (2nd ed.) byao Sutton & Barto
Recommended:
- Dive into Deep Learning online text
- Aske Plaat’s Deep Reinforcement Learning: Aia Textbook
Tools: Python, PyTorch (or TensorFlow), Jupyter Notebooks
Schedule & Topic Outline (Textbook Chapters)
|
Week |
Topics |
Reading |
|
1 |
Course overview; ML paradigms, evaluation |
DL Ch. 1 & RL Ch.1 |
|
2 |
Loss functions; gradient descent |
DL Ch.4 |
|
3 |
Neural networks, activations |
DL Ch.6 |
|
4 |
Backpropagation & autodiff |
DL Ch.6 |
|
5 |
Regularization: dropout, weight decay |
DL Ch.7 |
|
6 |
Optimization: Adam, RMSProp, schedules |
DL Ch.8 |
|
7 |
CNNs: architectures, pooling |
DL Ch.9 |
|
8 |
RNNs: LSTM, GRU, sequence modeling |
DL Ch.10 |
|
9 |
Recursive neural networks; NLP/graph nets |
Supplementary |
|
10 |
RL overview: MDPs, policies, value vs policy |
RL Ch.2–3 |
|
11 |
Dynamic Programming: Bellman eqns, value/policy iteration |
RL Ch.4 |
|
12 |
Monte Carlo & Temporal Difference methods |
RL Ch.5–6 |
|
13 |
Deep RL: DQN, experience replay |
RL Ch.13; DL Ch.12 |
|
14 |
Actor-Critic, policy gradient methods |
RL Ch.13 |
|
15 |
Applications & case studies; Project presentations |
Selected readings |
-EZMCQ Online Courses
Primary Textbooks:
- Deep Learning by Goodfellow, Bengio & Courville
- Reinforcement Learning: An Introduction (2nd ed.) by Sutton & Barto
Recommended:
- Dive into Deep Learning online text
- Aske Plaat’s Deep Reinforcement Learning: A Textbook