CS3236: Introduction to Information Theory (2014–2015)

Course material for CS3236: Introduction to Information Theory, taught at the National University of Singapore during a sabbatical year.

Lecture slides

  1. Introduction
  2. Entropy
  3. Source coding
  4. Lossless compression
  5. Noisy channel
  6. Noisy channel coding theorem
  7. Error-correcting codes
  8. Cryptography (companion notes: statistical distance, min-entropy, randomness)
  9. Kolmogorov complexity
  10. Properties of Kolmogorov complexity

Assignments

  1. CS3236: Homework 1
  2. CS3236: Homework 2
  3. CS3236: Homework 3
  4. CS3236: Homework 4
  5. CS3236: Homework 5
  6. CS3236: Homework 6
  7. CS3236: Homework 7
  8. CS3236: Homework 9
  9. CS3236: Homework 11
  10. CS3236: Homework 12

Assessments