Schedule & syllabus

The lecture slides,abs, and assignments will be posted online here as the course progresses. All the pre-recorded lectures would be uploaded Monday every week on Canvas.
Lecture times are 2:30-3:50pm PST. All deadlines are at 11:59pm PST.

This schedule is subject to change according to the pace of the class.

Date Description Materials Events
Part I: Background (Week 1)
Mon Mar 29 Week 1 Presentation topics:
    Course overview
    Background: Deep learning
    Background: Vision
    Background: Keras
Slides Pre-recorded lecture
Tue Mar 30 Orientation, overview Fireside chat, course QA and introduce final project Slides
Fireside chat Lecture
Thu Apr 1 Troubleshooting Homework 0
Intro to Homework 1
Slides Lab

Homework 1 Released:
[pdf]
[Code]
[Written Template]

Description: Homework 1 is designed to make sure you are comfortable with ML fundamentals that will be needed in this course. If you are struggling with parts of this assignment, consider whether you meet the prerequisites.

Learning outcomes: Background checkpoint

Content: XGboost, Python, Sci-kit learn, Tensorflow for vision
Part II: Explanations (Weeks 2 and 3)
Mon Apr 5 Week 2 Presentation topics:
    Explanations overview
    Local explanations
    Input importance and Shapley values
An Evaluation of the Human-Interpretability of Explanation
Why Should I Trust You?": Explaining the Predictions of Any Classifier
Axiomatic Attribution for Deep Networks
Pre-recorded lecture
Tue Apr 6 Shapley values in explanations: SHAP & QII Slides
Algorithmic Transparency via Quantitative Input Influence: Theory and Experiments with Learning Systems
A Unified Approach to Interpreting Model Predictions<
Fireside chat Lecture
Thu Apr 8 Intro to Homework 2
Slides Lab
Fri Apr 9 Homework 1 due
Sat Apr 10 Homework 2 Homework 2 Released:
[pdf]
[Code]
[Written Template]

Mon Apr 12 Week 3 Presentation topics:
    Vision attributions (saliency maps, integrated gradients, layerwise relevant propagation, etc.)
    Evaluations for attributions
    Training point influence
Slides
Interpreting Interpretations: Organizing Attribution Methods by Criteria
Representer point selection for DNN
Understanding Black-box Predictions via Influence Functions
Pre-recorded lecture
Tue Apr 13 More deep learning introspection methods Slides

Towards Automatic Concept-based Explanations
Influence-Directed Explanations for CNNs
Fireside chat Lecture
Thu Apr 15 Homework 2 Q/A
Slides Lab
Part III: Fairness (Weeks 4 and 5)
Mon Apr 19 Week 4 Presentation topics:
    Fairness overview
    Mitigation in Data
    Individual Fairness
Slides
Big Data's Disparate Impact
Certifying and Eliminating Disparate Impact
Fairness through Awareness
Pre-recorded lecture
Tue Apr 20
    How fair do we need to be? Disparate impact/connections to legal sector
    Problems with measuring fairness in the real world
Slides
Certifying and removing disparate impact
The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning
Fireside chat Lecture
Thu Apr 22 Intro to Homework 3
TBD
Slides Lab
Mon Apr 26 Week 5 Presentation topics:
    Mitigation with Adversarial Learning
    Bias in NLP: Embeddings
    Bias in NLP: Beyond embeddings
Slides
Mitigation with Adversarial Learning
Man is to Computer Programmer as Woman is to Homemaker?
Gender Bias in Neural Natural Language Processing
Pre-recorded lecture
Tue Apr 27 Ethical implications, bias in non-language settings
Slides
Human-like Bias in Language Models
Understanding bias in facial recognition technologies
Fireside chat Lecture
Thu Apr 29 Homework 3 Q/A
TBD
Slides Lab
Part IV: Privacy (Weeks 6 and 7)
Mon May 3 Week 6 Presentation topics:
    Privacy overview
    Membership inference
    Model inversion
Slides
Use Privacy in Data-Driven Systems: Theory and Experiments with Machine Learnt Programs
Membership Inference Attacks Against Machine Learning Models
Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
Pre-recorded lecture
Tue May 4 White-box vs Black-box: Bayes Optimal Strategies for Membership Inference Slides
White-box vs Black-box: Bayes Optimal Strategies for Membership Inference
Fireside chat Lecture
Thu May 6 Intro to Homework 4
TBD
Slides Lab
Mon May 10 Week 7 Presentation topics:
    Location privacy
    Federated learning
    Privacy and Explanations
Slides
Quantifying Location Privacy
Comprehensive Privacy Analysis of Deep Learning: Stand-alone and Federated Learning under Passive and Active White-box Inference Attacks
On the Privacy Risks of Model Explanations
Pre-recorded lecture
Tue May 11
    Differential Privacy: A Survey of Results
    No Free Lunch in Data Privacy
Slides
Differential Privacy: A Survey of Results
No Free Lunch in Data Privacy
Fireside chat Lecture
Thu May 13 Homework 4 Q/A
TBD
Slides Lab
Part V: Robustness (Weeks 8 and 9)
Mon May 17 Week 8 Presentation topics:
    Robustness overview
    Adversarial attacks
    Real-world adversarial attacks
Slides
The Limitations of DL in Adversarial Settings
Towards Evaluating the Robustness of Neural Networks
DReal and Stealthy Attacks on State-of-the-Art Face Recognition
Pre-recorded lecture
Tue May 18
    Adversarial Examples Are Not Bugs, They Are Features
    How does adversarial robustness play a role in model explainability (to be discussed further in next week’s Presentation topics)?
Slides
Adversarial Examples Are Not Bugs, They Are Features
Fireside chat Lecture
Thu May 20 Intro to Homework 5
Implement basic attacks for small models
Slides Lab
Mon May 24 Week 9 Presentation topics:
    Adversarial defenses
    Attacks on attributions
    Defenses against attacks on attributions
Slides
Towards Deep Learning Models Resistant to Adversarial Attacks
Explanations can be manipulated and geometry is to blame
Improving the Adversarial Robustness and Interpretability of Deep Neural Networks by Regularizing their Input Gradients
Pre-recorded lecture
Tue May 25
    How to certify robustness?
    Fast Geometric Projections for Local Robustness Certification
    Non-deep net adversarial attacks on explanations?
    Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methods
Slides
Fast Geometric Projections for Local Robustness Certification
Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methods
Fireside chat Lecture
Thu May 27 Homework 5 Q/A
TBD
Slides Lab
Part VI: Synthesis and Takeaways (Week 10)
Tue Jun 1 Final assignment presentations Fireside chat Lecture
Thu Jun 3 Final assignment presentations Slides Lab