Natural Language Processing (CMSC 470)

Logistics

Location Iribe 2207
Time Tue./Thu. 11:00am - 12:15pm
Webpage http://umiacs.umd.edu/~jbg/teaching/CMSC_470/
Mailing List http://piazza.com/umd/fall2021/cmsc470
Text Speech and Natural Language Processing
Syllabus https://docs.google.com/document/d/1UN3qlJttJFRXP4qtoIriZxHjYQflvsUNsulHLIFVTzQ/edit?usp=sharing

People

Professor

Jordan Boyd-Graber
IRB 4146
Office Hours (IRB 4146): Mondays 12:00 - 13:00 and by appointment

Teaching Assistant

Schedule

Date In-Class Topic Assignment Due Lecture
Tue 31. Aug Introducing the Course and Linguistic Concepts [Video: A B] [PDF: A B]
Optional Readings:
Thu 2. Sep Information Retrieval / tf-idf [Video: A B C] [PDF: A B C D] [Class]
Readings:
Tue 7. Sep Classification: KNN, Logistic Regression, and Naive Bayes [PDF A B C] [Video A B] [Class]
Readings:
  • SNLP Chapter 5.1-5.3
TODO: KNN
Thu 9. Sep Homework Lab
Fri 10. Sep Homework Due tf-idf
Tue 14. Sep Project Framework [Video: A B C] [PDF: A B C] [Class]
Readings: TODO: Update framework / instructions
Thu 16. Sep Stochastic Gradient Descent [PDF A B] [Video A] [Class A Class B]
Readings:
  • SNLP Chapter 5.4-5.9
Fri 17. Sep Homework Due NN Question Answering
Tue 21. Sep Classification and Feature Engineering [Video: Classification, Examples: A B] [PDF: Classification Examples: A B] [Class]
Thu 23. Sep Distributional Semantics (Word2Vec) [Video: A B C] [PDF: A B C D] [Class]
Readings:
  • SNLP Chapter 6
Fri 24. Sep Homework Due Logistic Regression
Tue 28. Sep Neural Networks for Language [Video: Deep Backprop Frameworks Pytorch DAN] [PDF: A B C D E F] [Class]
Readings:
  • SNLP 7
Thu 30. Sep Pytorch
Fri 1. Oct Homework Due Buzzer Feature Engineering
Tue 5. Oct A History of Question Answering
Thu 7. Oct Expo Match I (Students) [Class]
Fri 8. Oct Homework Due Pytorch Logistic Regression
Tue 12. Oct Neural Sequence Models [PDF: A B C] [Video: RNN LSTM] [Class]
Readings:
  • SNLP 9
Thu 14. Oct Midterm Review
Fri 15. Oct Homework Due Deep Averaging Networks
Tue 19. Oct Midterm
Thu 21. Oct Machine Reading [Video: Entity Recognition and Linking Coref Datasets Dr. QA] [PDF: A B C D E] [In-class]
Readings:
  • SNLP 23
Tue 26. Oct Homework Lab
Thu 28. Oct Part of Speech Tagging [Video] [A B C] [In-class]
Readings:
  • SLP Chapter 8
Tue 2. Nov Constiuency Syntax [Video] [Slides Ex] [In-class]
Readings:
  • SLP Chapter 12
Thu 4. Nov Dependency Syntax [Video] [Slides Ex] [In-class]
Fri 5. Nov Homework Due Project Proposal Due
Tue 9. Nov Entities
Thu 11. Nov Expo Match II (MAQT / Faculty)
Fri 12. Nov HW Due Sequence Buzzer
Tue 16. Nov Sequence to Sequence [Video: Word-Based Phrase Neural] [PDF: Word Phrase Neural Ex] [In-class]
Readings:
Thu 18. Nov Topic Models [Video: Intro Evaluation Gibbs Sampling] [PDF: Topic Models Gibbs Sampling Ex] [In-class]
Readings:
Fri 19. Nov Homework Due Project Deliverable
Tue 23. Nov Slack Day
Thu 25. Nov Thanksgiving
Tue 30. Nov Advanced QA: Fact Checking, Long-form QA
Readings:
Thu 2. Dec Bias in NLP and AI
Readings:
Fri 3. Dec Homework Due Retriever Answerer
Tue 7. Dec Midterm Review [In Class Video]
Thu 9. Dec Midterm II