Natural Language Processing (CMSC 470)

Logistics

Location CSIC 1121
Time Tue./Thu. 11:00am - 12:15pm
Webpage http://umiacs.umd.edu/~jbg/teaching/CMSC_470/
Homework Submission https://www.gradescope.com/courses/303336
Mailing List http://piazza.com/umd/fall2021/cmsc470
Text Speech and Natural Language Processing
Syllabus https://docs.google.com/document/d/1UN3qlJttJFRXP4qtoIriZxHjYQflvsUNsulHLIFVTzQ/edit?usp=sharing

People

Professor

Jordan Boyd-Graber
IRB 4146
Office Hours (IRB 4146): By appointment

Teaching Assistant

Neha Pundlik Srikanth (nehasrik@umd.edu)

Schedule

Date In-Class Topic Assignment Due
Tue 31. Aug Introducing the Course and Linguistic Concepts
Lecture: Optional Readings:
Thu 2. Sep Information Retrieval / tf-idf
Lecture: Readings:
Tue 7. Sep Logistic Regression Intro [רֹאשׁ הַשָּׁנָה]
Lecture: Readings:
  • SNLP Chapter 5.1-5.3
Thu 9. Sep Feature Engineering
Lecture: Readings:
Fri 10. Sep Homework Due tf-idf
Thu 14. Sep Stochastic Gradient Descent [יוֹם כִּיפּוּר]
Lecture: Readings:
  • SNLP Chapter 5.4-5.9
Is there only really one lecture? Yes, because this is a difficult but super important concept. Make sure you understand it!
Tue 14. Sep Project Framework
Lectures: Readings:
Fri 17. Sep Homework Due tf-idf Guesser
Tue 21. Sep Distributional Semantics (Word2Vec)
Lecture: Readings:
  • SNLP Chapter 6
Thu 23. Sep Neural Networks for Language
Lecture: Readings:
  • SNLP Chapter 7
Fri 24. Sep Homework Due Stochastic Gradient Descent
Tue 28. Sep Deep Learning Frameworks
Lecture:
Thu 30. Sep Expo Match I (Students)
Fri 1. Oct Homework Due Pytorch Logistic Regression
Tue 5. Oct History of Question Answering
  • How question answering saved civilization
  • What question answering researchers can learn from trivia
  • Watson on Jeopardy!
Thu 7. Oct Neural Sequence Models
Lecture: Readings:
  • SNLP 9-9.3.3
This material will not be on the midterm.
Fri 8. Oct Homework Due Buzzer Feature Engineering
Tue 12. Oct Midterm Review
Thu 14. Oct Midterm
Tue 19. Oct Expo Match II: Course Staff
Thu 21. Oct Modern QA
Lecture: Readings:
  • SNLP 23
Fri 22. Oct Homework Due Deep Retrieval
Tue 26. Oct Transformer Language Models
Lecture: Reading:
  • SNLP 9.4-9.6
Thu 28. Oct Transformer Encoders for QA
Lecture:
  • Dense Passage Retrieval
  • BERT for Machine Reading
  • Other Ways of Doing QA: Generation / NN
Fri 29. Oct Homework Due Project Proposal Due
Tue 2. Nov Constiuency Syntax
Lecture: Readings:
  • SLP Chapter 12
Super old video, I know, but there's nothing really wrong with it. I can't bring myself to redo it.
Thu 4. Nov Dependency Syntax
Lecture: Readings:
  • SLP Chapter 13
Tue 9. Nov Entities
Lecture:
Thu 11. Nov Expo Match III: MAQT
Fri 12. Nov HW Due Run a QA Model
Tue 16. Nov Machine Translation
Lecture: Readings:
Thu 18. Nov Topic Models
Lecture: Readings:
Fri 19. Nov Homework Due Project Deliverable
Tue 23. Nov Slack Day
Thu 25. Nov Thanksgiving
Tue 30. Nov Advanced QA: Fact Checking, Long-form QA, Bias
Readings:
Thu 2. Dec AMA
Possible Topics:
Tue 7. Dec Midterm Review
Thu 9. Dec Midterm II