CMSC 470

Logistics

Location	Iribe 1116
Q & A	Mon. / Wed. 08:30 AM - 09:45 AM
Webpage	http://umiacs.umd.edu/~jbg/teaching/CMSC_470/
Homework Submission	https://www.gradescope.com/courses/670788
Mailing List	https://piazza.com/umd/fall2025/cmsc470
Text	Speech and Natural Language Processing
Syllabus	https://docs.google.com/document/d/1lrCYFd20FYuwSi7Zrhj-Zqk4QotFFnJT92sxdN67z8M/edit?usp=sharing

People

Professor

Jordan Boyd-Graber
IRB 4146
Office Hours (IRB 4146 / Online): By appointment

Teaching Assistants (Check Piazza for Locations)

Wichayaporn "Joy" Wongkamjan (OH Thursdays 15:00-17:00, Online)
Zongxia Li (OH Fridays 9:00-10:00, 11:00-12:00)
Ashish Seth (OH Fridays 15:00-17:00)

Schedule

Date	In-Class Topic	Assignment Due
Wednesday, 03. September 2025	What the class is about?
	Content: Welcome to NLP What's a word? What's a language? Tokenization BPE Administrivia: How to read this webpage How to take a class with me More on the Flipped Classroom Hybrid classes Grader Expectations Readings: SLP2 Linguistic Fundamentals for Natural Language Processing: 100 Essentials from Morphology and Syntax (Chapters 1 and 2) Alternate Link Optional Readings: Python (and programming) introductory course Jon Hewitt's Math Notes First weeks of INST 414 as review A probability primer Grinstead and Snell, Chapters 1-2, Chapter 4.1 How the statistical revolution changes (computational) linguistics The deep learning revolution in NLP
Friday, 05. September 2025	Homework Due	Warmup (5 points)
Monday, 08. September 2025	AI vs. NLP
	Videos: What's the difference between NLP, AI, and ChatGPT? What made generative AI possible What to call these models? Shannon Game Evaluating Language Models The Turing Test Optional Review: What are expectations and entropy? administrivia Why you shouldn't use generative AI to cheat in my class Readings: Language Models: A Guide for the Perplexed SLP3
Wednesday, 10. September 2025	Information Retrieval
	Videos: The Cranfield Paradigm What is information retrieval? TF-IDF Evaluation RAG Readings: IR Chapter 1, 6 SLP 11.1 Evolution of Cranfield (Optional) Slides: Cranfield IR Intro IR tf-idf IR eval IR exercise
Friday, 12. September 2025	Homework Due	Tokenization and tf-idf (10 points)
Monday, 15. September 2025	Logistic Regression
	Videos: Regression Logistic Regression Stochastic Gradient Descent Feature Engineering in the Age of Deep Learning Feature Engineering for Quiz Bowl Slides: Logistic Regression w/ SGD Example Readings: SNLP Chapter 4
Wednesday, 17. September 2025	Continuing Logistic Regression / Homework Workshop

Friday, 19. September 2025	Homework Due	Logistic Regression (15 points)
Monday, 22. September 2025	Word representations
	Videos: Distributional Semantics Word2Vec Evaluation Readings: SNLP Chapter 5 (formerly 6) Slides: Distributional Semantics Word2Vec Eval Exercise Exercise (Derivation)
Wednesday, 24. September 2025 [Rosh Hashana]	Pytorch
	Videos: Deep Backprop Frameworks Pytorch DAN ADAM (released late, so will not be on quiz) Readings: SNLP Chapter 6 (Was 6) Slides: Deep Backprop Frameworks Pytorch DAN ADAM Exercise
Friday, 26. September 2025	Homework Due	Feature Engineering (15 points)
Monday, 29. September 2025	Homework Framework
	Videos: Advice / Overview How to stump a computer Good questions Bad questions optional_videos IRT optional_past_finals 2019 Finals 2022 Finals
Wednesday, 01. October 2025	Syntax
	Videos: What's a part of speech, and why is it a joint problem? Hidden Markov Modeling Constituency grammars Dependency parsing Readings: SNLP Chapters 17.1 and 17.2 SNLP Chapter 18.1 - 18.3 SNLP Chapter 19.1 - 19.2 Slides Sequence Modeling HMM Constituency grammars Dependency HMM Ex PCFG Ex Dependency Ex Optional Lectures Viterbi Algorithm PCFGs CYK Parsing Shift-Reduce Parser
Friday, 03. October 2025	Homework Due	Sparse Retrieval (15 points)
Monday, 06. October 2025	Linear neural language models (Last content on Midterm I)
	Videos: RNN for Sentiment RNN for LM LSTM Backpack Sequence models in Pytorch Readings: SNLP 19 (Was 9) Optional Readings: Backpack LM
Wednesday, 08. October 2025 [Succos]	Workshop: Feature Engineering

Friday, 10. October 2025 [Succos]	Homework Due	Pytorch LR + Adam
Monday, 13. October 2025 [Succos]	Fall Break
Wednesday, 15. October 2025 [Simchas Torah]	Transformers
	Videos: Contextual Neural Language Models Overview Transformer Encoder BERTology Decoder Implementation Details Readings: SNLP 8 The Annotated Transformer SNLP 7-7.3
Friday, 17. October 2025	Homework Due	DAN (20 points)
Monday, 20. October 2025	Decoding

Wednesday, 22. October 2025	Finetuning

Friday, 24. October 2025	Homework Due	LM (20 points)
Monday, 27. October 2025	Alignment
	Videos: Fine-tuning, prompting, and how they relate to NLP RL Review Alignment Policy Gradient RLHF ['DSPY'] Readings: SLP 9 Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback optional_videos UG Research at UMD on Prompting
Wednesday, 29. October 2025 [Shavuos]	Slack/Sick Day II

Friday, 31. October 2025	Homework Due	Transformer LM (20 points)
Monday, 03. November 2025	Midterm Review

Wednesday, 05. November 2025	Midterm I

Monday, 10. November 2025	Question Answering Approaches
	Videos: Dense Retrieval BERT for MRQA Multihop Generation for QA Conversational QA Long QA Readings: MRC Literature Review
Wednesday, 12. November 2025	Question Answering Datasets and Evaluation
	Videos: How question answering saved civilization The Turing Test Watson on Jeopardy! QA Datasets Cranfield vs. Manchester Readings: ['Questioning Answers']
Friday, 14. November 2025	Homework Due	Finetuning + Alignment (20 points)
Monday, 17. November 2025	Item Response Theory

Wednesday, 19. November 2025	Adversarial Examples / Red Teaming

Friday, 21. November 2025	Homework Due	Adversarial Authoring (15 points)
Monday, 24. November 2025	Machine translation
	Videos: Translation is Hard Word-based Translation Phrase-based Translation Neural Machine Translation Decoding Evaluation Readings: NMT Book (Chapter 5)
Wednesday, 26. November 2025	Thanksgiving
Monday, 01. December 2025	Computational Social Science

Wednesday, 03. December 2025	Midterm II

Friday, 05. December 2025	Homework Due	Prompt Optimization (15 points)
Monday, 08. December 2025	Expo Match

Wednesday, 10. December 2025	Ask Me Anything
	Videos: Course Evals You got a PhD in Computational Linguistics ... what now? Optimizing ML for Society How far off were my predictions? and p(Doom)
Monday, 15. December 2025 [Chanuka]	Final Exam (for computers): 1:30pm - 3:30pm

Natural Language Processing (CMSC 470)

Logistics

People

Professor

Teaching Assistants (Check Piazza for Locations)

Schedule