INST 734
Information Retrieval Systems
Spring 2018
Module 5: Monday February 26 to Sunday March 4

This module focused on evaluation of information retrieval systems. The module is designed to be completed in 12 hours over 7 days. As with every module, you must complete all componentents of this module by midnight on the evening of the indicated end date for the module.

Module Checklist

The recommended order for completing the activities in this module is:
  1. View the introductory video for this module.
  2. Read Chapter 8 of our CMS textbook.
  3. View the first reading commentary video.
  4. Read the Kelly chapter.
  5. View the second reading commentary video.
  6. Read the Chapelle, et al. paper. For sections 6, 7, 9, and 10 it would suffice to skim the section to see what is being compared and then just read the summary at the end of each of those sections. Don't fail to read the other sections (including section 8) carefully, though.
  7. View the third reading commentary video.
  8. Check ELMS to see if you have an additional reading summary assigned to you this week. If so, complete that summary by midnight Thursday and submit it using ELMS. Be sure to follow the guidance on page 2 of the Example Reading Summary that was provided in Module 1.
  9. View the Evaluation Fundamentals lecture video.
  10. View the Evaluating Sets lecture video.
  11. View the Evaluating Rankings lecture video.
  12. View the Exercise E2 Results lecture video.
  13. View the Interleaving lecture video.
  14. View the User Studies lecture video.
  15. On Friday (or later), read the additional reading summaries that were prepared by your classmates this week.
  16. View the Guest Cameo video by Jamie Callan.
  17. Don't forget to post at least one substantive comment to this module's discussion forum.
  18. Read Exercise E5.
  19. Watch the exercise explanation video for Exercise E5.
  20. Complete Exercise E5 and submit your results using ELMS.
  21. If you want to hear some of the topics in this module presented differently, consider viewing parts of the optional supplementary videos.

Readings

This week we have three reading assignments.

Summaries of Additional Readings

 Additional Readings are assigned to five students. All students should read the summaries once they are posted to ELMS.

Videos

Here are the videos for this module:

Project Assignment E5

Finally, complete Project Assignment E5. Like all assignments that you are asked to turn in, this is due at midnight on the last day of the module.
Doug Oard
Last modified: Sun Feb 25 23:46:24 2018