INST 734
Information Retrieval Systems
Fall 2014
Module 5: Monday September 29 to Sunday October 5

This module focused on evaluation of information retrieval systems. The module is designed to be completed in 12 hours over 7 days. As with every module, you must complete all componentents of this module by midnight on the evening of the indicated end date for the module.

Module Checklist

The recommended order for completing the activities in this module is:
  1. View the introductory video for this module.
  2. Read the Harman chapter.
  3. View the first reading commentary video.
  4. Read the Kelly chapter.
  5. View the second reading commentary video.
  6. Read the Chapelle, et al. paper. For sections 6, 7, 9, and 10 it would suffice to skim the section to see what is being compared and then just read the summary at the end of each of those sections. Don't fail to read the other sections (including section 8) carefully, though.
  7. View the third reading commentary video.
  8. Check ELMS to see if you have an additional reading summary assigned to you this week. If so, complete that summary by midnight Thursday and submit it using ELMS.
  9. View the Evaluation Fundamentals lecture video.
  10. View the Evaluating Sets lecture video.
  11. View the Evaluating Rankings lecture video.
  12. View the Exercise E2 Results lecture video.
  13. View the Interleaving lecture video.
  14. View the User Studies lecture video.
  15. On Friday (or later), read and comment on the additional reading summaries that were prepared by your classmates this week.
  16. View the Guest Cameo video by Jamie Callan.
  17. Read Exercise E5.
  18. Watch the exercise explanation video for Exercise E5.
  19. Complete Exercise E5 and submit your results using ELMS.
  20. If you want to hear some of the topics in this module presented differently, consider viewing parts of the optional supplementary videos.

Readings

This week we have three reading assignments.

Summaries of Additional Readings

Additional Readings are assigned to five students. All students should read the summaries once they are posted to ELMS, and all students other than those who wrote a summary this week should make a comment on the discussion board about at least one of the summaries (or about someone else's comment on one of them).

Videos

Here are the videos for this module:

Project Assignment E5

Finally, complete Project Assignment E5. Like all assignments that you are asked to turn in, this is due at midnight on the last day of the module.
Doug Oard
Last modified: Sat Oct 18 23:24:27 2014