LBSC 796/INFM 718R
Information Retrieval Systems
Fall 2007
Batch Evaluation Results
Here's a recap of the details I provided at the end of class on
November 26.
- Describe the problem that you are solving (not much detail is
needed on this for class purposes) [0.5-1 page]
- Describe the design of your evaluation (generally including: what
documents you used, where you got your topics, how many topics you
used, how you got your relevance judgments, and what evaluation
measure(s) you used). [1-2 pages]
- Present your results using one or more tables and/or graphs
(either way is fine), along with some explanatory comments. Probably
easiest to present this in the same way as you will in your class
presentation. [1-2 pages, most of which will be tables or graphs]
- Analysis of your results. Don't get too carried away here -- the
key is to draw some interesting conclusions from your evaluation. [1-2
pages]
- Some appropriate way of ending (e.g., remarks on limitations, one
or more suggestions for future work, etc.) [0.5 page]
The total should be about 6 pages. Several good examples are
available from TREC or SIGIR (which
is available through the ACM Digital Library in Research Port).
As with all project components,
this report will be separately graded but the overall proect grade
will be holistic (not some formulaic combination of the graded parts).
Doug Oard
Last modified: Dec 1 2007