LBSC 796/INFM 718R
Information Retrieval Systems
Spring 2011
Batch Evaluation Results
Once you have completed your batch evaluation, you will turn in a
written report describing your evaluation results. Here's a brief
outline for what should be in the report:
- Describe the problem that you are solving (not much detail is
needed on this for class purposes) [0.5-1 page]
- Describe the design of your evaluation (generally including: what
documents you used, where you got your topics, how many topics you
used, how you got your relevance judgments, and what evaluation
measure(s) you used). [1-2 pages]
- Present your results using one or more tables and/or graphs
(either way is fine), along with some explanatory comments. Probably
easiest to present this in the same way as you will in your class
presentation. [1-2 pages, most of which will be tables or graphs]
- Analysis of your results. Don't get too carried away here -- the
key is to draw some interesting conclusions from your evaluation. [1-2
pages]
- Some appropriate way of ending (e.g., remarks on limitations, one
or more suggestions for future work, etc.) [0.5 page]
The total should be about 6 pages. Several good examples are
available from TREC or SIGIR (which
is available through the ACM Digital Library in Research Port).
As with all project components,
this report will be separately graded but the overall project grade
will be holistic (not some formulaic combination of the graded parts).
Doug Oard
Last modified: Jan 24 2011