3.5: Evaluation of IR Systems

The goal of the evaluation of a IR system should be to determine how useful a system or a specific method within a system is to solve the information problems of users. A sound experimental evaluation of this question would need representative samples of problems and users. Within experiments many potentially influencing factors should be examined including

Such an approach is not feasible. Therefor most evaluations are restricted to a limited but central sub task.


the goal is to find as many relevant documents as possible.

ZUGANG3.5.1: Measures

ZUGANG3.5.2: Test Collections

ZUGANG3.5.3: The TREC Experiments


© 1998 / HTML-Version 17. 11. 1998: R. Ferber