3.5.3: The TREC Experiments

Since 1992: Seven Text REtrieval Conferences (http://trec.nist.gov/).

The goal of the conference series is to encourage research in information retrieval from large text applications by providing a large test collection, uniform scoring procedures, and a forum for organizations interested in comparing their results.

Material provided for preparation:

Material provided for testing:

Participants can adapt their systems to the material provided for preparation. With the new material for testing two tasks are given:

Participants provide ranked lists of 1000 hits per topic. Evaluation is done centrally at NIST (National Institute of Standards & Technology, USA). Measures are Precision Recall Diagrams and the mean precision over a fixed set of recall values.

ZUGANG3.5.3.1: Relevance Judgements

ZUGANG3.5.3.2: Tracks


© 1998 / HTML-Version 17. 11. 1998: R. Ferber