3.5.2: Test Collections

The relevance relation cannot be generated automatically. It has to be determined by humans knowing the domain. This means that for every query all documents of a collection have to be known or inspected. For large collections this is very expensive. Therefor collections with queries and relevance data that had once been generated were often reused.

ZUGANGAbb. 23: Test Collections (according to Griffiths Luckhurst & Willett 1986 and Dumais, 1991)

Test collections have the advantages to be available and to offer comparable test conditions. But there are also some p roblems:


© 1998 / HTML-Version 17. 11. 1998: R. Ferber