|
|
|
                                          
|
Return to Posters
Many common web searches by their nature have a very small number of relevant documents. Homepage and "namedpage" searching are known-item searches where there is only a single relevant document. Topic distillation is a special kind of topical relevance search where the user wishes to find a few key web sites rather than every relevant web page. Because these types of searches are so common, web search evaluations have come to focus on tasks where there are very few relevant documents. Evaluations with few relevant documents pose special challenges for current metrics. In particular, the TREC 2003 topic distillation evaluation is unable to distinguish most submitted runs from each other.
@inproceedings{1009105, author = {Ian Soboroff}, title = {On evaluating web search with very few relevant documents}, booktitle = {SIGIR '04: Proceedings of the 27th annual international conference on Research and development in information retrieval}, year = {2004}, isbn = {1-58113-881-4}, pages = {530--531}, location = {Sheffield, United Kingdom}, doi = {http://doi.acm.org/10.1145/1008992.1009105}, publisher = {ACM Press}, }  ©2005 Association for Computing Machinery |
