Loading...
Using key phrases as new queries in building relevance judgements automatically
Makary, Mireille Oakes, Michael Yamout, Fadi
Makary, Mireille
Oakes, Michael
Yamout, Fadi
Editors
Other contributors
Affiliation
Epub Date
Issue Date
2016-09-30
Submitted date
Alternative
Abstract
We describe a new technique for building a relevance judgment list (qrels) for TREC test collections with no human intervention. For each TREC topic, a set of new queries is automatically generated from key phrases extract-ed from the top k documents retrieved from 12 different Terrier weighting models when the initial TREC topic is submitted. We assign a score to each key phrase based on its similarity to the original TREC topic. The key phrases with the highest scores become the new queries for a second search, this time using the Terrier BM25 weighting model. The union of the documents retrieved forms the automatically-build set of qrels.
Citation
Makary, M., Oakes, M., Yamout, F. (2016) 'Using key phrases as new queries in building relevance judgements automatically', Lernen,Wissen, Daten, Analysen (LWDA) Conference Proceedings, LWDA'16, September 12-14, Potsdam, Germany: CEUR - workshop proceedings, 1670, pp. 175-176.
Publisher
Research Unit
DOI
PubMed ID
PubMed Central ID
Embedded videos
Additional Links
Type
Conference contribution
Language
en
Description
Series/Report no.
ISSN
1613-0073