Show simple item record

dc.contributor.authorMakary, Mireille
dc.contributor.authorOakes, Michael
dc.contributor.authorYamout, Fadi
dc.date.accessioned2017-03-09T10:12:22Z
dc.date.available2017-03-09T10:12:22Z
dc.date.issued2016-09-20
dc.identifier.citationMakary, M., Oakes, M., Yamout, F. (2016) 'Towards automatic generation of relevance judgments for a test collection', Eleventh International Conference on Digital Information Management, ICDIM 2016, September 19-21, Porto, Portugal: IEEE, pp. 121-126
dc.identifier.isbn9781509026425
dc.identifier.doi10.1109/ICDIM.2016.7829763
dc.identifier.urihttp://hdl.handle.net/2436/620407
dc.description.abstractThis paper represents a new technique for building a relevance judgment list for information retrieval test collections without any human intervention. It is based on the number of occurrences of the documents in runs retrieved from several information retrieval systems and a distance based measure between the documents. The effectiveness of the technique is evaluated by computing the correlation between the ranking of the TREC systems using the original relevance judgment list (qrels) built by human assessors and the ranking obtained by using the newly generated qrels.
dc.language.isoen
dc.publisherIEEE
dc.relation.urlhttp://ieeexplore.ieee.org/document/7829763/
dc.subjectInformation Retrieval
dc.subjectTest Collections
dc.subjectRelevance Judgements
dc.titleTowards automatic generation of relevance judgments for a test collection
dc.typeConference contribution
dc.identifier.journalEleventh International Conference on Digital Information Management (ICDIM)
dc.conference.name2016 Eleventh International Conference on Digital Information Management (ICDIM)
dc.conference.nameEleventh International Conference on Digital Information Management
dc.conference.locationPorto, Portugal
pubs.finish-date2016-09-21
pubs.finish-date2016-09-21
pubs.place-of-publicationPorto, Portugal
pubs.start-date2016-09-19
pubs.start-date2016-09-19
dc.date.accepted2016-08-31
rioxxterms.funderUniversity of Wolverhampton
rioxxterms.identifier.projectUoW090317MO
rioxxterms.versionAM
rioxxterms.licenseref.urihttps://creativecommons.org/CC BY-NC-ND 4.0
rioxxterms.licenseref.startdate2017-03-09
refterms.dateFCD2018-10-18T15:47:00Z
refterms.versionFCDAM
refterms.dateFOA2017-03-09T00:00:00Z
html.description.abstractThis paper represents a new technique for building a relevance judgment list for information retrieval test collections without any human intervention. It is based on the number of occurrences of the documents in runs retrieved from several information retrieval systems and a distance based measure between the documents. The effectiveness of the technique is evaluated by computing the correlation between the ranking of the TREC systems using the original relevance judgment list (qrels) built by human assessors and the ranking obtained by using the newly generated qrels.


Files in this item

Thumbnail
Name:
ICDIM_Towards automatic generation ...
Size:
504.1Kb
Format:
PDF

This item appears in the following Collection(s)

Show simple item record

https://creativecommons.org/CC BY-NC-ND 4.0
Except where otherwise noted, this item's license is described as https://creativecommons.org/CC BY-NC-ND 4.0