Show simple item record

dc.contributor.authorThelwall, Mike
dc.contributor.authorKousha, Kayvan
dc.contributor.authorAbdoli, Mahshid
dc.contributor.authorStuart, Emma
dc.contributor.authorMakita, Meiko
dc.contributor.authorWilson, Paul
dc.contributor.authorLevitt, Jonathan
dc.date.accessioned2023-01-16T10:39:26Z
dc.date.available2023-01-16T10:39:26Z
dc.date.issued2023-12-31
dc.identifier.citationThelwall, M., Kousha, K., Abdoli, M., Stuart, E., Makita, M., Wilson, P. and Levitt, J. (in press) Terms in journal articles associating with high quality: can qualitative research be world-leading? Journal of Documentation.en
dc.identifier.issn0022-0418en
dc.identifier.doi10.1108/JD-12-2022-0261en
dc.identifier.urihttp://hdl.handle.net/2436/625089
dc.descriptionThis is an accepted manuscript of an article due to be published by Emerald in Journal of Documentation. The accepted version of the publication may differ from the final published version.en
dc.description.abstractPurpose: Scholars often aim to conduct high quality research and their success is judged primarily by peer reviewers. Research quality is difficult for either group to identify, however, and misunderstandings can reduce the efficiency of the scientific enterprise. In response, we use a novel term association strategy to seek quantitative evidence of aspects of research that associate with high or low quality. Design/methodology/approach: We extracted the words and 2–5-word phrases most strongly associating with different quality scores in each of 34 Units of Assessment (UoAs) in the Research Excellence Framework (REF) 2021. We extracted the terms from 122,331 journal articles 2014-2020 with individual REF2021 quality scores. Findings: The terms associating with high- or low-quality scores vary between fields but relate to writing styles, methods, and topics. We show that the first-person writing style strongly associates with higher quality research in many areas because it is the norm for a set of large prestigious journals. We found methods and topics that associate with both high- and low-quality scores. Worryingly, terms associating with educational and qualitative research attract lower quality scores in multiple areas. REF experts may rarely give high scores to qualitative or educational research because the authors tend to be less competent, because it is harder to make world leading research with these themes, or because they do not value them. Originality: This is the first investigation of journal article terms associating with research quality.en
dc.description.sponsorshipThis study was funded by Research England, Scottish Funding Council, Higher Education Funding Council for Wales, and Department for the Economy, Northern Ireland as part of the Future Research Assessment Programme (https://www.jisc.ac.uk/future-research-assessment-programme).en
dc.formatapplication/pdfen
dc.language.isoenen
dc.publisherEmeralden
dc.relation.urlhttps://www.emerald.com/insight/publication/issn/0022-0418en
dc.subjectREF2021en
dc.subjectresearch excellence frameworken
dc.subjectresearch qualityen
dc.titleTerms in journal articles associating with high quality: can qualitative research be world-leading?en
dc.typeJournal articleen
dc.identifier.journalJournal of Documentationen
dc.date.updated2023-01-13T11:49:32Z
dc.date.accepted2023-01-13
rioxxterms.funderResearch England, Scottish Funding Council, Higher Education Funding Council for Wales, and Department for the Economy, Northern Irelanden
rioxxterms.identifier.projectUOW16012023MTen
rioxxterms.versionAMen
rioxxterms.licenseref.urihttps://creativecommons.org/licenses/by-nc/4.0/en
rioxxterms.licenseref.startdate2023-12-31en
refterms.dateFCD2023-01-16T10:38:50Z
refterms.versionFCDAM


Files in this item

Thumbnail
Name:
Thelwall_Terms_in_journal_arti ...
Embargo:
2023-12-31
Size:
523.7Kb
Format:
PDF

This item appears in the following Collection(s)

Show simple item record

https://creativecommons.org/licenses/by-nc/4.0/
Except where otherwise noted, this item's license is described as https://creativecommons.org/licenses/by-nc/4.0/