Is research funding always beneficial? A cross-disciplinary analysis of UK research 2014-20
Abstract
Whilst funding is essential for some types of research and beneficial for others, it may constrain academic choice and creativity. Thus, it is important to check whether it ever seems unnecessary. Here we investigate whether funded UK research tends to be higher quality in all fields and for all major research funders. Based on peer review quality scores for 113,877 articles from all fields in the UK’s Research Excellence Framework (REF) 2021, we estimate that there are substantial disciplinary differences in the proportion of funded journal articles, from Theology and Religious Studies (16%+) to Biological Sciences (91%+). The results suggest that funded research is likely to be higher quality overall, for all the largest research funders, and for 30 out of 34 REF Units of Assessment (disciplines or sets of disciplines), even after factoring out research team size. There are differences between funders in the average quality of the research supported, however. Funding seems particularly associated with higher research quality in health-related fields. The results do not show cause and effect and do not take into account the amount of funding received but are consistent with funding either improving research quality or being won by high quality researchers or projects.Citation
Thelwall, M., Kousha, K., Abdoli, M., Stuart, E., Makita, M., Font-Julián, C.I., Wilson, P. and Levitt, J. (2023) Is research funding always beneficial? A cross-disciplinary analysis of UK research 2014-20. Quantitative Science Studies, 1-41, https://doi.org/10.1162/qss_a_00254Publisher
MIT PressJournal
Quantitative Science StudiesAdditional Links
https://direct.mit.edu/qssType
Journal articleLanguage
enDescription
This is an accepted manuscript of an article published by MIT Press on 01/04/2023, available online: https://doi.org/10.1162/qss_a_00254 The accepted version of the publication may differ from the final published version.ISSN
2641-3337Sponsors
This study was funded by Research England, Scottish Funding Council, Higher Education Funding Council for Wales, and Department for the Economy, Northern Ireland as part of the Future Research Assessment Programme (https://www.jisc.ac.uk/future-research-assessment-programme).Scopus Count
Collections
Except where otherwise noted, this item's license is described as https://creativecommons.org/licenses/by/4.0/
Related items
Showing items related by title, author, creator and subject.
-
Is big team research fair in national research assessments? The case of the UK Research Excellence Framework 2021Collaborative research causes problems for research assessments because of the difficulty in fairly crediting its authors. Whilst splitting the rewards for an article amongst its authors has the greatest surface-level fairness, many important evaluations assign full credit to each author, irrespective of team size. The underlying rationales for this are labour reduction and the need to incentivise collaborative work because it is necessary to solve many important societal problems. This article assesses whether full counting changes results compared to fractional counting in the case of the UK’s Research Excellence Framework (REF) 2021. For this assessment, fractional counting reduces the number of journal articles to as little as 10% of the full counting value, depending on the Unit of Assessment (UoA). Despite this large difference, allocating an overall grade point average (GPA) based on full counting or fractional counting give results with a median Pearson correlation within UoAs of 0.98. The largest changes are for Archaeology (r=0.84) and Physics (r=0.88). There is a weak tendency for higher scoring institutions to lose from fractional counting, with the loss being statistically significant in 5 of the 34 UoAs. Thus, whilst the apparent over-weighting of contributions to collaboratively authored outputs does not seem too problematic from a fairness perspective overall, it may be worth examining in the few UoAs in which it makes the most difference.
-
What is the optimal number of researchers for social science research?Many studies have found that co-authored research is more highly cited than single author research. This finding is policy relevant as it indicates that encouraging co-authored research will tend to maximise citation impact. Nevertheless, whilst the citation impact of research increase as the number of authors increases in the sciences, the extent to which this occurs in the social sciences is unknown. In response, this study investigates the average citation level of articles with one to four authors published in 1995, 1998, 2001, 2004 and 2007 in 19 social science disciplines. The results suggest that whilst having at least two authors gives a substantial citation impact advantage in all social science disciplines, additional authors are beneficial in some disciplines but not in others.
