Testing novel quantitative indicators of research 'quality', esteem and 'user engagement': an economics pilot study

Abstract

Applying 'standard' publication and citation measures to the social sciences is fast becoming an outmoded practice, yet we have still to develop credible quantitative alternatives to inform research evaluation exercises. This paper reports the outcomes of a comparative pilot study of five Australian economics departments which tested data produced using novel bibliometric, esteem, and 'user engagement' measures. The results were presented to a group of expert peers drawn from the economics groups studied. There was support for developing some novel bibliometric indicators and 'user engagement' measures, but esteem indicators were roundly rejected.