Journal of the Association for Information Science and Technology · 2018 · 39 citations · 16 references
ManagementHigher EducationImpact MeasurementOutcomes ResearchPsychometricsBibliometric AnalysisCitation PracticesPeer ReviewQuality MetricsResearch Impact AssessmentSocial Impact AssessmentAcademic Impact AssessmentAttentionResearch Impact MetricsResearch Performance IndicatorsResearch Performance MeasurementResearch Performance MetricsScientific Impact MeasurementUniversity Impact Assessment
In this article we test whether metrics of online attention describing research can provide information on research quality and societal impact that is not found in citation data alone. Our approach is to set up a traditional model in which the true quality or impact of a university department is determined by a panel of experts, but a citation metric is regarded as a reasonable proxy. However, the model assumes that the information contained in the scores provided by an expert panel exceeds that contained in a citation metric (HEFCE, 2015). Finally, we extend this model by including altmetric data to see if it adds information about a department's performance that cannot be gleaned from citations alone. We find the presence of altmetric data for the cited underpinning research to be highly correlated with peer review scores for societal impact. Conversely, no such connection was seen with the assessment of research quality. Our findings therefore suggest altmetric data could be useful as an aid to assessing impact.
16
Estimation of Relationships for Limited Dependent Variables
James Tobin · Econometrica · 1958 · 7K citations
Do Altmetrics Work? Twitter and Ten Other Social Web Services
Mike Thelwall, Stefanie Haustein, Vincent Larivière et al. · PLoS ONE · 2013 · 913 citations · Full text
James Wilsdon, Liz Allen, Eleonora Belfiore et al. · Kent Academic Repository (University of Kent) · 2015 · 736 citations · Full text
Rodrigo Costas, Zohreh Zahedi, Paul Wouters · Journal of the Association for Information Science and Technology · 2014 · 727 citations · Full text