Development of a new outlier statistic for meta-analytic data.

Abstract

This article describes the development of a new technique for identifying outlier coefficients in meta-analytic data sets. Denoted as the sample-adjusted meta-analytic deviancy statistic or SAMD, this technique takes into account the sample size on which each study is based when determining outlier status. An empirical test of the SAMD statistic with an actual meta-analytic data set resulted in a substantial reduction in residual variabilities and a corresponding increase in the percentage of variance accounted for by statistical artifacts after removal of outlier study coefficients. Moreover, removal of these coefficients helped to clarify what was a confusing and difficult-to-explain finding in this meta-analysis. It is suggested that analysis for outliers become a routine part of meta-analysis methodology. Limitations and directions for future research are discussed