PLoS ONE · 2020 · 22 citations · 23 references
BusinessComputer ScienceDecision SciencesDecision TheoryForecastingMachine LearningEnsemble MethodsExpertise DiscoveryForecast EvaluationForecasting MethodsPredictive ModelingProbabilistic ForecastingCombining Probabilistic ForecastsDecision ProblemsForecast Performance EvaluationMachine Learning Forecasting Models
A common approach to improving probabilistic forecasts is to identify and leverage the forecasts from experts in the crowd based on forecasters' performance on prior questions with known outcomes. However, such information is often unavailable to decision-makers on many forecasting problems, and thus it can be difficult to identify and leverage expertise. In the current paper, we propose a novel algorithm for aggregating probabilistic forecasts using forecasters' meta-predictions about what other forecasters will predict. We test the performance of an extremised version of our algorithm against current forecasting approaches in the literature and show that our algorithm significantly outperforms all other approaches on a large collection of 500 binary decision problems varying in five levels of difficulty. The success of our algorithm demonstrates the potential of using meta-predictions to leverage latent expertise in environments where forecasters' expertise cannot otherwise be easily identified.
23
Better Bootstrap Confidence Intervals
Bradley Efron · Journal of the American Statistical Association · 1987 · 3.3K citations
Equivalent Comparisons of Experiments
David Blackwell · The Annals of Mathematical Statistics · 1953 · 1.5K citations · Full text
Experts in uncertainty: opinion and subjective probability in science
Choice Reviews Online · 1992 · 1.2K citations
Business, Psychology, Epistemology +11
Principles of forecasting : a handbook for researchers and practitioners
J. Scott Armstrong · 2001 · 1.1K citations · Full text