Journal of Management · 2023 · 161 citations · 95 references
ComputingComputer ScienceDecision SciencesArtificial IntelligenceDecision MakingMachine LearningCollective Decision-makingCollective IntelligenceCooperative Decision-makingEnsemble LearningEnsemble MethodsAccuracyEnsemble Learning TheoryEnsemble-based PredictionHuman-ai Decision MakingHuman-ai Decision SupportHuman-ai InteractionMachine IntelligencePredictive Performance
An ensemble approach aggregates decisions from multiple agents, yet many managerial decisions lack clear specialization, making collaboration uncommon. The study proposes conditions under which human‑AI ensembles can be useful, even when neither side has a clear predictive advantage. The authors draw on machine‑learning and human‑decision‑making literature to formulate conditions for effective human‑AI ensembles. They find that human‑AI ensembles can be effective even when individual accuracy is low or comparable, provided the identified conditions are met.
An “ensemble” approach to decision-making involves aggregating the results from different decision makers solving the same problem (i.e., a division of labor without specialization). We draw on the literatures on machine learning-based Artificial Intelligence (AI) as well as on human decision-making to propose conditions under which human-AI ensembles can be useful. We argue that human and AI-based algorithmic decision-making can be usefully ensembled even when neither has a clear advantage over the other in terms of predictive accuracy, and even if neither alone can attain satisfactory accuracy in absolute terms. Many managerial decisions have these attributes, and collaboration between humans and AI is usually ruled out in such contexts because the conditions for specialization are not met. However, we propose that human-AI collaboration through ensembling is still a possibility under the conditions we identify.
95
Journal of the American Dietetic Association · 1994 · 46.5K citations
Self-efficacy: Toward a unifying theory of behavioral change.
Psychological Review · 1977 · 42.6K citations · Full text
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Pattern Recognition and Machine Learning
Journal of Electronic Imaging · 2007 · 22.1K citations
Exploration and Exploitation in Organizational Learning
James G. March · Organization Science · 1991 · 21.4K citations