Organization Science · 2024 · 222 citations · 67 references
ManagementComputer ScienceStrategyArtificial IntelligenceCreativityInnovationCollaborative CreativityCollective IntelligenceEvaluation Of IdeasHeuristic SearchIdea GenerationSolution EvaluationCrowdsourcingCrowdsourcing InnovationHuman-ai Decision MakingHuman-ai Decision SupportHuman-ai InteractionInnovation CrowdsourcingLarge Language ModelsNovelty
The rapid advances in generative artificial intelligence (AI) open up attractive opportunities for creative problem-solving through human-guided AI partnerships. To explore this potential, we initiated a crowdsourcing challenge focused on sustainable, circular economy business ideas generated by the human crowd (HC) and collaborative human-AI efforts using two alternative forms of solution search. The challenge attracted 125 global solvers from various industries, and we used strategic prompt engineering to generate the human-AI solutions. We recruited 300 external human evaluators to judge a randomized selection of 13 out of 234 solutions, totaling 3,900 evaluator-solution pairs. Our results indicate that while human crowd solutions exhibited higher novelty—both on average and for highly novel outcomes—human-AI solutions demonstrated superior strategic viability, financial and environmental value, and overall quality. Notably, human-AI solutions cocreated through differentiated search, where human-guided prompts instructed the large language model to sequentially generate outputs distinct from previous iterations, outperformed solutions generated through independent search. By incorporating “AI in the loop” into human-centered creative problem-solving, our study demonstrates a scalable, cost-effective approach to augment the early innovation phases and lays the groundwork for investigating how integrating human-AI solution search processes can drive more impactful innovations. Funding: This work was supported by Harvard Business School (Division of Research and Faculty Development) and the Laboratory for Innovation Science at Harvard (LISH) at the Digital Data and Design (D 3 ) Institute at Harvard. Supplemental Material: The online appendix is available at https://doi.org/10.1287/orsc.2023.18430 .
67
Exploration and Exploitation in Organizational Learning
James G. March · Organization Science · 1991 · 21.4K citations
Mastering the game of Go with deep neural networks and tree search
David Silver, Aja Huang, Chris J. Maddison et al. · Nature · 2016 · 15.8K citations
Economy and Society: An Outline of Interpretive Sociology
Gianfranco Poggi · Sociology · 1969 · 6.9K citations