Spoiled for Choice? Personalized Recommendation for Healthcare Decisions: A Multiarmed Bandit Approach

Abstract

Choice overload is a common problem in many online settings, including healthcare. Online healthcare platforms tend to provide a large variety of behavior intervention information or programs to help individuals modify their lifestyles to improve wellness. However, having too many options can significantly increase searching cost, prevent users from discovering the truly relevant interventions, and harm users’ long-term healthcare decision-making efficiency. This motivates us to propose a personalized healthcare recommendation system to provide tailored support for individuals’ intervention participation. The proposed framework, a deep-learning and diversity-enhanced multiarmed bandit (DLDE-MAB), integrates several predictive and prescriptive analytics components to combat the unique challenges presented in the healthcare recommendation setting. It leverages online machine learning to provide adaptive and real-time support, a theory-guided diversity promotion scheme to cover multiple healthcare needs, and deep learning to further enhance dynamic context representation. Through extensive experiments, we show that the proposed framework outperforms various competing models in terms of its adaptivity to data dynamics, diversity, and uncertainty. The proposed model and evaluation results provide important implications for business intelligence and personalized, contextualized, and agile healthcare decision making.