Risk Aversion, Road Choice, and the One-Armed Bandit Problem

Abstract

This paper provides a theoretical analysis of advanced traveler information systems for road choice with risk-averse drivers who rationally learn over time, in a simple setting. For this purpose, we study the one-armed bandit problem where a driver selects, day after day, either a safe or a random road. Four information regimes are envisaged. The visionary driver knows beforehand, with certainty, the travel time on the random road, while the locally informed driver needs to select a road to acquire information on it. Two intermediary information regimes (fully and globally) are also envisaged. We analyze these four regimes and compare the optimal strategies and the individual benefits with respect to individual risk aversion. A numerical example also illustrates the impact of risk aversion on dynamic optimal strategies.