Proceedings of the AAAI Conference on Artificial Intelligence · 2015 · 53 citations · 18 references
ComputingAutonomous SystemsAutonomous VehiclesGame TheoryOptimizationOptimal ControlPolicy IterationReinforcement LearningReinforcement Learning FoundationsValue IterationAutonomous Vehicle Path PlanningConvergenceLexicographic PreferencesMulti-objective Exploration-exploitation Trade-offsPlanning In GamesSemi-autonomous SystemsVehicle Path Planning
Sequential decision problems that involve multiple objectives are prevalent. Consider for example a driver of a semi-autonomous car who may want to optimize competing objectives such as travel time and the effort associated with manual driving. We introduce a rich model called Lexicographic MDP (LMDP) and a corresponding planning algorithm called LVI that generalize previous work by allowing for conditional lexicographic preferences with slack. We analyze the convergence characteristics of LVI and establish its game theoretic properties. The performance of LVI in practice is tested within a realistic benchmark problem in the domain of semi-autonomous driving. Finally, we demonstrate how GPU-based optimization can improve the scalability of LVI and other value iteration algorithms for MDPs.
18
Artificial intelligence: a modern approach
Choice Reviews Online · 1995 · 22.2K citations · Full text
Empirical evaluation methods for multiobjective reinforcement learning algorithms
Peter Vamplew, Richard Dazeley, Adam Berry et al. · Machine Learning · 2010 · 274 citations · Full text