2017 · 154 citations · 11 references
ComputingAutonomous SystemsComputer ScienceArtificial IntelligenceAutonomous VehiclesMarkov Decision ProcessesCollision AvoidanceObstacle DetectionPolicy LearningReinforcement LearningReward DesignVehicle ControlAction Space FormulationBrake ControlBrake Control AlgorithmsDeep Reinforcement LearningMarkov Decision ModelsQ-learningReinforcement Learning TheoryReward Function Design
In this paper, we propose a new autonomous braking system based on deep reinforcement learning. The proposed autonomous braking system automatically decides whether to apply the brake at each time step when confronting the risk of collision using the information on the obstacle obtained by the sensors. The problem of designing brake control is formulated as searching for the optimal policy in Markov decision process (MDP) model where the state is given by the relative position of the obstacle and the vehicle's speed, and the action space is defined as the set of the brake actions including 1) no braking, 2) weak, 3) mid, 4) strong brakiong actions. The policy used for brake control is learned through computer simulations using the deep reinforcement learning method called deep Q-network (DQN). In order to derive desirable braking policy, we propose the reward function which balances the damage imposed to the obstacle in case of accident and the reward achieved when the vehicle runs out of risk as soon as possible. DQN is trained for the scenario where a vehicle is encountered with a pedestrian crossing the urban road. Experiments show that the control agent exhibits desirable control behavior and avoids collision without any mistake in various uncertain environments.
11
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
End to End Learning for Self-Driving Cars
Mariusz Bojarski, Davide Testa, Daniel Dworakowski et al. · arXiv (Cornell University) · 2016 · 3.1K citations · Full text