IEEE Robotics and Automation Letters · 2019 · 52 citations · 17 references
ComputingAutonomous SystemsComputer ScienceAutonomous VehiclesComputer VisionRoboticsDeep LearningRobotic VisionTrajectory PredictionVehicle ControlVehicle Control SystemsVehicle PerceptionConvolutional Neural NetworksFrictionParticle Filter FusionParticle FiltersPredictive ControlVehicle DetectionVehicle State EstimationWheel Speed Sensors
In this letter, we present a framework for combining deep learning-based road detection, particle filters, and model predictive control (MPC) to drive aggressively using only a monocular camera, IMU, and wheel speed sensors. This framework uses deep convolutional neural networks combined with LSTMs to learn a local cost map representation of the track in front of the vehicle. A particle filter uses this dynamic observation model to localize in a schematic map, and MPC is used to drive aggressively using this particle filter based state estimate. We show extensive real world testing results and demonstrate reliable operation of the vehicle at the friction limits on a complex dirt track. We reach speeds above 27 m/h (12 m/s) on a dirt track with a 105 ft (32 m) long straight using our 1:5 scale test vehicle.
17
Fully convolutional networks for semantic segmentation
Jonathan Long, Evan Shelhamer, Trevor Darrell · 2015 · 36.9K citations
End to End Learning for Self-Driving Cars
Mariusz Bojarski, Davide Testa, Daniel Dworakowski et al. · arXiv (Cornell University) · 2016 · 3.1K citations · Full text
DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving
Chenyi Chen, Ari Seff, Alain L. Kornhauser et al. · 2015 · 1.8K citations