Integrating end-to-end learned steering into probabilistic autonomous driving

Abstract

We propose an integrated approach of combining end-to-end learned trajectory proposals with a probabilistic sampling based planning algorithm for autonomous driving. A convolutional neural network is trained based on monocular image data to predict prospective steering angles. By using a local history of image data, we achieve an implicit spatial representation of parked cars or other obstacles commonly found in urban and residential areas. Through this local history, calculated using the vehicle's velocity data, the trajectory proposals are not only capable of lane following, but also comfortably circumnavigate obstacles. Training data is collected by recording video data and the vehicles CAN bus during human driving, thus imitating human behavior. The integration of end-to-end learning into a modularized architecture allows for additional safety constraints and complementary sensor information to be combined with intuitive steering. Our first results take a promising step towards general architectures for autonomous vehicles that combine deep learning with factorized probabilistic modeling.