Leveraging Thermal Imaging for Autonomous Driving

Abstract

In 2018, vehicles operating in an autonomous mode have been involved in at least five major accidents. Of these, one involved a pedestrian death due to a lack of timely information available to the detection system. Thermal imaging (TI) could have potentially helped with the time of detection of the pedestrian. This paper will argue how TI can provide supplementary information to existing autonomous detection systems to improve their overall performance. It will outline detection considerations for classifying objects in a thermal image which can later be used in sensor fusion applications. A new labelled dataset of thermal images will also be introduced under snowy, overcast, misty, and nighttime driving conditions. A labeled dataset of a golden retriever and a Doberman will be also be introduced. These datasets are publicly available for download.