2019 · 13 citations · 26 references
ComputingAutonomous SystemsComputer ScienceComputer VisionMachine LearningVisual AttentionAttention NetworksDeep LearningFeature-based AttentionRepresentation LearningScene UnderstandingVehicle PerceptionAccuracyAttentionConvolutionFully Convolutional NetworksMax PoolingMotion-based AttentionOptical Flow FeaturesReceptive Field Encoding
In this work, we aim to build a real-time prediction model that can predict the driver's Focus of Attention (FoA) based on the image and motion information (RGB and Optical Flow) of the driving environment. A Y-shape-structured Fully Convolutional Neural Network (Y-FCNN) is proposed to learn and predict the FoA. This network first applies convolution and max-pool layers on RGB and Optical Flow respectively to get the low-level feature maps, and then merges the two encoded low-level feature maps together. After that, the Dilated Convolution, which can get a larger receptive field while still keeping high-resolution information, is applied to make the final prediction. The model is trained and tested using the Dr(eye)ve dataset. Experiment results show that our model can predict the FoA with high accuracy at a speed of about 122 frames per second, which outperforms some previous works for FoA prediction.
26
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Going deeper with convolutions
Christian Szegedy, Wei Liu, Yangqing Jia et al. · 2015 · 46.8K citations