A state-of-the-art survey of deep learning models for automated pavement crack segmentation

Abstract

Survey of road cracks in a timely, complete, and accurate way is pivotal to pavement maintenance planning. Motivated by the increasingly heavy task of identifying cracks, researchers have developed extensive crack segmentation models based on Deep learning (DL) methods with significantly different levels of accuracy, efficiency, and generalizing capacity. Although many of the models provide satisfying detection performance, why these models work still needs to be determined. The objective of this study is to survey recent advances in automated DL crack recognition and provide evidence for their underlying working mechanism. We first reviewed 54 DL crack recognition methods to summarize critical factors in these models. Then, we conducted a performance evaluation of fourteen famous semantic segmentation models using the quantitative metrics: F-1 score and mIoU. Then, the effective receptive field and class activation map of the included models are visualized to demonstrate the training results as qualitative evaluation. Based on the literature review and comparison results, larger kernel size, feature fusion, and attention module all contribute to the improvement of model performance. Striking a balance between increasing the effective receptive field and computational/memory efficiency is the key to designing DL crack segmentation models. Finally, some potential directions and suggestions for future development are provided, such as developing semi-supervised or unsupervised learning for the high cost of pixel-level labeling.