Domain Knowledge-Guided Self-Supervised Change Detection for Remote Sensing Images

Abstract

As one of the most popular topics in the field of Earth observation using remote sensing images, change detection (CD) provides great practical and valuable significance for many fields. Although the majority of supervised methods have made great progress by introducing deep learning in the CD field, they are still limited by manually labeled data. In comparison, unsupervised methods do not require manually labeled data, but the accuracy of CD is difficult to be improved due to the lack of constraints or guidance during training. To tackle these issues, we propose a novel domain knowledge-guided self-supervised learning approach for unsupervised CD by fusing the domain knowledge of remote sensing indices during training and inference. Furthermore, we calculate cosine similarity to select the high-similarity feature vectors outputted by the mean teacher and student networks to implement the hard negative sampling strategy, which effectively improves the CD performance. Compared with other supervised and unsupervised CD methods, our proposed approach achieves state-of-the-art performance with a <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Kap</i> of 53.34% and an <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">F1</i> of 55.69% on the Onera Satellite Change Detection dataset. Fusing domain knowledge to guide model training and inference obtains an improvement of 5.83% in <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Kap</i> and 5.13% in <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">F1</i> , which further narrows the performance gap between unsupervised and supervised CD.