Efficient Adjacent Feature Harmonizer Network With UAV-CD+ Dataset for Remote Sensing Change Detection

Abstract

Remote sensing change detection (RSCD) aims to identify changes within bi-temporal registered images. However, existing deep learning (DL)-based RSCD networks often suffer from large numbers of parameters, high computational complexity, and low inference speed, making it challenging to achieve efficient inference in real-world deployments. In addition, current models lack robust feature-fitting capabilities, necessitating the development of an efficient and powerful RSCD model to address this issue. Therefore, we propose a novel RSCD network named efficient adjacent feature harmonizer network (EAFH-Net) with fast computational speed and lightweight design. It is based on MobileNetV2, considering that change maps of different sizes contain temporal information of bitemporal features and spatial information at various scales, we introduce a multiscale feature neighbor fusion module (MFNFM) to address the lack of interaction between sophisticated-level and elementary-level features, and spatial and channel feature harmonizer module (SCFHM) to harmonize the spatiotemporal information of the change maps. Moreover, data-driven DL algorithms face another challenge due to insufficient granularity and the need for more practical datasets. Therefore, we present unmanned aerial vehicle (UAV)-CD+, a dataset comprising 2002 pairs of bi-temporal UAV low-altitude images, each sized at <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$1024\times 1024$ </tex-math></inline-formula>. We performed experiments on three publicly accessible datasets in conjunction with UAV-CD+, comparing the results with other state-of-the-art (SOTA) methods. EAFH-Net attains the utmost precision, obtaining 91.74% on LEVIR-CD, 84.28% on SYSU-CD, 95.07% on WHU-CD, 79.12% on CLCD, and 70.12% on UAV-CD+. We have our model code available at the following link: <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/yikuizhai/UCSFH-Net</uri>.