ARNet: Prior Knowledge Reasoning Network for Aircraft Detection in Remote-Sensing Images

Abstract

Amidst the landscape of contemporary remote sensing technology, the endeavor to detect and recognize aircraft within remote sensing images (RSIs) assumes pivotal strategic and practical significance. The complex nature of fine-grained aircraft recognition is a result of the intricate interplay between aircraft and their background environments, alongside category imbalance, which collectively lead to the emergence of a long-tail distribution within the dataset. However, experts proficient in RSIs interpretation can effectively address these challenges through the application of prior knowledge. This paper introduces the Aircraft Reasoning Network (ARNet), a framework tailored for aircraft detection and fine-grained recognition in RSIs, building upon prior knowledge employed in expert interpretation. Specifically, the Knowledge Reasoning Module (KRM) introduces a knowledge graph that incorporates both common and expert knowledge into the end-to-end network. Additionally, the network encompasses a Spatial Context Module (SCM) and an Airport Facility Relationship Module (AFRM). These components facilitate highly accurate detection and recognition of fine-grained aircraft in diverse environmental contexts by employing adaptive prior knowledge reasoning and optimizing target spatial location. Furthermore, an independent Aircraft Component Discrimination Module (ACDM) distinguishes aircraft based on their predominant component features, contributing to improved classification performance in both the few-shot and easily confused categories. Moreover, this paper introduces the AR-RSI dataset, a compilation of RSIs capturing fine-grained aircraft targets from diverse locations. The effectiveness and superiority of ARNet are exemplified on AR-RSI, achieving a minimum of 3.7 percentage higher mAP than the mainstream aircraft detection framework.