Rooftop PV Segmenter: A Size-Aware Network for Segmenting Rooftop Photovoltaic Systems from High-Resolution Imagery

Abstract

The photovoltaic (PV) industry boom has accelerated the need for accurately understanding the spatial distribution of PV energy systems. The synergy of remote sensing and artificial intelligence presents significant prospects for PV energy monitoring. Currently, numerous studies have focused on extracting rooftop PV systems from airborne or satellite imagery, but their small-scale and size-varying characteristics make the segmentation results suffer from PV internal incompleteness and small PV omission. To address these issues, this study proposed a size-aware deep learning network called Rooftop PV Segmenter (RPS) for segmenting small-scale rooftop PV systems from high-resolution imagery. In detail, the RPS network introduced a Semantic Refinement Module (SRM) to sense size variations of PV panels and reconstruct high-resolution deep semantic features. Moreover, a Feature Aggregation Module (FAM) enhanced the representation of robust features by continuously aggregating deeper features into shallower ones. In the output stage, a Deep Supervised Fusion Module (DSFM) was employed to constrain and fuse the outputs at different scales to achieve more refined segmentation. The proposed RPS network was tested and shown to outperform other models in producing segmentation results closer to the ground truth, with the F1 score and IoU reaching 0.9186 and 0.8495 on the publicly available California Distributed Solar PV Array Dataset (C-DSPV Dataset), and 0.9608 and 0.9246 on the self-annotated Heilbronn Rooftop PV System Dataset (H-RPVS Dataset). This study has provided an effective solution for obtaining a refined small-scale energy distribution database.