Trustworthy Super-Resolution of Multispectral Sentinel-2 Imagery With Latent Diffusion

Abstract

Remote sensing super-resolution aims to enhance the spatial details of satellite images by introducing meaningful high-frequency features while avoiding hallucinations and spectral distortions. High-resolution imagery is usually not publicly available, whereas low-resolution imagery is freely available with a much higher revisit rate, such as the Sentinel-2 multispectral imaging mission. Cross-sensor super-resolution has the potential to bridge this gap, providing high spatial and temporal resolution imagery which are otherwise unavailable for many remote sensing users and applications. With the recent advancements in diffusion models, many methodologies have emerged which take advantage of their generative power to perform super-resolution. We propose an adapted latent diffusion approach, since image diffusion is computationally prohibitive to be applied to large Earth observation datasets. Contrary to standard latent diffusion, we encode the low-resolution image to condition the diffusion process, forcing better spectral consistency with the input imagery. The model includes visible and near-infrared bands. To ensure trustworthy results, we utilize the probabilistic nature of diffusion models to generate pixel-level uncertainty maps. This confidence metric is crucial for real-world applications, such as environmental monitoring, land cover classification, and change detection, where accurate surface feature reconstruction and spectral consistency are essential. The uncertainty map allows users to evaluate the reliability of the product for these tasks. The proposed model super-resolves Sentinel-2 imagery at 10 to 2.5 m and is the first multispectral remote sensing (RS) super-resolution diffusion model efficient enough to process large-scale RS datasets, as well as the only model providing a pixelwise uncertainty metric.