Pano3D: A Holistic Benchmark and a Solid Baseline for 360° Depth Estimation

Abstract

Pano3D is a new benchmark for depth estimation from spherical panoramas. It aims to assess performance across all depth estimation traits, the primary direct depth estimation performance targeting precision and accuracy, and also the secondary traits, boundary preservation and smoothness. Moreover, Pano3D moves beyond typical intra-dataset evaluation to inter-dataset performance assessment. By disentangling the capacity to generalize in unseen data into different test splits, Pano3D represents a holistic benchmark for 360 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">o</sup> depth estimation. We use it as a basis for an extended analysis seeking to offer insights into classical choices for depth estimation. This results into a solid baseline for panoramic depth that followup works can built upon to steer future progress.