Proceedings of the AAAI Conference on Artificial Intelligence · 2023 · 34 citations · 36 references
ComputingComputer ScienceComputer VisionMachine VisionVisual Perception3D ReconstructionDepth EstimationOptical FlowScene ReconstructionScene UnderstandingStereo VisionCoarse-to-fine EstimationCross-view Depth EstimationGradient DescentImage UpsamplingMulti-view Depth EstimationMultiview Stereo ReconstructionPhotometric ConsistencySmoothing
Over the years, learning-based multi-view stereo methods have achieved great success based on their coarse-to-fine depth estimation frameworks. However, 3D CNN-based cost volume regularization inevitably leads to over-smoothing problems at object boundaries due to its smooth properties. Moreover, discrete and sparse depth hypothesis sampling exacerbates the difficulty in recovering the depth of thin structures and object boundaries. To this end, we present an Efficient edge-Preserving multi-view stereo Network (EPNet) for practical depth estimation. To keep delicate estimation at details, a Hierarchical Edge-Preserving Residual learning (HEPR) module is proposed to progressively rectify the upsampling errors and help refine multi-scale depth estimation. After that, a Cross-view Photometric Consistency (CPC) is proposed to enhance the gradient flow for detailed structures, which further boosts the estimation accuracy. Last, we design a lightweight cascade framework and inject the above two strategies into it to achieve better efficiency and performance trade-offs. Extensive experiments show that our method achieves state-of-the-art performance with fast inference speed and low memory usage. Notably, our method tops the first place on challenging Tanks and Temples advanced dataset and ETH3D high-res benchmark among all published learning-based methods. Code will be available at https://github.com/susuwj/EPNet.
36
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Focal Loss for Dense Object Detection
Tsung-Yi Lin, Priya Goyal, Ross Girshick et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2018 · 9.6K citations
A Multi-view Stereo Benchmark with High-Resolution Images and Multi-camera Videos
Thomas Schöps, Johannes L. Schönberger, Silvano Galliani et al. · 2017 · 849 citations
Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matching
Xiaodong Gu, Zhiwen Fan, Siyu Zhu et al. · 2020 · 840 citations
Large-Scale Data for Multiple-View Stereopsis
Henrik Aanæs, Rasmus Ramsbøl Jensen, George Vogiatzis et al. · International Journal of Computer Vision · 2016 · 663 citations · Full text