IEEE Transactions on Medical Imaging · 2019 · 168 citations · 20 references
ComputingComputer ScienceRadiologyBiomedical ImagingComputer VisionDiagnostic ImagingComputed TomographyDepth EstimationGastrointestinal EndoscopyMedical ImagingSelf-supervised LearningStereo VisionConvolutional Neural NetworksDense Depth EstimationLabelingManual Image LabelingMonocular Depth EstimationMulti-view StereoSelf-supervised Depth EstimationSelf-supervised Pretraining
We present a self-supervised approach to training convolutional neural networks for dense depth estimation from monocular endoscopy data without a priori modeling of anatomy or shading. Our method only requires monocular endoscopic videos and a multi-view stereo method, e.g., structure from motion, to supervise learning in a sparse manner. Consequently, our method requires neither manual labeling nor patient computed tomography (CT) scan in the training and application phases. In a cross-patient experiment using CT scans as groundtruth, the proposed method achieved submillimeter mean residual error. In a comparison study to recent self-supervised depth estimation methods designed for natural video on in vivo sinus endoscopy data, we demonstrate that the proposed approach outperforms the previous methods by a large margin. The source code for this work is publicly available online at https://github.com/lppllppl920/EndoscopyDepthEstimation-Pytorch.
20
Automatic differentiation in PyTorch
Adam Paszke, Sam Gross, Soumith Chintala et al. · 2017 · 11.1K citations
Unsupervised Learning of Depth and Ego-Motion from Video
Tinghui Zhou, Matthew Brown, Noah Snavely et al. · 2017 · 2.8K citations