2021 · 19 citations · 40 references
Image ReconstructionEngineeringMachine LearningBayesian Neural NetworksAutoencodersTotal VariationUncertainty FormalismUncertainty ModelingBayesian InferenceData ScienceUncertainty QuantificationDeep UncertaintySparse Neural NetworkRobust OptimizationRadiologyHealth SciencesReconstruction TechniqueMedical ImagingModel UncertaintyInverse ProblemsComputer ScienceMedical Image ComputingDeep LearningBiomedical ImagingDeep Gradient DescentStatistical InferenceMedical Image Analysis
Recent advances in reconstruction methods for inverse problems leverage powerful data-driven models, e.g., deep neural networks. These techniques have demonstrated state-of-the-art performances for several imaging tasks, but they often do not provide uncertainty on the obtained reconstruction. In this work, we develop a scalable, data-driven, knowledge-aided computational framework to quantify the model uncertainty via Bayesian neural networks. The approach builds on, and extends deep gradient descent, a recently developed greedy iterative training scheme, and recasts it within a probabilistic framework. Scalability is achieved by being hybrid in the architecture: only the last layer of each block is Bayesian, while the others remain deterministic, and by being greedy in training. The framework is showcased on one representative medical imaging modality, viz. computed tomography with either sparse view or limited view data, and exhibits competitive performance with respect to state-of-the-art benchmarks, e.g., total variation, deep gradient descent and learned primal-dual.
40
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.2K citations
On Information and Sufficiency
S. Kullback, R. A. Leibler · The Annals of Mathematical Statistics · 1951 · 19.5K citations · Full text