DeepInfer: open-source deep learning deployment toolkit for image-guided therapy

Alireza Mehrtash, Mehran Pesteie, Jorden Hetherington, Peter A. Behringer, Tina Kapur, William M. Wells, Robert Rohling, Andriy Fedorov, Purang Abolmaesumi

Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2017 · 41 citations · 20 references

Concepts

TL;DR

Deep learning has surpassed traditional methods in medical image analysis, yet its deployment remains challenging due to the steep learning curve and fragmented software ecosystem. This work introduces DeepInfer, an open‑source toolkit that integrates deep learning models into the 3D Slicer platform to streamline development and deployment. DeepInfer leverages a repository of task‑specific models, enabling users to select a pretrained model from a public registry and apply it to new data without writing code or configuring software. We validated the toolkit by successfully performing prostate segmentation for MRI‑guided biopsy and identifying the target plane in 3D ultrasound for spinal injections.

Abstract

Deep learning models have outperformed some of the previous state-of-the-art approaches in medical image analysis. Instead of using hand-engineered features, deep models attempt to automatically extract hierarchical representations at multiple levels of abstraction from the data. Therefore, deep models are usually considered to be more flexible and robust solutions for image analysis problems compared to conventional computer vision models. They have demonstrated significant improvements in computer-aided diagnosis and automatic medical image analysis applied to such tasks as image segmentation, classification and registration. However, deploying deep learning models often has a steep learning curve and requires detailed knowledge of various software packages. Thus, many deep models have not been integrated into the clinical research workflows causing a gap between the state-of-the-art machine learning in medical applications and evaluation in clinical research procedures. In this paper, we propose "DeepInfer" - an open-source toolkit for developing and deploying deep learning models within the 3D Slicer medical image analysis platform. Utilizing a repository of task-specific models, DeepInfer allows clinical researchers and biomedical engineers to deploy a trained model selected from the public registry, and apply it to new data without the need for software development or configuration. As two practical use cases, we demonstrate the application of DeepInfer in prostate segmentation for targeted MRI-guided biopsy and identification of the target plane in 3D ultrasound for spinal injections.

References

20