IEEE Transactions on Medical Imaging · 2021 · 81 citations · 27 references
Veterinary MedicineBiomedical EngineeringComputer ScienceDiagnostic ImagingUltrasonographyUltrasoundCardiac ImagingCardiac UltrasonographyCardiovascular ImagingDeep LearningGenerative ModelingMedical ImagingAutomatic Label GenerationConvolutional Neural Network SegmentationConvolutional Neural NetworksGenerative Adversarial NetworksIntracardiac EchocardiographyMedical Anatomical ModelsSynthetic Label GenerationUltrasound Image Segmentation
Deep learning can bring time savings and increased reproducibility to medical image analysis. However, acquiring training data is challenging due to the time-intensive nature of labeling and high inter-observer variability in annotations. Rather than labeling images, in this work we propose an alternative pipeline where images are generated from existing high-quality annotations using generative adversarial networks (GANs). Annotations are derived automatically from previously built anatomical models and are transformed into realistic synthetic ultrasound images with paired labels using a CycleGAN. We demonstrate the pipeline by generating synthetic 2D echocardiography images to compare with existing deep learning ultrasound segmentation datasets. A convolutional neural network is trained to segment the left ventricle and left atrium using only synthetic images. Networks trained with synthetic images were extensively tested on four different unseen datasets of real images with median Dice scores of 91, 90, 88, and 87 for left ventricle segmentation. These results match or are better than inter-observer results measured on real ultrasound datasets and are comparable to a network trained on a separate set of real images. Results demonstrate the images produced can effectively be used in place of real data for training. The proposed pipeline opens the door for automatic generation of training data for many tasks in medical imaging as the same process can be applied to other segmentation or landmark detection tasks in any modality. The source code and anatomical models are available to other researchers. <xref ref-type="fn" rid="fn1" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><sup>1</sup></xref> <fn id="fn1" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><label><sup>1</sup></label> <uri>https://adgilbert.github.io/data-generation/</uri> </fn>
27
Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks
Jun-Yan Zhu, Taesung Park, Phillip Isola et al. · 2017 · 21.9K citations · Full text
Individual Comparisons by Ranking Methods
Frank Wilcoxon · Biometrics Bulletin · 1945 · 14.4K citations
Business, Computer Science, Multi-criteria Decision Making +8
Carol Mitchell, Peter S. Rahko, Lori A. Blauwet et al. · Journal of the American Society of Echocardiography · 2018 · 2.5K citations
Medicine, Cardiology, Radiology +12
Antonio Torralba, Alexei A. Efros · 2011 · 2.4K citations