Echo from Noise: Synthetic Ultrasound Image Generation Using Diffusion Models for Real Image Segmentation

Abstract

Abstract We propose a novel pipeline for the generation of synthetic ultrasound images via Denoising Diffusion Probabilistic Models (DDPMs) guided by cardiac semantic label maps. We show that these synthetic images can serve as a viable substitute for real data in the training of deep-learning models for ultrasound image analysis tasks such as cardiac segmentation. To demonstrate the effectiveness of this approach, we generated synthetic 2D echocardiograms and trained a neural network for segmenting the left ventricle and left atrium. The performance of the network trained on exclusively synthetic images was evaluated on an unseen dataset of real images and yielded mean Dice scores of $$88.6 \pm 4.91$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mn>88.6</mml:mn> <mml:mo>±</mml:mo> <mml:mn>4.91</mml:mn> </mml:mrow> </mml:math> , $$91.9 \pm 4.22$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mn>91.9</mml:mn> <mml:mo>±</mml:mo> <mml:mn>4.22</mml:mn> </mml:mrow> </mml:math> , $$85.2 \pm 4.83$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mn>85.2</mml:mn> <mml:mo>±</mml:mo> <mml:mn>4.83</mml:mn> </mml:mrow> </mml:math> % for left ventricular endocardium, epicardium and left atrial segmentation respectively. This represents a relative increase of 9.2, 3.3 and 13.9% in Dice scores compared to the previous state-of-the-art. The proposed pipeline has potential for application to a wide range of other tasks across various medical imaging modalities.