Translational Vision Science & Technology · 2020 · 14 citations · 24 references
Health ProfessionsComputer ScienceOphthalmologyBiomedical ImagingComputer VisionOcular ImagingFundus PhotographyImage AnalysisImage RegistrationMedical Image AnalysisRetinal ImagingScanning Laser OphthalmoscopyColor Fundus ImagingColor Fundus PhotographyImage AlignmentImage WarpingRegistrationRetinal Image MatchingRetinal Vessel SegmentationStyle Transfer
Purpose: The purpose of this study was to evaluate the ability to align two types of retinal images taken on different platforms; color fundus (CF) photographs and infrared scanning laser ophthalmoscope (IR SLO) images using mathematical warping and artificial intelligence (AI). Methods: We collected 109 matched pairs of CF and IR SLO images. An AI algorithm utilizing two separate networks was developed. A style transfer network (STN) was used to segment vessel structures. A registration network was used to align the segmented images to each. Neither network used a ground truth dataset. A conventional image warping algorithm was used as a control. Software displayed image pairs as a 5 × 5 checkerboard grid composed of alternating subimages. This technique permitted vessel alignment determination by human observers and 5 masked graders evaluated alignment by the AI and conventional warping in 25 fields for each image. Results: < 0.0001). The average number of good/excellent matches increased from 90.5% to 94.4% with AI method. Conclusions: AI permitted a more accurate overlay of CF and IR SLO images than conventional mathematical warping. This is a first step toward developing an AI that could allow overlay of all types of fundus images by utilizing vascular landmarks. Translational Relevance: The ability to align and overlay imaging data from multiple instruments and manufacturers will permit better analysis of this complex data helping understand disease and predict treatment.
24
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
1993 · 14.3K citations
Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning
Daniel Kermany, Michael H. Goldbaum, Wenjia Cai et al. · Cell · 2018 · 4.7K citations · Full text
Ridge-Based Vessel Segmentation in Color Images of the Retina
Joes Staal, Michael D. Abràmoff, Meindert Niemeijer et al. · IEEE Transactions on Medical Imaging · 2004 · 4.1K citations
A Neural Algorithm of Artistic Style
Leon A. Gatys, Alexander S. Ecker, Matthias Bethge · Journal of Vision · 2016 · 939 citations · Full text