1.Detection of microaneurysms in fundus images based on improved YOLOv4 with SENet embedded.
Weiwei GAO ; Mingtao SHAN ; Nan SONG ; Bo FAN ; Yu FANG
Journal of Biomedical Engineering 2022;39(4):713-720
Microaneurysm is the initial symptom of diabetic retinopathy. Eliminating this lesion can effectively prevent diabetic retinopathy in the early stage. However, due to the complex retinal structure and the different brightness and contrast of fundus image because of different factors such as patients, environment and acquisition equipment, the existing detection algorithms are difficult to achieve the accurate detection and location of the lesion. Therefore, an improved detection algorithm of you only look once (YOLO) v4 with Squeeze-and-Excitation networks (SENet) embedded was proposed. Firstly, an improved and fast fuzzy c-means clustering algorithm was used to optimize the anchor parameters of the target samples to improve the matching degree between the anchors and the feature graphs; Then, the SENet attention module was embedded in the backbone network to enhance the key information of the image and suppress the background information of the image, so as to improve the confidence of microaneurysms; In addition, an spatial pyramid pooling was added to the network neck to enhance the acceptance domain of the output characteristics of the backbone network, so as to help separate important context information; Finally, the model was verified on the Kaggle diabetic retinopathy dataset and compared with other methods. The experimental results showed that compared with other YOLOv4 network models with various structures, the improved YOLOv4 network model could significantly improve the automatic detection results such as F-score which increased by 12.68%; Compared with other network models and methods, the automatic detection accuracy of the improved YOLOv4 network model with SENet embedded was obviously better, and accurate positioning could be realized. Therefore, the proposed YOLOv4 algorithm with SENet embedded has better performance, and can accurately and effectively detect and locate microaneurysms in fundus images.
Algorithms
;
Diabetic Retinopathy/diagnostic imaging*
;
Fundus Oculi
;
Humans
;
Microaneurysm/diagnostic imaging*
2.Diagnostic accuracies of a Smartphone-Based Fundus photography and tablet-based visual field testing
Patricia Anne S. S. Tecson ; Victor Jose L. Caparas ; Rainier Victor A. Covar
Philippine Journal of Ophthalmology 2022;47(2):82-86
Objective:
We determined the diagnostic accuracies of the mydriatic, monoscopic, iPhone 6s+ optic nerve
photographs with a 20D lens and the Melbourne Rapid Fields (MRF) visual fields iPad application.
Methods:
This was a prospective, cross-sectional, single-center study involving 47 non-glaucomatous and 49
glaucomatous eyes. Each eye underwent 2 visual field tests: MRF iPad application and the Humphrey Field
Analyzer (HRF). Mydriatic photographs of the fundus were taken with two devices: an iPhone 6s+ combined
with a 20 D lens and the Visucam 500 fundus camera. All printouts were evaluated by 2 independent, masked
glaucoma specialists. Diagnostic accuracies between the modalities were computed. Agreements between
different parameters of both devices were analyzed using Cohen’s kappa test.
Results:
Smartphone-based (iPhone 6s+) fundus photos had an overall sensitivity of 100%, specificity of
89.36%, positive predictive value (PPV) of 89.36% and negative predictive value (NPV) of 100%, with all kappa
values between graders of each parameter above 0.61. Tablet-based Melbourne Rapid Fields test had a
sensitivity of 81.82%, specificity of 86.54%, PPV of 83.72% and NPV of 84.91%, showing good agreement
with the HRF with a kappa value of 0.68 ± 0.07.
Conclusion
Smartphone-based fundus photography and tablet-based visual field tests are comparable to the
standard fundus photos and visual field tests in evaluating the optic nerve and visual field. These portable
devices are reliable and appropriate tools for diagnosing glaucoma and can be used for documentation and
testing in remote areas and in a wider range of settings.
Fundus Oculi
3.A deep-learning model for the assessment of coronary heart disease and related risk factors via the evaluation of retinal fundus photographs.
Yao Dong DING ; Yang ZHANG ; Lan Qing HE ; Meng FU ; Xin ZHAO ; Lu Ke HUANG ; Bin WANG ; Yu Zhong CHEN ; Zhao Hui WANG ; Zhi Qiang MA ; Yong ZENG
Chinese Journal of Cardiology 2022;50(12):1201-1206
Objective: To develop and validate a deep learning model based on fundus photos for the identification of coronary heart disease (CHD) and associated risk factors. Methods: Subjects aged>18 years with complete clinical examination data from 149 hospitals and medical examination centers in China were included in this retrospective study. Two radiologists, who were not aware of the study design, independently evaluated the coronary angiography images of each subject to make CHD diagnosis. A deep learning model using convolutional neural networks (CNN) was used to label the fundus images according to the presence or absence of CHD, and the model was proportionally divided into training and test sets for model training. The prediction performance of the model was evaluated in the test set using monocular and binocular fundus images respectively. Prediction efficacy of the algorithm for cardiovascular risk factors (e.g., age, systolic blood pressure, gender) and coronary events were evaluated by regression analysis using the area under the receiver operating characteristic curve (AUC) and R2 correlation coefficient. Results: The study retrospectively collected 51 765 fundus images from 25 222 subjects, including 10 255 patients with CHD, and there were 14 419 male subjects in this cohort. Of these, 46 603 fundus images from 22 701 subjects were included in the training set and 5 162 fundus images from 2 521 subjects were included in the test set. In the test set, the deep learning model could accurately predict patients' age with an R2 value of 0.931 (95%CI 0.929-0.933) for monocular photos and 0.938 (95%CI 0.936-0.940) for binocular photos. The AUC values for sex identification from single eye and binocular retinal fundus images were 0.983 (95%CI 0.982-0.984) and 0.988 (95%CI 0.987-0.989), respectively. The AUC value of the model was 0.876 (95%CI 0.874-0.877) with either monocular fundus photographs and AUC value was 0.885 (95%CI 0.884-0.888) with binocular fundus photographs to predict CHD, the sensitivity of the model was 0.894 and specificity was 0.755 with accuracy of 0.714 using binocular fundus photographs for the prediction of CHD. Conclusion: The deep learning model based on fundus photographs performs well in identifying coronary heart disease and assessing related risk factors such as age and sex.
Humans
;
Male
;
Retrospective Studies
;
Deep Learning
;
Fundus Oculi
;
ROC Curve
;
Algorithms
;
Risk Factors
;
Coronary Disease/diagnostic imaging*
4.Segmentation of retinal vessels by fusing contour information and conditional generative adversarial.
Liming LIANG ; Zhimin LAN ; Xiaoqi SHENG ; Zhaoben XIE ; Wanrong LIU
Journal of Biomedical Engineering 2021;38(2):276-285
The existing retinal vessels segmentation algorithms have various problems that the end of main vessels are easy to break, and the central macula and the optic disc boundary are likely to be mistakenly segmented. To solve the above problems, a novel retinal vessels segmentation algorithm is proposed in this paper. The algorithm merged together vessels contour information and conditional generative adversarial nets. Firstly, non-uniform light removal and principal component analysis were used to process the fundus images. Therefore, it enhanced the contrast between the blood vessels and the background, and obtained the single-scale gray images with rich feature information. Secondly, the dense blocks integrated with the deep separable convolution with offset and squeeze-and-exception (SE) block were applied to the encoder and decoder to alleviate the gradient disappearance or explosion. Simultaneously, the network focused on the feature information of the learning target. Thirdly, the contour loss function was added to improve the identification ability of the blood vessels information and contour information of the network. Finally, experiments were carried out on the DRIVE and STARE datasets respectively. The value of area under the receiver operating characteristic reached 0.982 5 and 0.987 4, respectively, and the accuracy reached 0.967 7 and 0.975 6, respectively. Experimental results show that the algorithm can accurately distinguish contours and blood vessels, and reduce blood vessel rupture. The algorithm has certain application value in the diagnosis of clinical ophthalmic diseases.
Algorithms
;
Fundus Oculi
;
Optic Disk
;
ROC Curve
;
Retinal Vessels/diagnostic imaging*
5.Joint optic disc and cup segmentation based on residual multi-scale fully convolutional neural network.
Xin YUAN ; Xiujuan ZHENG ; Bin JI ; Miao LI ; Bin LI
Journal of Biomedical Engineering 2020;37(5):875-884
Glaucoma is the leading cause of irreversible blindness, but its early symptoms are not obvious and are easily overlooked, so early screening for glaucoma is particularly important. The cup to disc ratio is an important indicator for clinical glaucoma screening, and accurate segmentation of the optic cup and disc is the key to calculating the cup to disc ratio. In this paper, a full convolutional neural network with residual multi-scale convolution module was proposed for the optic cup and disc segmentation. First, the fundus image was contrast enhanced and polar transformation was introduced. Subsequently, W-Net was used as the backbone network, which replaced the standard convolution unit with the residual multi-scale full convolution module, the input port was added to the image pyramid to construct the multi-scale input, and the side output layer was used as the early classifier to generate the local prediction output. Finally, a new multi-tag loss function was proposed to guide network segmentation. The mean intersection over union of the optic cup and disc segmentation in the REFUGE dataset was 0.904 0 and 0.955 3 respectively, and the overlapping error was 0.178 0 and 0.066 5 respectively. The results show that this method not only realizes the joint segmentation of cup and disc, but also improves the segmentation accuracy effectively, which could be helpful for the promotion of large-scale early glaucoma screening.
Diagnostic Techniques, Ophthalmological
;
Fundus Oculi
;
Glaucoma/diagnostic imaging*
;
Humans
;
Neural Networks, Computer
;
Optic Disk/diagnostic imaging*
6.A Simplifed Model Eye for Testing Fundus Imaging Device.
Jianhua PENG ; Xiaohang JIA ; Jingtao WANG ; Yiping HU
Chinese Journal of Medical Instrumentation 2019;43(1):21-24
Based on the Gullstrand I model eye, a simplified model eye for testing fundus imaging device is designed. The model eye can reach the following requirements:(1) The refractive characteristics of the ocular refractive tissue are simulated, and the equivalent focal length in air is 17 mm; (2) The differences between relative refractive index differences of the adjacent materials of the simplified model eye and relative refractive index differences of any adjacent two layers (cornea and aqueous humor, aqueous humor and lens, lens and vitreous body) of the Gullstrand I model eye are not more than 1%; (3) In the case of the incident aperture diameter of 3 mm, the differences of radii of the diffuse spots formed by the paraxial light and the axial light are not more than 15%; (4) The differences of angles of chief ray and tangent line of the fundus are not more than 1°; (5) In the case of the incident aperture diameter of 3 mm, the differences of MTF values of the near axis light are not more than 0.1. The simplified model eye can be expected to be used for testing fundus imaging device instead of the test method in ISO 10940:2009 Ophthalmic instruments-Fundus cameras.
Cornea
;
Fundus Oculi
;
Lens, Crystalline
;
diagnostic imaging
;
Refraction, Ocular
7.Effect of Cataract Grade according to Wide-Field Fundus Images on Measurement of Macular Thickness in Cataract Patients.
Mingue KIM ; Youngsub EOM ; Jong Suk SONG ; Hyo Myung KIM
Korean Journal of Ophthalmology 2018;32(3):172-181
PURPOSE: To investigate the effects of cataract grade based on wide-field fundus imaging on macular thickness measured by spectral domain optical coherence tomography (SD-OCT) and its signal-to-noise ratio (SNR). METHODS: Two hundred cataract patients (200 eyes) with preoperative measurements by wide-field fundus imaging and macular SD-OCT were enrolled. Cataract severity was graded from 1 to 4 according to the degree of macular obscuring by cataract artifact in fundus photo images. Cataract grade based on wide-field fundus image, the Lens Opacity Classification System III, macular thickness, and SD-OCT SNR were compared. All SD-OCT B-scan images were evaluated to detect errors in retinal layer segmentation. RESULTS: Cataract grade based on wide-field fundus imaging was positively correlated with grade of posterior subcapsular cataracts (rho = 0.486, p < 0.001), but not with nuclear opalescence or cortical cataract using the Lens Opacity Classification System III. Cataract grade was negatively correlated with total macular thickness (rho = −0.509, p < 0.001) and SD-OCT SNR (rho = −0.568, p < 0.001). SD-OCT SNR was positively correlated with total macular thickness (rho = 0.571, p < 0.001). Of 200 eyes, 97 (48.5%) had segmentation errors on SD-OCT. As cataract grade increased and SD-OCT SNR decreased, the percentage of eyes with segmentation errors on SD-OCT increased. All measurements of macular thickness in eyes without segmentation errors were significantly greater than those of eyes with segmentation errors. CONCLUSIONS: Posterior subcapsular cataracts had profound effects on cataract grade based on wide-field fundus imaging. As cataract grade based on wide-field fundus image increased, macular thickness tended to be underestimated due to segmentation errors in SD-OCT images. Segmentation errors in SD-OCT should be considered when evaluating macular thickness in eyes with cataracts.
Artifacts
;
Cataract*
;
Classification
;
Fundus Oculi
;
Humans
;
Iridescence
;
Retinaldehyde
;
Signal-To-Noise Ratio
;
Tomography, Optical Coherence
8.Changes in Fundus Autofluorescence after Anti-vascular Endothelial Growth Factor According to the Type of Choroidal Neovascularization in Age-related Macular Degeneration.
Ji Young LEE ; Hyewon CHUNG ; Hyung Chan KIM
Korean Journal of Ophthalmology 2016;30(1):17-24
PURPOSE: To describe the changes of fundus autofluorescence (FAF) in patients with age-related macular degeneration before and after intravitreal injection of anti-vascular endothelial growth factor according to the type of choroidal neovascularization (CNV) and to evaluate the correlation of FAF with spectral domain optical coherence tomography (SD-OCT) parameters and vision. METHODS: This was a retrospective study. Twenty-one treatment-naive patients with neovascular age-related macular degeneration were included. Study eyes were divided into two groups according to the type of CNV. Fourteen eyes were type 1 CNV and seven eyes were type 2 CNV. All eyes underwent a complete ophthalmologic examination, including an assessment of best-corrected visual acuity, SD-OCT, fluorescein angiography, and FAF imaging, before and 3 months after intravitreal anti-vascular endothelial growth factor injection. Gray scales of FAF image for CNV areas, delineated as in fluorescein angiography, were analyzed using the ImageJ program, which were adjusted by comparison with normal background areas. Correlation of changes in FAF with changes in SD-OCT parameters, including CNV thickness, photoreceptor inner and outer segment junction disruption length, external limiting membrane disruption length, central macular thickness, subretinal fluid, and intraretinal fluid were analyzed. RESULTS: Eyes with both type 1 and type 2 CNV showed reduced FAF before treatment. The mean gray scales (%) of type 1 and type 2 CNV were 52.20% and 42.55%, respectively. The background values were 106.72 and 96.86. After treatment, the mean gray scales (%) of type 1 CNV and type 2 CNV were changed to 57.61% (p = 0.005) and 57.93% (p = 0.008), respectively. After treatment, CNV thickness, central macular thickness, and inner and outer segment junction disruption length were decreased while FAF increased. CONCLUSIONS: FAF was noted to be reduced in eyes with newly diagnosed wet age-related macular degeneration, but increased after anti-vascular endothelial growth factor therapy regardless of CNV lesion type.
Aged
;
Angiogenesis Inhibitors/*therapeutic use
;
Choroidal Neovascularization/classification/diagnostic imaging/*drug therapy
;
Female
;
Fluorescein Angiography
;
Fundus Oculi
;
Humans
;
Intravitreal Injections
;
Male
;
Middle Aged
;
Optical Imaging
;
Ranibizumab/*therapeutic use
;
Retrospective Studies
;
Tomography, Optical Coherence
;
Vascular Endothelial Growth Factor A/*antagonists & inhibitors
;
Visual Acuity
;
Wet Macular Degeneration/classification/diagnostic imaging/*drug therapy
9.Optical Coherence Tomography-based Diagnosis of Polypoidal Choroidal Vasculopathy in Korean Patients.
Young Suk CHANG ; Jae Hui KIM ; Jong Woo KIM ; Tae Gon LEE ; Chul Gu KIM
Korean Journal of Ophthalmology 2016;30(3):198-205
PURPOSE: To evaluate the efficacy of an optical coherence tomography (OCT)-based diagnosis of polypoidal choroidal vasculopathy (PCV) in Korean patients. METHODS: This retrospective, observational case series included 263 eyes of 263 patients (147 eyes with PCV and 116 eyes with typical exudative, age-related macular degeneration [AMD]) who had been diagnosed with treatment naïve exudative AMD. Eyes with three or more of the following OCT findings were diagnosed with PCV: multiple retinal pigment epithelial detachment (RPED), a sharp RPED peak, an RPED notch, a hyporeflective lumen representing polyps, and hyperreflective intraretinal hard exudates. The OCT-based diagnosis was compared with the gold-standard indocyanine green angiography-based method. The sensitivity and specificity of the OCT-based diagnosis was also estimated. An additional analysis was performed using a choroidal thickness criterion. Eyes with a subfoveal choroidal thickness greater than 300 µm were also diagnosed with PCV despite having only two OCT features. RESULTS: In eyes with PCV, three or more OCT features were observed in 126 of 147 eyes (85.7%), and the incidence of typical exudative AMD was 16 of 116 eyes (13.8%). The sensitivity and specificity of an OCT-based diagnosis were 85.7% and 86.2%, respectively. After applying the choroidal thickness criterion, the sensitivity increased from 85.7% to 89.8%, and the specificity decreased from 86.2% to 84.5%. CONCLUSIONS: The OCT-based diagnosis of PCV showed a high sensitivity and specificity in Korean patients. The addition of a choroidal thickness criterion improved the sensitivity of the method with a minimal decrease in its specificity.
Aged
;
Choroid/blood supply/*diagnostic imaging
;
Choroid Diseases/*diagnosis/epidemiology/physiopathology
;
Diagnosis, Differential
;
Female
;
Fluorescein Angiography
;
Follow-Up Studies
;
Fundus Oculi
;
Humans
;
Incidence
;
Male
;
Republic of Korea/epidemiology
;
Retrospective Studies
;
Tomography, Optical Coherence/*methods
;
Visual Acuity
10.Management of Acute Submacular Hemorrhage with Intravitreal Injection of Tenecteplase, Anti-vascular Endothelial Growth Factor and Gas.
Jung Pil LEE ; Jun Sang PARK ; Oh Woong KWON ; Yong Sung YOU ; Soon Hyun KIM
Korean Journal of Ophthalmology 2016;30(3):192-197
PURPOSE: To evaluate the visual and anatomical outcomes for neovascular age-related macular degeneration with submacular hemorrhage after intravitreal injections of tenecteplase (TNK), anti-vascular endothelial growth factor (VEGF) and expansile gas. METHODS: This study was a retrospective clinical case series following 25 eyes of 25 patients. All patients received a triple injection using 0.05 mL TNK (50 µg), 0.05 mL anti-VEGF and 0.3 mL of perfluoropropane gas. Retreatment with anti-VEGF was performed as needed. Preoperative and postoperative best-corrected visual acuity and central retinal thickness were analyzed. RESULTS: The mean logarithm of the minimum angle of resolution of best-corrected visual acuity improved significantly from 1.09 ± 0.77 at baseline to 0.52 ± 0.60 at 12 months (p < 0.001). The mean central retinal thickness also improved significantly from 545 ± 156 at baseline to 266 ± 107 at 12 months (p < 0.001). A visual improvement of 0.3 logarithm of the minimum angle of resolution unit or more was achieved in 15 eyes (60%). During the 12 postoperative months, an average of 4.04 intravitreal anti-VEGF injections was applied. CONCLUSIONS: A triple injection of TNK, anti-VEGF, and a gas appears to be safe and effective for the treatment of submacular hemorrhage secondary to neovascular age-related macular degeneration.
Acute Disease
;
Aged
;
Aged, 80 and over
;
Female
;
Fibrinolytic Agents/administration & dosage
;
Fluorescein Angiography
;
Fluorocarbons/*administration & dosage
;
Follow-Up Studies
;
Fundus Oculi
;
Humans
;
Intravitreal Injections
;
Macula Lutea/*diagnostic imaging
;
Male
;
Middle Aged
;
Retinal Hemorrhage/diagnosis/*drug therapy
;
Retrospective Studies
;
Tissue Plasminogen Activator/*administration & dosage
;
Tomography, Optical Coherence
;
Treatment Outcome
;
Vascular Endothelial Growth Factor A/antagonists & inhibitors
;
Visual Acuity


Result Analysis
Print
Save
E-mail