Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning
To compare performance of a deep-learning enhanced algorithm for automated detection of diabetic retinopathy (DR), to the previously published performance of that algorithm, the Iowa Detection Program (IDP)-without deep learning components-on the same publicly available set of fundus images and prev...
Gespeichert in:
| Veröffentlicht in: | Investigative ophthalmology & visual science Jg. 57; H. 13; S. 5200 - 5206 |
|---|---|
| Hauptverfasser: | , , , , , , |
| Format: | Journal Article |
| Sprache: | Englisch |
| Veröffentlicht: |
United States
01.10.2016
|
| Schlagworte: | |
| ISSN: | 1552-5783, 1552-5783 |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | To compare performance of a deep-learning enhanced algorithm for automated detection of diabetic retinopathy (DR), to the previously published performance of that algorithm, the Iowa Detection Program (IDP)-without deep learning components-on the same publicly available set of fundus images and previously reported consensus reference standard set, by three US Board certified retinal specialists.
We used the previously reported consensus reference standard of referable DR (rDR), defined as International Clinical Classification of Diabetic Retinopathy moderate, severe nonproliferative (NPDR), proliferative DR, and/or macular edema (ME). Neither Messidor-2 images, nor the three retinal specialists setting the Messidor-2 reference standard were used for training IDx-DR version X2.1. Sensitivity, specificity, negative predictive value, area under the curve (AUC), and their confidence intervals (CIs) were calculated.
Sensitivity was 96.8% (95% CI: 93.3%-98.8%), specificity was 87.0% (95% CI: 84.2%-89.4%), with 6/874 false negatives, resulting in a negative predictive value of 99.0% (95% CI: 97.8%-99.6%). No cases of severe NPDR, PDR, or ME were missed. The AUC was 0.980 (95% CI: 0.968-0.992). Sensitivity was not statistically different from published IDP sensitivity, which had a CI of 94.4% to 99.3%, but specificity was significantly better than the published IDP specificity CI of 55.7% to 63.0%.
A deep-learning enhanced algorithm for the automated detection of DR, achieves significantly better performance than a previously reported, otherwise essentially identical, algorithm that does not employ deep learning. Deep learning enhanced algorithms have the potential to improve the efficiency of DR screening, and thereby to prevent visual loss and blindness from this devastating disease. |
|---|---|
| AbstractList | PURPOSETo compare performance of a deep-learning enhanced algorithm for automated detection of diabetic retinopathy (DR), to the previously published performance of that algorithm, the Iowa Detection Program (IDP)-without deep learning components-on the same publicly available set of fundus images and previously reported consensus reference standard set, by three US Board certified retinal specialists.METHODSWe used the previously reported consensus reference standard of referable DR (rDR), defined as International Clinical Classification of Diabetic Retinopathy moderate, severe nonproliferative (NPDR), proliferative DR, and/or macular edema (ME). Neither Messidor-2 images, nor the three retinal specialists setting the Messidor-2 reference standard were used for training IDx-DR version X2.1. Sensitivity, specificity, negative predictive value, area under the curve (AUC), and their confidence intervals (CIs) were calculated.RESULTSSensitivity was 96.8% (95% CI: 93.3%-98.8%), specificity was 87.0% (95% CI: 84.2%-89.4%), with 6/874 false negatives, resulting in a negative predictive value of 99.0% (95% CI: 97.8%-99.6%). No cases of severe NPDR, PDR, or ME were missed. The AUC was 0.980 (95% CI: 0.968-0.992). Sensitivity was not statistically different from published IDP sensitivity, which had a CI of 94.4% to 99.3%, but specificity was significantly better than the published IDP specificity CI of 55.7% to 63.0%.CONCLUSIONSA deep-learning enhanced algorithm for the automated detection of DR, achieves significantly better performance than a previously reported, otherwise essentially identical, algorithm that does not employ deep learning. Deep learning enhanced algorithms have the potential to improve the efficiency of DR screening, and thereby to prevent visual loss and blindness from this devastating disease. To compare performance of a deep-learning enhanced algorithm for automated detection of diabetic retinopathy (DR), to the previously published performance of that algorithm, the Iowa Detection Program (IDP)-without deep learning components-on the same publicly available set of fundus images and previously reported consensus reference standard set, by three US Board certified retinal specialists. We used the previously reported consensus reference standard of referable DR (rDR), defined as International Clinical Classification of Diabetic Retinopathy moderate, severe nonproliferative (NPDR), proliferative DR, and/or macular edema (ME). Neither Messidor-2 images, nor the three retinal specialists setting the Messidor-2 reference standard were used for training IDx-DR version X2.1. Sensitivity, specificity, negative predictive value, area under the curve (AUC), and their confidence intervals (CIs) were calculated. Sensitivity was 96.8% (95% CI: 93.3%-98.8%), specificity was 87.0% (95% CI: 84.2%-89.4%), with 6/874 false negatives, resulting in a negative predictive value of 99.0% (95% CI: 97.8%-99.6%). No cases of severe NPDR, PDR, or ME were missed. The AUC was 0.980 (95% CI: 0.968-0.992). Sensitivity was not statistically different from published IDP sensitivity, which had a CI of 94.4% to 99.3%, but specificity was significantly better than the published IDP specificity CI of 55.7% to 63.0%. A deep-learning enhanced algorithm for the automated detection of DR, achieves significantly better performance than a previously reported, otherwise essentially identical, algorithm that does not employ deep learning. Deep learning enhanced algorithms have the potential to improve the efficiency of DR screening, and thereby to prevent visual loss and blindness from this devastating disease. |
| Author | Folk, James C. Abràmoff, Michael David Clarida, Warren Amelon, Ryan Erginay, Ali Niemeijer, Meindert Lou, Yiyue |
| Author_xml | – sequence: 1 givenname: Michael David surname: Abràmoff fullname: Abràmoff, Michael David organization: Department of Ophthalmology and Visual Sciences, University of Iowa Hospitals and Clinics, Iowa City, Iowa, United States 2Iowa City Veterans Affairs Medical Center, Iowa City, Iowa, United States 3IDx LLC, Iowa City, Iowa, United States – sequence: 2 givenname: Yiyue surname: Lou fullname: Lou, Yiyue organization: Department of Biostatistics, College of Public Health, University of Iowa, Iowa City, Iowa, United States – sequence: 3 givenname: Ali surname: Erginay fullname: Erginay, Ali organization: Service d' Ophtalmologie, Hôpital Lariboisière, APHP, Paris, France – sequence: 4 givenname: Warren surname: Clarida fullname: Clarida, Warren organization: IDx LLC, Iowa City, Iowa, United States – sequence: 5 givenname: Ryan surname: Amelon fullname: Amelon, Ryan organization: IDx LLC, Iowa City, Iowa, United States – sequence: 6 givenname: James C. surname: Folk fullname: Folk, James C. organization: Department of Ophthalmology and Visual Sciences, University of Iowa Hospitals and Clinics, Iowa City, Iowa, United States 3IDx LLC, Iowa City, Iowa, United States – sequence: 7 givenname: Meindert surname: Niemeijer fullname: Niemeijer, Meindert organization: IDx LLC, Iowa City, Iowa, United States |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/27701631$$D View this record in MEDLINE/PubMed |
| BookMark | eNptkctLAzEQxoMoWh9Hr5Kjl9U8NrvZY2l9FAqK6Dlk02kb2d3UJFvof2_aqoh4mQfzmw9mvlN02LkOELqk5IbSory1bh1uaJHRqiryAzSgQrBMlJIf_qpP0GkI74QwShk5RiesLAktOB2gzaRdebeGGR720bU6pmoMEUy0rsNujsdW1xCtwS8pdm6l43KD00jj575urGk2eLjWttF1A3isow4Q8evSu36xxJMuwsLrHy2AFZ6C9p3tFufoaK6bABdf-Qy93d-9jh6z6dPDZDScZoZXMmasKo3JJRNGMDoDATlnhs8oKwkUIjVcFpUs60qKmhPOcsgLoLIuQeqK1IKfoeu9brrzo4cQVWuDgabRHbg-KCq5SBpMbNGrL7SvW5iplbet9hv1_a4E8D1gvAvBw1wZG3fnRZ9-oChRW1PU1hRFC7UzJW1lf7a-hf_nPwFioY69 |
| CitedBy_id | crossref_primary_10_1109_ACCESS_2020_3015258 crossref_primary_10_1007_s10489_021_02242_4 crossref_primary_10_1080_17469899_2024_2328620 crossref_primary_10_1016_j_compmedimag_2024_102355 crossref_primary_10_1097_IAE_0000000000004310 crossref_primary_10_1097_ICU_0000000000000470 crossref_primary_10_1038_s41598_022_15495_x crossref_primary_10_1038_s41598_023_47854_7 crossref_primary_10_1097_IIO_0000000000000298 crossref_primary_10_3389_fmed_2024_1482788 crossref_primary_10_1038_s41551_022_00879_1 crossref_primary_10_3390_diagnostics14020121 crossref_primary_10_2196_jmir_7984 crossref_primary_10_4103_ijo_IJO_1569_22 crossref_primary_10_3389_fmed_2025_1519768 crossref_primary_10_1177_11206721241248856 crossref_primary_10_3390_jimaging9040084 crossref_primary_10_1016_j_measurement_2024_114216 crossref_primary_10_1038_s41591_020_1037_7 crossref_primary_10_1038_s41433_022_02335_5 crossref_primary_10_1007_s11277_024_10968_w crossref_primary_10_1002_jemt_24413 crossref_primary_10_1038_s41433_020_0849_5 crossref_primary_10_3390_jcm12216719 crossref_primary_10_1097_ICO_0000000000003492 crossref_primary_10_1007_s00530_021_00884_5 crossref_primary_10_1016_j_media_2021_102141 crossref_primary_10_4103_ijo_IJO_1420_21 crossref_primary_10_1016_j_xops_2025_100935 crossref_primary_10_1080_21681163_2022_2060864 crossref_primary_10_1186_s40942_023_00502_8 crossref_primary_10_1007_s13755_017_0034_9 crossref_primary_10_1016_j_media_2021_102118 crossref_primary_10_1007_s13300_019_0652_0 crossref_primary_10_1016_j_ophtha_2020_02_009 crossref_primary_10_1111_aos_14306 crossref_primary_10_1007_s11831_022_09862_0 crossref_primary_10_1038_s41598_021_02479_6 crossref_primary_10_1016_j_health_2023_100261 crossref_primary_10_1097_CM9_0000000000001816 crossref_primary_10_1016_j_compbiomed_2019_103537 crossref_primary_10_1136_bjophthalmol_2017_311489 crossref_primary_10_1007_s10489_021_03043_5 crossref_primary_10_1186_s13063_020_04951_6 crossref_primary_10_1007_s00138_018_00998_3 crossref_primary_10_1038_s41551_018_0305_z crossref_primary_10_1038_s41746_018_0040_6 crossref_primary_10_3390_jimaging7090165 crossref_primary_10_1007_s00521_022_08038_y crossref_primary_10_1016_j_preteyeres_2019_04_003 crossref_primary_10_1038_s41598_025_91941_w crossref_primary_10_3390_math10050686 crossref_primary_10_1007_s00417_023_06181_3 crossref_primary_10_1016_j_patcog_2025_111484 crossref_primary_10_1016_j_media_2019_101561 crossref_primary_10_1080_02713683_2023_2215984 crossref_primary_10_1016_j_survophthal_2021_03_003 crossref_primary_10_4103_ijo_IJO_1399_19 crossref_primary_10_1007_s42979_025_04266_w crossref_primary_10_1136_bmjopen_2023_081050 crossref_primary_10_3389_fdgth_2022_889445 crossref_primary_10_1007_s40123_023_00691_3 crossref_primary_10_1097_WON_0000000000000650 crossref_primary_10_1016_j_jdiacomp_2025_109120 crossref_primary_10_1097_ICO_0000000000003038 crossref_primary_10_1007_s00431_024_05476_9 crossref_primary_10_1016_j_exer_2022_109092 crossref_primary_10_1016_j_addr_2023_114772 crossref_primary_10_1016_j_artmed_2019_03_009 crossref_primary_10_1007_s11042_024_19558_1 crossref_primary_10_1001_jamaophthalmol_2023_4508 crossref_primary_10_1371_journal_pone_0291390 crossref_primary_10_3390_app10093280 crossref_primary_10_1080_17434440_2020_1813566 crossref_primary_10_3389_fpubh_2022_908756 crossref_primary_10_1109_ACCESS_2021_3109240 crossref_primary_10_1109_ACCESS_2021_3108395 crossref_primary_10_1007_s10354_025_01081_z crossref_primary_10_1186_s12859_021_04005_x crossref_primary_10_2196_37532 crossref_primary_10_3389_fmed_2024_1489139 crossref_primary_10_1007_s44196_025_00956_8 crossref_primary_10_1111_ceo_13943 crossref_primary_10_1002_jemt_23991 crossref_primary_10_1016_j_cmpb_2020_105320 crossref_primary_10_1002_ima_22734 crossref_primary_10_1186_s40662_020_00182_7 crossref_primary_10_1007_s00439_022_02439_8 crossref_primary_10_1080_08820538_2019_1620812 crossref_primary_10_3389_fmed_2022_839088 crossref_primary_10_1109_ACCESS_2019_2929365 crossref_primary_10_1038_s42256_020_0154_9 crossref_primary_10_1016_j_imu_2020_100377 crossref_primary_10_1016_j_asoc_2024_112536 crossref_primary_10_1109_ACCESS_2020_3016782 crossref_primary_10_1038_s41598_021_93632_8 crossref_primary_10_3390_ijerph19031204 crossref_primary_10_3389_fnagi_2018_00188 crossref_primary_10_1016_j_visres_2017_03_008 crossref_primary_10_1016_j_ajo_2023_06_024 crossref_primary_10_4103_ijo_IJO_1212_21 crossref_primary_10_1016_j_ophtha_2020_10_030 crossref_primary_10_1007_s13748_021_00233_7 crossref_primary_10_1080_08820538_2018_1551496 crossref_primary_10_1186_s12967_024_05597_7 crossref_primary_10_3233_THC_236036 crossref_primary_10_1016_j_cmpb_2021_105972 crossref_primary_10_1007_s40123_024_00981_4 crossref_primary_10_1002_ima_22842 crossref_primary_10_1016_j_ogla_2020_04_008 crossref_primary_10_1007_s00417_020_04853_y crossref_primary_10_1371_journal_pone_0255034 crossref_primary_10_1007_s00417_017_3850_3 crossref_primary_10_1177_11206721211052852 crossref_primary_10_1080_08820538_2021_1901123 crossref_primary_10_1155_2021_5592472 crossref_primary_10_1371_journal_pone_0254180 crossref_primary_10_1007_s00417_023_06052_x crossref_primary_10_1136_bmj_m3164 crossref_primary_10_1016_j_oret_2021_12_021 crossref_primary_10_1002_jbio_201960186 crossref_primary_10_1063_5_0172226 crossref_primary_10_1007_s40135_018_0161_8 crossref_primary_10_1038_d41586_019_01112_x crossref_primary_10_1007_s11892_022_01467_y crossref_primary_10_1016_j_compbiomed_2020_104198 crossref_primary_10_1038_s41433_025_03708_2 crossref_primary_10_1155_2020_9139713 crossref_primary_10_1016_j_compbiomed_2021_104599 crossref_primary_10_1007_s12559_021_09880_3 crossref_primary_10_1016_j_jcjo_2018_04_019 crossref_primary_10_3390_jcm10112352 crossref_primary_10_1038_s41746_024_01389_x crossref_primary_10_1089_tmj_2023_0704 crossref_primary_10_1007_s11831_021_09667_7 crossref_primary_10_1186_s12909_022_03272_3 crossref_primary_10_1038_s41598_021_89225_0 crossref_primary_10_3390_app13053108 crossref_primary_10_1002_jbio_201960050 crossref_primary_10_1097_ICL_0000000000001054 crossref_primary_10_1177_19322968211042665 crossref_primary_10_1007_s11042_020_10238_4 crossref_primary_10_26633_RPSP_2024_12 crossref_primary_10_26633_RPSP_2024_13 crossref_primary_10_1016_j_hjdsi_2023_100692 crossref_primary_10_3390_s22051803 crossref_primary_10_1007_s11548_020_02121_2 crossref_primary_10_1109_ACCESS_2022_3192024 crossref_primary_10_1007_s11042_022_14313_w crossref_primary_10_1007_s11831_023_09989_8 crossref_primary_10_1007_s40123_018_0153_7 crossref_primary_10_3390_app10186185 crossref_primary_10_1016_j_neucom_2019_08_079 crossref_primary_10_1007_s11042_020_09217_6 crossref_primary_10_3390_medicina60060990 crossref_primary_10_1007_s10462_022_10185_6 crossref_primary_10_1007_s13735_021_00218_1 crossref_primary_10_3390_electronics13193862 crossref_primary_10_3390_jimaging5020026 crossref_primary_10_1038_s41591_020_1034_x crossref_primary_10_1007_s10792_019_01074_z crossref_primary_10_3389_fmed_2025_1573329 crossref_primary_10_1007_s00592_020_01506_8 crossref_primary_10_1134_S1054661819020093 crossref_primary_10_1002_hsr2_1543 crossref_primary_10_1038_s41372_023_01719_z crossref_primary_10_3390_s21165283 crossref_primary_10_1089_tmj_2023_0041 crossref_primary_10_1155_2021_9928899 crossref_primary_10_1038_s41746_025_01739_3 crossref_primary_10_1016_j_optom_2022_08_001 crossref_primary_10_1155_2018_8289253 crossref_primary_10_1038_s41598_022_15491_1 crossref_primary_10_1007_s00417_023_06245_4 crossref_primary_10_1155_2021_6641980 crossref_primary_10_1038_s41598_019_54779_7 crossref_primary_10_1080_0954898X_2024_2424242 crossref_primary_10_1016_j_jdiacomp_2019_107417 crossref_primary_10_1108_IJPCC_08_2020_0109 crossref_primary_10_1038_s41598_019_43670_0 crossref_primary_10_3928_23258160_20230130_03 crossref_primary_10_1111_aos_15110 crossref_primary_10_3389_fmed_2023_1184892 crossref_primary_10_3389_fmed_2023_1303300 crossref_primary_10_1038_s41433_021_01912_4 crossref_primary_10_1016_j_ins_2019_06_011 crossref_primary_10_2196_23863 crossref_primary_10_2196_67529 crossref_primary_10_3390_diagnostics13172810 crossref_primary_10_1038_s41433_019_0566_0 crossref_primary_10_1080_08164622_2022_2111201 crossref_primary_10_4103_ijo_IJO_1411_21 crossref_primary_10_1016_j_oftale_2020_08_002 crossref_primary_10_3390_jcm12041408 crossref_primary_10_1109_ACCESS_2020_2980055 crossref_primary_10_1016_j_asoc_2022_109462 crossref_primary_10_1016_j_media_2017_04_012 crossref_primary_10_4103_ijo_IJO_644_22 crossref_primary_10_1155_2019_6319581 crossref_primary_10_1016_j_aopr_2022_100078 crossref_primary_10_1016_j_ophtha_2019_09_036 crossref_primary_10_1111_aos_14132 crossref_primary_10_1016_j_preteyeres_2017_01_001 crossref_primary_10_1007_s40135_020_00245_x crossref_primary_10_3389_fphar_2022_930520 crossref_primary_10_1007_s11042_024_18792_x crossref_primary_10_1007_s40200_025_01596_7 crossref_primary_10_1016_j_jpsychires_2021_02_021 crossref_primary_10_1016_j_procs_2018_05_074 crossref_primary_10_1111_iwj_13064 crossref_primary_10_1016_j_survophthal_2018_09_002 crossref_primary_10_18502_jovr_v19i1_15424 crossref_primary_10_1016_j_preteyeres_2025_101363 crossref_primary_10_1089_tmj_2022_0357 crossref_primary_10_1007_s40123_021_00404_8 crossref_primary_10_1038_s41433_021_01572_4 crossref_primary_10_1371_journal_pone_0215916 crossref_primary_10_1038_s41598_023_38610_y crossref_primary_10_1016_j_ajo_2025_02_022 crossref_primary_10_1038_s41433_024_03173_3 crossref_primary_10_1155_2020_7493419 crossref_primary_10_1007_s11892_019_1189_3 crossref_primary_10_1109_JBHI_2020_3012134 crossref_primary_10_1016_j_procs_2024_04_297 crossref_primary_10_1109_ACCESS_2020_2994047 crossref_primary_10_1155_2018_5278196 crossref_primary_10_1155_2023_2728719 crossref_primary_10_3390_ijtm1030016 crossref_primary_10_2337_dc18_0147 crossref_primary_10_2337_dc18_0148 crossref_primary_10_1177_1932296820906212 crossref_primary_10_1016_j_cmpb_2023_107358 crossref_primary_10_3389_fcell_2024_1473176 crossref_primary_10_1136_bjophthalmol_2019_315651 crossref_primary_10_1007_s11042_018_7044_8 crossref_primary_10_1007_s12652_020_02882_3 crossref_primary_10_1109_ACCESS_2024_3469537 crossref_primary_10_3390_s22093490 crossref_primary_10_1177_24741264241247602 crossref_primary_10_1177_09691413221144382 crossref_primary_10_7717_peerj_cs_715 crossref_primary_10_1016_j_ophtha_2019_09_014 crossref_primary_10_1089_omi_2019_0038 crossref_primary_10_1155_2018_2159702 crossref_primary_10_1016_j_scs_2020_102589 crossref_primary_10_1049_iet_ipr_2017_0636 crossref_primary_10_1038_s41598_022_12497_7 crossref_primary_10_2196_12539 crossref_primary_10_3389_fcell_2023_1174936 crossref_primary_10_1049_iet_cvi_2018_5508 crossref_primary_10_1111_imj_15017 crossref_primary_10_1049_iet_ipr_2019_0804 crossref_primary_10_1016_j_compbiomed_2022_105368 crossref_primary_10_1016_j_media_2024_103365 crossref_primary_10_1038_s41598_020_78696_2 crossref_primary_10_1007_s13755_022_00181_z crossref_primary_10_1136_bmjdrc_2019_000892 crossref_primary_10_3390_medicina60040527 crossref_primary_10_1038_s41433_022_02217_w crossref_primary_10_1038_s41746_025_01959_7 crossref_primary_10_3389_fendo_2022_1036426 crossref_primary_10_3389_fpubh_2022_944967 crossref_primary_10_1016_j_pdpdt_2024_104331 crossref_primary_10_3389_fmed_2023_1115032 crossref_primary_10_3390_s20226549 crossref_primary_10_1007_s12652_020_01963_7 crossref_primary_10_1016_j_cmpbup_2021_100013 crossref_primary_10_1038_s41746_020_0247_1 crossref_primary_10_1097_IAE_0000000000002640 crossref_primary_10_1109_TBCAS_2022_3182907 crossref_primary_10_1016_j_media_2024_103357 crossref_primary_10_1080_21681163_2022_2083020 crossref_primary_10_1038_s41433_025_03633_4 crossref_primary_10_4103_ijo_IJO_1203_19 crossref_primary_10_1007_s11042_023_17254_0 crossref_primary_10_1371_journal_pone_0284060 crossref_primary_10_18502_jovr_v19i3_15893 crossref_primary_10_1111_dme_14386 crossref_primary_10_1051_epjconf_202532801009 crossref_primary_10_1007_s40123_021_00353_2 crossref_primary_10_1038_s41433_024_03037_w crossref_primary_10_4103_tjo_TJO_D_24_00064 crossref_primary_10_1007_s13555_020_00372_0 crossref_primary_10_1016_j_optom_2022_06_006 crossref_primary_10_1016_j_rbmo_2021_08_008 crossref_primary_10_1109_ACCESS_2017_2788044 crossref_primary_10_2147_OPTH_S235751 crossref_primary_10_3390_brainsci12050535 crossref_primary_10_1136_bjophthalmol_2018_313173 crossref_primary_10_1097_01_APO_0000656984_56467_2c crossref_primary_10_1016_j_heliyon_2025_e41802 crossref_primary_10_1038_s41746_023_00991_9 crossref_primary_10_1371_journal_pdig_0000618 crossref_primary_10_3389_fendo_2022_1032144 crossref_primary_10_1136_bjophthalmol_2018_313290 crossref_primary_10_1089_tmj_2019_0137 crossref_primary_10_4103_hjo_HJO_5_23 crossref_primary_10_1038_s41598_023_41362_4 crossref_primary_10_1089_tmj_2020_0006 crossref_primary_10_1089_tmj_2020_0008 crossref_primary_10_2196_16225 crossref_primary_10_1007_s00500_021_06088_3 crossref_primary_10_1001_jamaophthalmol_2018_6035 crossref_primary_10_3390_vision9030075 crossref_primary_10_1016_j_artmed_2019_07_009 crossref_primary_10_1016_j_oret_2016_12_009 crossref_primary_10_1109_ACCESS_2021_3052870 crossref_primary_10_1016_j_compmedimag_2020_101818 crossref_primary_10_1016_j_ncl_2024_08_003 crossref_primary_10_1136_bmjdrc_2020_001596 crossref_primary_10_1097_APO_0000000000000467 crossref_primary_10_1007_s00417_019_04575_w crossref_primary_10_1088_1361_6579_ada86a crossref_primary_10_1093_ibd_izaa211 crossref_primary_10_1038_s41433_020_0961_6 crossref_primary_10_3389_fmed_2025_1567159 crossref_primary_10_1007_s00417_021_05503_7 crossref_primary_10_1007_s40123_025_01173_4 crossref_primary_10_3390_jcm12093266 crossref_primary_10_1038_s41598_019_42042_y crossref_primary_10_1002_VIW_20220070 crossref_primary_10_3389_fendo_2022_946915 crossref_primary_10_3390_diagnostics12112865 crossref_primary_10_1097_IIO_0000000000000505 crossref_primary_10_1016_j_ogla_2018_04_002 crossref_primary_10_1001_jamaophthalmol_2021_1284 crossref_primary_10_1111_jdi_13480 crossref_primary_10_1016_j_media_2020_101660 crossref_primary_10_1038_s41433_019_0562_4 crossref_primary_10_1109_JBHI_2020_3046771 crossref_primary_10_3390_jcm10061254 crossref_primary_10_1016_j_ophtha_2017_08_046 crossref_primary_10_1016_j_medj_2021_04_006 crossref_primary_10_1007_s40123_024_00923_0 crossref_primary_10_1038_s41433_025_03885_0 crossref_primary_10_1155_2020_8841927 crossref_primary_10_1088_1361_6560_ac9fa0 crossref_primary_10_1016_j_preteyeres_2024_101271 crossref_primary_10_1016_j_heliyon_2024_e39329 crossref_primary_10_1038_s41598_021_81539_3 crossref_primary_10_1007_s11892_017_0940_x crossref_primary_10_1038_s41433_024_03026_z crossref_primary_10_1097_IIO_0000000000000519 crossref_primary_10_1177_2327857923121052 crossref_primary_10_1016_j_compbiomed_2025_109792 crossref_primary_10_1016_j_procs_2025_08_108 crossref_primary_10_31893_multirev_2025218 crossref_primary_10_3390_s21113883 crossref_primary_10_4103_ijo_IJO_1840_21 crossref_primary_10_1155_2022_5779276 crossref_primary_10_3389_fendo_2024_1386613 crossref_primary_10_1080_00051144_2024_2409552 crossref_primary_10_1111_exsy_13295 crossref_primary_10_1038_s41433_018_0269_y crossref_primary_10_2337_dc20_1877 crossref_primary_10_1186_s12938_025_01336_1 crossref_primary_10_1007_s00417_025_06828_3 crossref_primary_10_1109_ACCESS_2021_3074458 crossref_primary_10_3390_app122111016 crossref_primary_10_1007_s13410_023_01296_z crossref_primary_10_1016_j_artmed_2024_102782 crossref_primary_10_1109_ACCESS_2023_3330104 crossref_primary_10_1155_2022_3163496 crossref_primary_10_1002_dmrr_3414 crossref_primary_10_4103_ijo_IJO_1482_21 crossref_primary_10_3390_bdcc6040152 crossref_primary_10_1016_j_ajo_2021_12_020 crossref_primary_10_1167_iovs_17_23677 crossref_primary_10_1371_journal_pone_0230111 crossref_primary_10_1109_ACCESS_2023_3343642 crossref_primary_10_1007_s10815_022_02649_z crossref_primary_10_1001_jamaophthalmol_2019_1997 crossref_primary_10_1016_j_oret_2021_06_010 crossref_primary_10_1016_j_compbiomed_2025_110412 crossref_primary_10_1097_APO_0000000000000267 crossref_primary_10_1007_s11633_022_1329_0 crossref_primary_10_1097_ICU_0000000000000846 crossref_primary_10_1038_s41433_025_03809_y crossref_primary_10_1016_j_media_2020_101742 crossref_primary_10_1088_1757_899X_925_1_012033 crossref_primary_10_1186_s12938_022_01018_2 crossref_primary_10_1007_s00417_022_05818_z crossref_primary_10_3390_diagnostics13010130 crossref_primary_10_2147_OPTH_S261629 crossref_primary_10_3389_fpubh_2022_971943 crossref_primary_10_3389_fmolb_2021_823277 crossref_primary_10_1038_s41433_019_0577_x crossref_primary_10_1002_dmrr_3445 crossref_primary_10_3390_jcm12010152 crossref_primary_10_1038_s41746_019_0096_y crossref_primary_10_3390_ijms251910485 crossref_primary_10_3389_fmed_2022_872214 crossref_primary_10_1007_s11042_022_14277_x crossref_primary_10_1007_s11517_021_02321_1 crossref_primary_10_1016_j_artmed_2019_101750 crossref_primary_10_1097_ICU_0000000000000979 crossref_primary_10_1007_s10278_022_00666_z crossref_primary_10_1016_j_survophthal_2022_08_004 crossref_primary_10_1089_sur_2019_154 crossref_primary_10_1007_s11042_025_20875_2 crossref_primary_10_1016_j_ajo_2024_02_007 crossref_primary_10_1007_s00417_020_04969_1 crossref_primary_10_1016_j_artmed_2019_101758 crossref_primary_10_1016_j_bspc_2021_103423 crossref_primary_10_3390_diagnostics12051210 crossref_primary_10_1016_j_oret_2021_01_013 crossref_primary_10_1098_rsif_2017_0387 crossref_primary_10_32604_cmc_2021_014691 crossref_primary_10_1177_2474126420914168 crossref_primary_10_1097_ICU_0000000000000983 crossref_primary_10_3389_fmed_2022_851644 crossref_primary_10_1186_s12886_020_01657_w crossref_primary_10_32604_cmc_2021_012874 crossref_primary_10_4103_tjo_TJO_D_23_00018 crossref_primary_10_1016_j_preteyeres_2020_100900 crossref_primary_10_1097_IIO_0000000000000333 crossref_primary_10_1002_sim_9308 crossref_primary_10_1007_s11760_022_02407_9 crossref_primary_10_22608_APO_2018438 crossref_primary_10_1038_s41746_020_00376_2 crossref_primary_10_1109_TBME_2020_3027231 crossref_primary_10_1016_j_survophthal_2023_04_001 crossref_primary_10_1002_14651858_CD014911_pub2 crossref_primary_10_1007_s10916_019_1432_0 crossref_primary_10_1109_ACCESS_2020_3028960 crossref_primary_10_1016_j_preteyeres_2018_07_004 crossref_primary_10_1167_iovs_18_25634 crossref_primary_10_1371_journal_pone_0295123 crossref_primary_10_4103_DLJO_DLJO_105_24 crossref_primary_10_1016_j_media_2017_07_005 crossref_primary_10_1080_02713683_2020_1764975 crossref_primary_10_1007_s11042_024_20241_8 crossref_primary_10_1016_j_ophtha_2019_05_029 crossref_primary_10_1016_j_ajo_2022_08_008 crossref_primary_10_1109_ACCESS_2024_3477420 crossref_primary_10_5114_amsad_183420 crossref_primary_10_1016_j_jcte_2019_100214 crossref_primary_10_1016_j_cmpbup_2022_100059 crossref_primary_10_1002_ima_23213 crossref_primary_10_1016_j_media_2020_101715 crossref_primary_10_3389_fbioe_2022_952198 crossref_primary_10_1097_IAE_0000000000004049 crossref_primary_10_1016_j_knosys_2022_108960 crossref_primary_10_3390_ijerph17030790 crossref_primary_10_1097_ICU_0000000000000885 crossref_primary_10_1097_ICU_0000000000000524 crossref_primary_10_1007_s10278_023_00774_4 crossref_primary_10_1109_ACCESS_2024_3510556 crossref_primary_10_1007_s40846_020_00509_8 crossref_primary_10_1371_journal_pone_0275983 crossref_primary_10_1016_j_oret_2018_10_014 crossref_primary_10_1007_s10278_024_01010_3 crossref_primary_10_1016_j_procs_2023_10_534 crossref_primary_10_1016_j_est_2023_106784 crossref_primary_10_1016_j_preteyeres_2021_101034 crossref_primary_10_1016_j_ophtha_2017_10_031 crossref_primary_10_1001_jamanetworkopen_2019_5822 crossref_primary_10_1002_jgc4_1192 crossref_primary_10_1109_ACCESS_2020_2993937 crossref_primary_10_1111_aos_13613 crossref_primary_10_1016_j_jfma_2020_03_024 crossref_primary_10_1080_23311916_2021_1920707 crossref_primary_10_1016_j_rbmo_2021_11_003 crossref_primary_10_1016_j_oret_2025_05_032 crossref_primary_10_4103_tjo_TJO_D_23_00032 crossref_primary_10_1038_s41598_018_35044_9 crossref_primary_10_1155_2022_7968200 crossref_primary_10_1109_TMI_2020_3035154 crossref_primary_10_7759_cureus_88114 crossref_primary_10_3390_diagnostics13111904 crossref_primary_10_1038_s41433_020_0895_z crossref_primary_10_1016_j_oftal_2020_08_007 crossref_primary_10_1109_ACCESS_2023_3299819 crossref_primary_10_1097_IIO_0000000000000246 crossref_primary_10_1038_s41598_025_98518_7 crossref_primary_10_1007_s00592_023_02105_z crossref_primary_10_2147_OPTH_S289425 crossref_primary_10_1007_s00417_018_04224_8 crossref_primary_10_1007_s00417_021_05402_x crossref_primary_10_1097_ICU_0000000000000788 crossref_primary_10_3390_app13148295 crossref_primary_10_1097_ICU_0000000000000789 crossref_primary_10_1136_bjophthalmol_2020_318544 crossref_primary_10_1007_s11831_023_10002_5 crossref_primary_10_1016_j_preteyeres_2022_101111 crossref_primary_10_1007_s00592_023_02104_0 crossref_primary_10_1038_s41433_024_03585_1 crossref_primary_10_1016_j_ophtha_2022_09_014 crossref_primary_10_1371_journal_pone_0217541 crossref_primary_10_1016_j_diabres_2023_110943 crossref_primary_10_1016_j_jaapos_2021_01_011 crossref_primary_10_3390_electronics10020163 crossref_primary_10_1007_s43441_021_00355_z crossref_primary_10_1016_j_cmpb_2024_108160 crossref_primary_10_1038_s41433_023_02724_4 crossref_primary_10_1001_jamadermatol_2019_3807 crossref_primary_10_1002_ima_22574 crossref_primary_10_1016_j_ophtha_2017_02_008 crossref_primary_10_1097_ICU_0000000000000791 crossref_primary_10_4103_IJO_IJO_2614_22 crossref_primary_10_1080_08820538_2020_1855358 crossref_primary_10_1007_s00347_020_01110_9 crossref_primary_10_3389_fmed_2025_1580583 crossref_primary_10_1097_ICU_0000000000000679 crossref_primary_10_1016_j_measen_2023_100951 crossref_primary_10_1007_s11831_022_09720_z crossref_primary_10_1097_ICU_0000000000000794 crossref_primary_10_1016_j_bspc_2024_106409 crossref_primary_10_1159_000502387 crossref_primary_10_1016_j_ophtha_2019_12_015 crossref_primary_10_1186_s40644_019_0227_3 crossref_primary_10_1155_2021_6651175 crossref_primary_10_1159_000546000 crossref_primary_10_22399_ijcesen_1971 crossref_primary_10_1007_s11042_022_12642_4 crossref_primary_10_1007_s11042_023_17784_7 crossref_primary_10_1007_s42835_024_01798_8 crossref_primary_10_3928_23258160_20210628_01 crossref_primary_10_4103_ijo_IJO_1754_19 crossref_primary_10_1109_ACCESS_2022_3157632 crossref_primary_10_1007_s11831_023_10003_4 crossref_primary_10_3390_jcm11174945 crossref_primary_10_3390_life12070973 crossref_primary_10_1097_APO_0000000000000301 crossref_primary_10_1007_s11042_023_15110_9 crossref_primary_10_1016_j_media_2022_102359 crossref_primary_10_1097_IAE_0000000000003282 crossref_primary_10_1016_j_cosrev_2019_100203 crossref_primary_10_2147_OPTH_S396537 crossref_primary_10_1177_19322968231215350 crossref_primary_10_1111_aos_13936 crossref_primary_10_1097_ICU_0000000000000693 crossref_primary_10_1007_s00417_017_3839_y crossref_primary_10_1016_j_media_2019_02_011 crossref_primary_10_1177_11206721241272229 crossref_primary_10_3389_fmed_2022_840498 crossref_primary_10_1038_s41467_021_23458_5 crossref_primary_10_1038_s41433_021_01415_2 crossref_primary_10_1080_08164622_2021_2022961 crossref_primary_10_1097_ICU_0000000000000695 crossref_primary_10_1016_j_imu_2024_101445 crossref_primary_10_1007_s11042_022_13837_5 crossref_primary_10_1016_j_patrec_2020_04_009 crossref_primary_10_1002_aisy_202000063 crossref_primary_10_1111_1753_0407_13241 crossref_primary_10_1186_s40942_024_00554_4 crossref_primary_10_1109_JBHI_2024_3384251 crossref_primary_10_1136_bmj_m3210 crossref_primary_10_3928_23258160_20211115_02 crossref_primary_10_1371_journal_pone_0179790 crossref_primary_10_3928_23258160_20211115_03 crossref_primary_10_1155_2023_3717035 crossref_primary_10_1177_1120672119857511 crossref_primary_10_1371_journal_pone_0217413 crossref_primary_10_1007_s11042_023_16449_9 crossref_primary_10_3389_fmed_2023_1293019 crossref_primary_10_1109_JBHI_2020_3040225 crossref_primary_10_1016_j_compbiomed_2017_09_008 crossref_primary_10_1007_s42600_023_00320_9 crossref_primary_10_1016_j_ophtha_2021_08_023 crossref_primary_10_1038_s41598_020_71622_6 crossref_primary_10_1136_bjophthalmol_2021_319618 crossref_primary_10_1080_08820538_2022_2139625 crossref_primary_10_3390_jpm14070690 crossref_primary_10_3390_electronics10172132 crossref_primary_10_1371_journal_pone_0283214 crossref_primary_10_1007_s00347_018_0752_7 crossref_primary_10_3233_JIFS_169963 crossref_primary_10_1016_j_compbiomed_2017_09_005 crossref_primary_10_1109_JBHI_2018_2795545 crossref_primary_10_1016_j_matpr_2022_02_162 |
| ContentType | Journal Article |
| DBID | AAYXX CITATION CGR CUY CVF ECM EIF NPM 7X8 |
| DOI | 10.1167/iovs.16-19964 |
| DatabaseName | CrossRef Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed MEDLINE - Academic |
| DatabaseTitle | CrossRef MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) MEDLINE - Academic |
| DatabaseTitleList | MEDLINE - Academic MEDLINE |
| Database_xml | – sequence: 1 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Medicine |
| EISSN | 1552-5783 |
| EndPage | 5206 |
| ExternalDocumentID | 27701631 10_1167_iovs_16_19964 |
| Genre | Multicenter Study Journal Article Comparative Study |
| GroupedDBID | --- 18M 2WC 34G 39C 5GY 5RE AAYXX ACGFO ACNCT ADBBV AENEX ALMA_UNASSIGNED_HOLDINGS BAWUL CITATION CS3 DIK DU5 E3Z EBS EJD F5P GROUPED_DOAJ GX1 N9A OK1 P2P RPM SJN TR2 TRV W8F WH7 WOQ WOW AFOSN CGR CUY CVF ECM EIF NPM 7X8 |
| ID | FETCH-LOGICAL-c398t-297cc4825c521de5e432c3d1270e65432386987b985b30324e46e18b7e8a90b53 |
| ISICitedReferencesCount | 719 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000392469600013&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1552-5783 |
| IngestDate | Thu Sep 04 15:39:13 EDT 2025 Thu Apr 03 06:55:52 EDT 2025 Sat Nov 29 03:45:41 EST 2025 Tue Nov 18 20:52:17 EST 2025 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 13 |
| Language | English |
| License | http://creativecommons.org/licenses/by-nc-nd/4.0 |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c398t-297cc4825c521de5e432c3d1270e65432386987b985b30324e46e18b7e8a90b53 |
| Notes | ObjectType-Article-2 SourceType-Scholarly Journals-1 ObjectType-Feature-1 content type line 23 |
| OpenAccessLink | https://doi.org/10.1167/iovs.16-19964 |
| PMID | 27701631 |
| PQID | 1835386255 |
| PQPubID | 23479 |
| PageCount | 7 |
| ParticipantIDs | proquest_miscellaneous_1835386255 pubmed_primary_27701631 crossref_citationtrail_10_1167_iovs_16_19964 crossref_primary_10_1167_iovs_16_19964 |
| PublicationCentury | 2000 |
| PublicationDate | 2016-10-01 |
| PublicationDateYYYYMMDD | 2016-10-01 |
| PublicationDate_xml | – month: 10 year: 2016 text: 2016-10-01 day: 01 |
| PublicationDecade | 2010 |
| PublicationPlace | United States |
| PublicationPlace_xml | – name: United States |
| PublicationTitle | Investigative ophthalmology & visual science |
| PublicationTitleAlternate | Invest Ophthalmol Vis Sci |
| PublicationYear | 2016 |
| SSID | ssj0021120 |
| Score | 2.681155 |
| Snippet | To compare performance of a deep-learning enhanced algorithm for automated detection of diabetic retinopathy (DR), to the previously published performance of... PURPOSETo compare performance of a deep-learning enhanced algorithm for automated detection of diabetic retinopathy (DR), to the previously published... |
| SourceID | proquest pubmed crossref |
| SourceType | Aggregation Database Index Database Enrichment Source |
| StartPage | 5200 |
| SubjectTerms | Algorithms Automation - methods Diabetic Retinopathy - diagnosis Diagnosis, Computer-Assisted - methods Diagnostic Techniques, Ophthalmological Female Follow-Up Studies Humans Male Middle Aged Neural Networks, Computer Ophthalmologists - education Retina - diagnostic imaging Retrospective Studies ROC Curve |
| Title | Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning |
| URI | https://www.ncbi.nlm.nih.gov/pubmed/27701631 https://www.proquest.com/docview/1835386255 |
| Volume | 57 |
| WOSCitedRecordID | wos000392469600013&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVAON databaseName: DOAJ Directory of Open Access Journals customDbUrl: eissn: 1552-5783 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0021120 issn: 1552-5783 databaseCode: DOA dateStart: 20160101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1bb9MwFLa6gRAvE3fKZTIS4qUEcrWdxwqGQIKJhwJ9ixzXZZGypGqTaPln-3kcx5dlaJPGAy9RlTp21PPV53w-N4ReAwVIyUrmHl0L34tBJXmcwB9P-oKJYC2pP3h0f36lx8dsuUy_TybnNhemK2lVsbOzdPNfRQ33QNgqdfYfxO0mhRvwGYQOVxA7XG8keH1MAHbkvG1qsEelCjVupLCmoY6BGeLnm6KqVUviXrkMuDnCK_vZvONFOeRUfeQNqLlmtjDtfL6Y6hJ2Lik3tkTr77GdOyrf0clZvTlpTnh5qus9KbB1xa616Zgj1OXace-f1rpYpAnqH0feq_bQ7aA4ir51Tx5tVX-JXqfsFM6xArS9WA3m8S8VklyNzzgC4qLl3LacAGWmuuWN3bd1YWuLz2i0Cye6-ukV6oEoB3VRd7t3ahHgevGFHrS-_7_UowtaHOgSoZl6PAtINjy-h26FNEmZJfOG6ge6IKh7b1vdldD3l1a_bA1dQ3EGU2dxDx0YjoLnGlv30URWD9CdbyYK4yHqLcSwgxh2EMP1GluI4RHEMHzFsYUYdhDDBmLYQAyPIDbMBRDDFmKP0I9PR4sPnz3TwsMTUcoaL0ypEDELEwFm4komMo5CEa1UuINUWc1gMJKU0TxlSQ7GVBjLmMiA5VQynvp5Ej1G-1VdyacIx5yrvtJsDSojDqngKyAfgtBcgrhlQKforf0pM2Hq26s2K2V2peCm6I0bvtGFXa4b-MrKJYOtV_nTeCXrFkYAe4H3B1I-RU-0wNxUIaWA4yh4dtNlnqO7F8h_gfabbStfotuia4rd9hDt0SU7HDD2B0v0skA |
| linkProvider | Directory of Open Access Journals |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Improved+Automated+Detection+of+Diabetic+Retinopathy+on+a+Publicly+Available+Dataset+Through+Integration+of+Deep+Learning&rft.jtitle=Investigative+ophthalmology+%26+visual+science&rft.au=Abr%C3%A0moff%2C+Michael+David&rft.au=Lou%2C+Yiyue&rft.au=Erginay%2C+Ali&rft.au=Clarida%2C+Warren&rft.date=2016-10-01&rft.issn=1552-5783&rft.volume=57&rft.issue=13&rft.spage=5200&rft_id=info:doi/10.1167%2Fiovs.16-19964&rft.externalDBID=n%2Fa&rft.externalDocID=10_1167_iovs_16_19964 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1552-5783&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1552-5783&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1552-5783&client=summon |