ophthalmologyОфтальмологияOphthalmology in Russia1816-50952500-0845Ophthalmology10.18008/1816-5095-2023-2-291-297ophthalmology-2109Research ArticleКЛИНИЧЕСКИЕ И ЭКСПЕРИМЕНТАЛЬНЫЕ ИССЛЕДОВАНИЯCLINICAL & EXPERIMENTAL RESEARCHКлиническая валидация программы диагностики угрожающей зрению диабетической ретинопатии на основе алгоритмов автоматической сегментацииClinical Validation of a Program for Diagnosing Vision-Threatening Diabetic Retinopathy Based on Automatic Segmentation Algorithmshttps://orcid.org/0000-0002-0759-3107ГабараевГ. М.GabaraevG. M.

Габараев Георгий Малхазович - врач-офтальмолог

Ореховый бульвар, 28, Москва, 115682, Российская Федерация

Gabaraev Georgii M. - ophthalmologist

Orekhovyy ave., 28, Moscow, 115682, Russian Federation

geor_gabaraev1@mail.ruПономареваЕ. Н.PonomarevaE. N.

Пономарева Елена Николаевна - заведующая отделением офтальмологии

Ореховый бульвар, 28, Москва, 115682, Российская Федерация

Ponomareva Elena N. - head of the Department of ophthalmology

Orekhovyy ave., 28, Moscow, 115682, Russian Federation

https://orcid.org/0000-0003-0057-3338ЛоскутовИ. А.LoskutovI. A.

Лоскутов Игорь Анатольевич - доктор медицинских наук, главный офтальмолог Московской области, руководитель офтальмологической службы;  заведующий научным отделом и кафедрой офтальмологии и оптометрии

ул. Щепкина, 61/2, Москва, 129110, Российская Федерация

Loskutov Igor A. - MD, chief ophthalmologist of the Moscow Region, head of the Ophthalmological Service, head of the Scientific department and the Department of ophthalmology and optometry

Shchepkina str., 61/2, Moscow, 129110, Russian Federation

https://orcid.org/0000-0002-5710-9205КаталевскаяЕ. А.KatalevskayaE. A.

Каталевская Евгения Алексеевна - кандидат, медицинских наук, врач-офтальмолог; медицинский директор проекта Retina AI

ул. Центральная, 8б, комн. 605, п. Внуково, Москва, 119027, Российская Федерация

Katalevskaya Evgenia A. - PhD, ophthalmologist, medical director of the Retina AI project

Tsentralnaya str., 8b, room 605, Vnukovo village, Moscow, 119027, Russian Federation

https://orcid.org/0000-0002-7770-575XХабазоваМ. Р.KhabazovaM. R.

Хабазова Маргарита Робертовна - врач-офтальмолог

Ореховый бульвар, 28, Москва, 115682, Российская Федерация

Khabazova Margarita R. - ophthalmologist

Orekhovyy ave., 28, Moscow, 115682, Russian Federation

ФГБУ «Федеральный научно-клинический центр специализированных видов медицинской помощи и медицинских технологий Федерального медико-биологического агентства»РоссияFederal Scientific and Clinical Center for Specialized Types of Medical Care and Medical Technologies of the Federal Medical and Biological AgencyRussian FederationГБУЗ Московской области «Московский областной научно-исследовательский клинический институт им. М.Ф. Владимирского»РоссияMoscow Regional Research Clinical Institute named after M.F. VladimirskyRussian FederationООО «Дидижитал Вижн Солюшнс», проект Retina AIРоссияDigital Vision Solutions LLC, Retina AI projectRussian Federation202301072023202291297Copyright © Габараев Г.М., Пономарева Е.Н., Лоскутов И.А., Каталевская Е.А., Хабазова М.Р., 20232023Габараев Г.М., Пономарева Е.Н., Лоскутов И.А., Каталевская Е.А., Хабазова М.Р.Gabaraev G.M., Ponomareva E.N., Loskutov I.A., Katalevskaya E.A., Khabazova M.R.Данная работа распространяется под лицензией Creative Commons Attribution 4.0.This work is licensed under a Creative Commons Attribution 4.0 License.https://www.ophthalmojournal.com/opht/article/view/2109Цель исследования

Цель исследования: апробация программного обеспечения (ПО) на основе алгоритмов автоматической сегментации признаков ДР «Retina AI» в клинической практике, изучение возможностей ПО «Retina AI» в диагностике, угрожающей зрению ДР.

Методы

Методы. Проведен анализ клинических данных, полученных от пациентов, проходивших диагностику и лечение в Федеральном научно-клиническом центре специализированных видов медицинской помощи и медицинских технологий ФМБА России и Московском областном научно-исследовательском клиническом институте им. М.Ф. Владимирского. Проанализировано 123 фундус-фотографии глазного дна при помощи платформы RETINA.AI. Фундус-фотографирование проводилось с помощью фундус-камеры VISUCAM 500 (Zeiss).

Результаты

Результаты. В процессе анализа фундус-фотографий алгоритмами Retina AI выявлена высокая эффективность автоматической детекции ретинопатии, угрожающей зрению. Точность метода в диагностике угрожающей зрению ДР составила 95 %, чувствительность — 96,59 %, специфичность — 91,4 %, ROC AUC — 0,94.

Заключение

Заключение. Программа диагностики ДР на основе алгоритмов автоматической сегментации представляет собой инструмент решения проблемы скрининга ДР.

Background

Background. Diabetic retinopathy is a very common, debilitating disease that requires early diagnosis and treatment. The development of new screening methods is a priority area of medicine in recent years. Purpose: Approbation of the software (SW) based on algorithms for automatic segmentation of signs of DR “Retina AI” in clinical practice, the study of the capabilities of the software “Retina AI” in the diagnosis of vision-threatening DR.

Methods

Methods. Analysis of clinical data obtained from patients undergoing diagnostics and treatment at the Federal Research and Clinical Center for Specialized Types of Medical Care and Medical Technologies of the Federal Medical and Biological Agency of Russia and the Moscow Regional Scientific Research Clinical Institute. 123 photographs of the fundus were analyzed using the RETINA.AI platform. Fundus photography was carried out using a fundus camera VISUCAM 500 (Zeiss).

Results

Results. In the process of analyzing fundus photographs with Retina AI algorithms, a high efficiency of automatic detection of vision-threatening retinopathy was revealed. The accuracy of the method in diagnosing vision-threatening DR was 95 %, sensitivity — 96.59 %, specificity — 91.4 %, ROC AUC — 0.94.

Conclusion

Conclusion. The DR diagnostic program based on adaptive segmentation algorithms is a tool for solving the DR screening problem.

диабетическая ретинопатияискусственный интеллектскринингугрожающая зрению диабетическая ретинопатияRETINA.AIdiabetic retinopathyartificial intelligencescreeningsight-threatening diabetic retinopathyRETINA.AIReferencesStitt AW, Curtis TM, Chen M, Medina RJ, McKay GJ, Jenkins A, Gardiner TA, Lyons TJ, Hammes HP, Simo R, Lois N. The progress in understanding and treatment of diabetic retinopathy. Prog Retin Eye Res. 2016 Mar;51:156–186. doi: 10.1016/j.preteyeres.2015.08.001.Stitt AW, Curtis TM, Chen M, Medina RJ, McKay GJ, Jenkins A, Gardiner TA, Lyons TJ, Hammes HP, Simo R, Lois N. The progress in understanding and treatment of diabetic retinopathy. Prog Retin Eye Res. 2016 Mar;51:156–186. doi: 10.1016/j.preteyeres.2015.08.001.Teo ZL, Tham YC, Yu M, Chee ML, Rim TH, Cheung N, Bikbov MM, Wang YX, Tang Y, Lu Y, Wong IY, Ting DSW, Tan GSW, Jonas JB, Sabanayagam C, Wong TY, Cheng CY. Global Prevalence of Diabetic Retinopathy and Projection of Burden through 2045: Systematic Review and Meta-analysis. Ophthalmology. 2021 Nov;128(11):1580–1591. doi: 10.1016/j.ophtha.2021.04.027.Teo ZL, Tham YC, Yu M, Chee ML, Rim TH, Cheung N, Bikbov MM, Wang YX, Tang Y, Lu Y, Wong IY, Ting DSW, Tan GSW, Jonas JB, Sabanayagam C, Wong TY, Cheng CY. Global Prevalence of Diabetic Retinopathy and Projection of Burden through 2045: Systematic Review and Meta-analysis. Ophthalmology. 2021 Nov;128(11):1580–1591. doi: 10.1016/j.ophtha.2021.04.027.Nei. Nih. Gov. Diabetic Retinopathy Tables 2020). URL: https://www.nei.nih.gov/learn-about-eye-health/eye-health-data-and-statistics/diabetic-retinopathy-dataand-statistics/diabetic-retinopathy-tables (accessed 15.02.2023).Nei. Nih. Gov. Diabetic Retinopathy Tables 2020). URL: https://www.nei.nih.gov/learn-about-eye-health/eye-health-data-and-statistics/diabetic-retinopathy-dataand-statistics/diabetic-retinopathy-tables (accessed 15.02.2023).Охджи М., Лоскутов ИА, ред. Хирургические заболевания сетчатки: руководство для врачей. М.: ГЭОТАР-Медиа, 2021. 128 с.Okhdzhi M, Loskutov IA, eds. Surgical diseases of the retina: a guide for physicians. Moscow: GEOTAR-Media, 2021. 128 p. (In Russ.).ICO Guidelines for Diabetic Eye Care. 2017. URL: https://www.urmc.rochester.edu/MediaLibraries/URMCMedia/eye-institute/images/ICOPH.pdf (accessed 10.02.2023).ICO Guidelines for Diabetic Eye Care. 2017. URL: https://www.urmc.rochester.edu/MediaLibraries/URMCMedia/eye-institute/images/ICOPH.pdf (accessed 10.02.2023).Лоскутов ИА, Хомякова ЕН. Диабетическая ретинопатия, диабетический макулярный отек — как достичь регресса: руководство для врачей. М.: ГЭОТАР-Медиа, 2023.Loskutov IA, Khomyakova EN. Diabetic retinopathy, diabetic macular edema — how to achieve regression: a guide for physicians. Moscow: GEOTAR-Media, 2023 (In Russ.).Schmidt-Erfurth U, Garcia-Arumi J, Bandello F, Berg K, Chakravarthy U, Gerendas BS, Jonas J, Larsen M, Tadayoni R, Loewenstein A. Guidelines for the Management of Diabetic Macular Edema by the European Society of Retina Specialists (EURETINA). Ophthalmologica. 2017;237(4):185–222. doi: 10.1159/000458539.Schmidt-Erfurth U, Garcia-Arumi J, Bandello F, Berg K, Chakravarthy U, Gerendas BS, Jonas J, Larsen M, Tadayoni R, Loewenstein A. Guidelines for the Management of Diabetic Macular Edema by the European Society of Retina Specialists (EURETINA). Ophthalmologica. 2017;237(4):185–222. doi: 10.1159/000458539.Ikram M, Xie J, Cotch MF. Vision-threatening diabetic retinopathy and incident cardiovascular disease: a systematic review and meta-analysis. Investigative ophthalmology & visual science. 2013;54(15):2174.Ikram M, Xie J, Cotch MF. Vision-threatening diabetic retinopathy and incident cardiovascular disease: a systematic review and meta-analysis. Investigative ophthalmology & visual science. 2013;54(15):2174.Kaushik M, Nawaz S, Qureshi TS. Profile of sight-threatening diabetic retinopathy and its awareness among patients with diabetes mellitus attending a tertiary care center in Kashmir, India. Indian J Ophthalmol. 2021 Nov;69(11):3123–3130. doi: 10.4103/ijo.IJO_831_21.Kaushik M, Nawaz S, Qureshi TS. Profile of sight-threatening diabetic retinopathy and its awareness among patients with diabetes mellitus attending a tertiary care center in Kashmir, India. Indian J Ophthalmol. 2021 Nov;69(11):3123–3130. doi: 10.4103/ijo.IJO_831_21.Alemu Mersha G, Tsegaw Woredekal A, Tilahun Tesfaw M. Sight-threatening Diabetic Retinopathy and Associated Risk Factors Among Adult Diabetes Patients at Debre Tabor General Hospital, Northwest Ethiopia. Clin Ophthalmol. 2020 Dec 30;14:4561–4569. doi: 10.2147/OPTH.S285606.Alemu Mersha G, Tsegaw Woredekal A, Tilahun Tesfaw M. Sight-threatening Diabetic Retinopathy and Associated Risk Factors Among Adult Diabetes Patients at Debre Tabor General Hospital, Northwest Ethiopia. Clin Ophthalmol. 2020 Dec 30;14:4561–4569. doi: 10.2147/OPTH.S285606.Bragge P, Gruen RL, Chau M, Forbes A, Taylor HR. Screening for presence or absence of diabetic retinopathy: a meta-analysis. Arch Ophthalmol. 2011 Apr;129(4):435–444. doi: 10.1001/archophthalmol.2010.319.Bragge P, Gruen RL, Chau M, Forbes A, Taylor HR. Screening for presence or absence of diabetic retinopathy: a meta-analysis. Arch Ophthalmol. 2011 Apr;129(4):435–444. doi: 10.1001/archophthalmol.2010.319.Amoaku WM, Ghanchi F, Bailey C, Banerjee S, Banerjee S, Downey L, Gale R, Hamilton R, Khunti K, Posner E, Quhill F, Robinson S, Setty R, Sim D, Varma D, Mehta H. Diabetic retinopathy and diabetic macular oedema pathways and management: UK Consensus Working Group. Eye (Lond). 2020 Jun;34(Suppl 1):1–51. doi: 10.1038/s41433-020-0961-6. Erratum in: Eye (Lond). 2020 Oct;34(10):1941–1942.Amoaku WM, Ghanchi F, Bailey C, Banerjee S, Banerjee S, Downey L, Gale R, Hamilton R, Khunti K, Posner E, Quhill F, Robinson S, Setty R, Sim D, Varma D, Mehta H. Diabetic retinopathy and diabetic macular oedema pathways and management: UK Consensus Working Group. Eye (Lond). 2020 Jun;34(Suppl 1):1–51. doi: 10.1038/s41433-020-0961-6. Erratum in: Eye (Lond). 2020 Oct;34(10):1941–1942.Липатов ДВ, Викулова ОК, Железнякова АВ, Исаков МА, Бессмертная ЕГ, Толкачева АА, Чистяков ТА, Шестакова МВ, Дедов ИИ. Эпидемиология ДР в РФ по данным Федерального регистра пациентов с сахарным диабетом (2013–2016 гг.). Сахарный диабет. 2018;21(4):230–240. doi: 10.14341/DM9797.Lipatov DV, Vikulova OK, Zheleznyakova AV, Isakov MA, Bessmertnaya EG, Tolkacheva AA, Chistyakov TA, Shestakova MV, Dedov II. Epidemiology of DR in the Russian Federation according to the Federal Register of Patients with Diabetes Mellitus (2013–2016). Diabetes. 2018;21(4):230–240 (In Russ.). doi: 10.14341/DM9797.Нероев ВВ, Брагин АА, Зайцева ОВ. Разработка прототипа сервиса для диагностики диабетической ретинопатии по снимкам глазного дна с использованием методов искусственного интеллекта. Национальное здравоохранение. 2021;2(2): 64–72. doi: 10.47093/2713-069X.2021.2.2.64-72.Neroev VV, Bragin AA, Zaitseva OV. Development of a prototype service for the diagnosis of diabetic retinopathy based on fundus images using artificial intelligence methods. National Health. 2021;2(2):64–72 (In Rus.). doi: 10.47093/2713-069X.2021.2.2.64-72.Mateen M, Wen J, Hassan M, Nasrullah N, Sun S, Hayat S. Automatic detection of diabetic retinopathy: a review on datasets, methods and evaluation metrics. IEEE Access. 2020;8:48784 –48811. doi: 10.1109/ACCESS.2020.2980055.Mateen M, Wen J, Hassan M, Nasrullah N, Sun S, Hayat S. Automatic detection of diabetic retinopathy: a review on datasets, methods and evaluation metrics. IEEE Access. 2020;8:48784 –48811. doi: 10.1109/ACCESS.2020.2980055.Ming S, Xie K, Lei X, Yang Y, Zhao Z, Li S, Jin X, Lei B. Evaluation of a novel artificial intelligence-based screening system for diabetic retinopathy in community of China: a real-world study. Int Ophthalmol. 2021 Apr;41(4):1291–1299. doi: 10.1007/s10792-020-01685-x.Ming S, Xie K, Lei X, Yang Y, Zhao Z, Li S, Jin X, Lei B. Evaluation of a novel artificial intelligence-based screening system for diabetic retinopathy in community of China: a real-world study. Int Ophthalmol. 2021 Apr;41(4):1291–1299. doi: 10.1007/s10792-020-01685-x.Каталевская ЕА, Каталевский ДЮ, Тюриков МИ, Велиева ИА, Большунов АВ. Перспективы использования искусственного интеллекта в диагностике и лечении заболеваний сетчатки. РМЖ. Клиническая офтальмология. 2022;22(1):36–43. doi: 10.32364/2311-7729-2022-22-1-36-43.Katalevskaya EA, Katalevskii DYu, Tyurikov MI, Velieva IA, Bol’shunov AV. Prospects for the use of artificial intelligence in the diagnosis and treatment of retinal diseases. Russian Journal of Clinical Ophthalmology. 2022;22(1):36–43 (In Russ.). doi: 10.32364/2311-7729-2022-22-1-36-43.IDx-DR (EU) — Digital Diagnostics. URL: https://www.digitaldiagnostics.com/products/eye-disease/idx-dr/ (accessed 19.11.2022).IDx-DR (EU) — Digital Diagnostics. URL: https://www.digitaldiagnostics.com/products/eye-disease/idx-dr/ (accessed 19.11.2022).EyeArt — Eyenuk, Inc. ~ Artificial Intelligence Eye Screening. URL: https://www.eyenuk.com/en/products/eyeart/ (accessed 19.11.2022).EyeArt — Eyenuk, Inc. ~ Artificial Intelligence Eye Screening. URL: https://www.eyenuk.com/en/products/eyeart/ (accessed 19.11.2022).Ipp E, Liljenquist D, Bode B, Shah VN, Silverstein S, Regillo CD, Lim JI, Sadda S, Domalpally A, Gray G, Bhaskaranand M, Ramachandra C, Solanki K; EyeArt Study Group. Pivotal Evaluation of an Artificial Intelligence System for Autonomous Detection of Referrable and Vision-Threatening Diabetic Retinopathy. JAMA Netw Open. 2021 Nov 1;4(11):e2134254. doi: 10.1001/jamanetworkopen.2021.34254. Erratum in: JAMA Netw Open. 2021 Dec 1;4(12):e2144317.Ipp E, Liljenquist D, Bode B, Shah VN, Silverstein S, Regillo CD, Lim JI, Sadda S, Domalpally A, Gray G, Bhaskaranand M, Ramachandra C, Solanki K; EyeArt Study Group. Pivotal Evaluation of an Artificial Intelligence System for Autonomous Detection of Referrable and Vision-Threatening Diabetic Retinopathy. JAMA Netw Open. 2021 Nov 1;4(11):e2134254. doi: 10.1001/jamanetworkopen.2021.34254. Erratum in: JAMA Netw Open. 2021 Dec 1;4(12):e2144317.Abramoff MD, Lavin PT, Birch M, Shah N, Folk JC. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. NPJ Digit Med. 2018 Aug 28;1:39. doi: 10.1038/s41746-018-0040-6.Abramoff MD, Lavin PT, Birch M, Shah N, Folk JC. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. NPJ Digit Med. 2018 Aug 28;1:39. doi: 10.1038/s41746-018-0040-6.Bellemo V, Lim ZW, Lim G, Nguyen QD, Xie Y, Yip MYT, Hamzah H, Ho J, Lee XQ, Hsu W, Lee ML, Musonda L, Chandran M, Chipalo-Mutati G, Muma M, Tan GSW, Sivaprasad S, Menon G, Wong TY, Ting DSW. Artificial intelligence using deep learning to screen for referable and vision-threatening diabetic retinopathy in Africa: a clinical validation study. Lancet Digit Health. 2019 May;1(1):e35–e44. doi: 10.1016/S2589-7500(19)30004-4.Bellemo V, Lim ZW, Lim G, Nguyen QD, Xie Y, Yip MYT, Hamzah H, Ho J, Lee XQ, Hsu W, Lee ML, Musonda L, Chandran M, Chipalo-Mutati G, Muma M, Tan GSW, Sivaprasad S, Menon G, Wong TY, Ting DSW. Artificial intelligence using deep learning to screen for referable and vision-threatening diabetic retinopathy in Africa: a clinical validation study. Lancet Digit Health. 2019 May;1(1):e35–e44. doi: 10.1016/S2589-7500(19)30004-4.Rogers TW, Gonzalez-Bueno J, Garcia Franco R, Lopez Star E, Mendez Marin D, Vassallo J, Lansingh VC, Trikha S, Jaccard N. Evaluation of an AI system for the detection of diabetic retinopathy from images captured with a handheld portable fundus camera: the MAILOR AI study. Eye (Lond). 2021 Feb;35(2):632–638. doi: 10.1038/s41433-020-0927-8.Rogers TW, Gonzalez-Bueno J, Garcia Franco R, Lopez Star E, Mendez Marin D, Vassallo J, Lansingh VC, Trikha S, Jaccard N. Evaluation of an AI system for the detection of diabetic retinopathy from images captured with a handheld portable fundus camera: the MAILOR AI study. Eye (Lond). 2021 Feb;35(2):632–638. doi: 10.1038/s41433-020-0927-8.

The authors declare that there are no conflicts of interest present.