Abstract
Artificial intelligence (AI) and machine learning (ML) were part of science fictions a decade before. But with ever evolving technology AI has made its way in our daily lives. AI also has brought paradigm shift in healthcare. Ophthalmology is a lucrative speciality for AI application as lot of imaging modality is being used to make diagnostic and therapeutic decisions. The application of AI in ophthalmology mainly focusses on disease with high incidence like diabetic retinopathy, age related macular degeneration, glaucoma, retinopathy of prematurity and cataract. In this review the current application of AI and its prospects is discussed in the ophthalmic practice.
Keywords: Artificial Intelligence; Ophthalmology; Diabetic Retinopathy; Cataract; Deep Learning; Machine Learning
Introduction
In this technology driven era, where does artificial intelligence (AI) stand in our daily personal and professional lives? The machines haven’t taken over yet and may never be able to outsmart their creators but indeed they have seeped their way in our daily lives. Most common examples are voice powered personal assistant “Siri”, “Alexa” and “Google assistant”; with “Tesla” rolling out cars with predictive capabilities, self-driving features; “Pandora” with musical DNA and “Nest”, the thermostat by Google. AI has become an indispensable tool to better our daily lives. AI has already shown proof of concept in medical fields rooted in diagnostic imaging like radiology, pathology and dermatology. Ophthalmology also relies heavily on imaging like colour fundus photography, optical coherence tomography (OCT) and anterior segment photograph [1]. The advantages of AI in medicine are manifold. In ophthalmology it can assist in clinical practice to detect and learn features from large images, help to reduce diagnostic error. It can also help in providing personalized medicine. It can help us gain innovative scientific insight by recognizing disease specific patterns [2]. AI may also pave way for cost efficient telemedicine screening programs worldwide. The global estimated mean for ophthalmologist density is dismal and was estimated to be 31.7 per million populations [3]. The number of ophthalmologists is growing at half the rate of our population aged over 60 years, and there are 23 countries with less than one ophthalmologist per million population [4]. Various studies have demonstrated successful virtual clinic for various retinal disorders and glaucoma screening [5,6].
Understanding Artificial Intelligence
What really is AI? Artificial intelligence is the broadest term encompassing machine leaning and deep learning. In simple terms AI is human like intelligence which a machine or computer acquires through various modalities. The term “artificial intelligence” was first coined by John McCarthy in 1955 [7]. He described it as ‘the science and engineering of making intelligent machines. AI comprises of machine machine learning (ML), deep learning (DL), conventional machine learning (CML), natural language processing, computer vision, robotics, reasoning, general intelligence, expert system, automated learning, and scheduling [8].
Machine Learning
Machine learning (ML) is a subset of AI that enables computers to learn on their own with experience. Arthur Samuel, recognised as pioneer of ML, defined it as ‘field of study that gives computers the ability to learn without being explicitly programmed and has the ability to automatically learn’ [9]. Therefore, machine learning is an ever evolving phenomenon.
Deep Learning
DL refers to machine learning which employs convolutional based neural networks (CNNs). It involves multiple levels of abstraction to process the input data without the need for manual feature engineering automatically and then the intricate structure is recognised through projection onto a lower dimensional manifold [10]. In conventional machine learning input image is classified from hand engineered features whereas in deep learning the features are both extracted and classified from the input directly allowing for fully end to end learning [11].
AI in Ophthalmic Practice: Where do we stand?
AI based algorithm has been widely investigated and published in diseases like diabetic retinopathy (DR), age related macular degeneration (AMD), cataract, refractive error, glaucoma, keratoconus and retinopathy of prematurity (ROP).
AI in Retina
In ophthalmic practice diagnosis in retina is heavily relied on color fundus photography and optical coherence tomography. These diagnostic tools allow non-invasive imaging of retinal vasculature and optic nerve head. Thus, the ample imaging in retina makes it a lucrative area of application of AI.
Diabetic Retinopathy
According to the International Diabetes Federation approximately 425 million people suffer from diabetes. The prevalence of diabetic retinopathy is approximately 28.5% in the United States and 18% in India [12,13]. Early detection and prompt treatment remain the mainstay for prevention of visual disability and effectively decreases the burden by 90%. In the current era, ophthalmologists screen the patients for DR but various logistical barrier, lack of trained ophthalmologist and cost of visit may limit the patients from getting the screening done. The other suggested way of addressing these issues are obtaining the colour fundus photo and sending it to ophthalmologist and optometrist to read the image thereby increasing the screening but involves time delay [14]. The limitations can be overcome by automated AI based grading systems. In April 2018, the US Food and Drug Administration (FDA) has approved an AI. AI algorithm, developed by IDx, used with Topcon Fundus camera (Topcon Medical) for DR identification [15- 22]. Various studies have been outlined in Table 1.
IDx-DR: It is the first FDA approved AI algorithm for detection of DR and is paired with non-mydriatic retinal camera (TRCNW400, Topcon). It can be used in the office of non-ophthalmic healthcare practitioners. The captured images are sent to a cloudbased server. The IDx-DR uses a deep learning algorithm to detect retinal findings suggestive of DR. The software provides either of the two results: (1) If more than mild DR detected, refer to an eyecare professional (ECP); (2) If the results are negative for more than mild DR, rescreen in 12 months [23]. The FDA approval was based on a study involving 900 subjects in a primary care setting with automated image analysis of two 45-degree digital image based on optic nerve. The images were compared with the stereo, wide field fundus imaging interpreted by the Wisconsin Fundus Photograph Reading Centre (FPRC). AI was able to make a diagnosis in just 20 second after procurement of retinal images. A new entity minimal DR (mtmDR) was defined [24]. Various AI algorithm developed for DR screening like Google AI, EyeArt and IDxDR work on platform based on cloud [16,17,20,25]. The AI algorithm by Medios Technologies (Singapore) is the first offline software for DR screening integrated with the smart phone-based fundus camera, the Remidio non-mydriatic (NM) fundus-on-phone (FOP) [26]. The sensitivity and specificity of the AI algorithm in detecting referable DR (RDR) was 93% (95% CI 91.3% to 94.7%) and 92.5% (95% CI 90.8% to 94.2%) in Indian population [27].
AI in AMD
Approximately 288 million patients have been projected to
suffer from AMD by 2040 and 10% of them will have intermediate
AMD or worse [28,29]. There is an urgent clinical need to have a
robust DL system to cater to the geriatric population to screen them
for AMD and to further facilitate evaluation in tertiary care centres.
Ting et al reported a clinically acceptable DL system diagnostic
performance in detecting referable AMD [19]. The DL system was
trained and tested using 108 558 retinal images from 38 189
patients bur this being primarily a DR centred study few patients
of referable AMD was present. Fovea-centred images without
macula segmentation were used in this study. Burlina et al.
reported a diagnostic accuracy of between 88.4% and 91.6%, with
an AUC of between 0.94 and 0.96 [30]. In this study macula was
presegmented. Grassmann et al reported a sensitivity of 84.2% in
the detection of any AMD [31]. All three abovementioned studies
did not have any results for external validation on the individual DL
systems. A predictive model also differentiated converting versus
non converting eyes with a performance of 0.68 and 0.80 for CNV
and GA, respectively [32].
Finally, AI is being studied as a support to therapy decisionmaking
in AMD. Prahs et al. looked at AI to support therapy
decisions for intravitreal injection and found that the deep CNN
was able to correctly predict the need for anti-VEGF therapy in 95%
of cases [33]. Schlegl et al. also designed an MLC using 1200 OCT
images with a mean accuracy of 0.94 and an AUROC of 0.92 [34].
AI in Other Retinal Condition
In 2018 DeepMind applied DL algorithm to OCT and successfully developed a model which automatically segmented tissue layers. The model achieved a diagnostic performance meeting and exceeding those of human expert graders for 50 common retinal conditions. This has paved a way for implementation in a realworld clinical pathway; the rapid access ‘virtual’ clinics that are now widely used for triaging of macular disease in the UK [5]. In the longer term, the system can be utilised by optometrist too, as OCT has become a common tool, in triaging the patient outside hospitals in community.
AI in Glaucoma
Glaucoma requires lifelong treatment and monitoring and is the second largest cause of irreversible blindness worldwide primarily affecting the elderly. It is projected that nearly 79.6million people will have glaucoma by 2020 [35,36]. The first aim is detection of glaucoma based on: classification of visual fields, optic nerve imaging or other clinical data. The second aim is to detect worsening earlier than conventional algorithms available. The last but not the least being able to study risk factors for glaucoma and quality of life based on AI models. Li et al. [37] and Ting et al. [19] trained computer algorithms to detect the glaucoma-like disc. Machine learning methods have been applied to distinguish glaucomatous nerve fibre layer damage from normal scans on wide-angle OCTs [38]. Elze et al. [39] developed an unsupervised computer program to analyse VF that recognises clinically relevant VF loss patterns and assigns a weighting coefficient for each of them and has proven useful in the detection of early VF loss from glaucoma [40]. Computer programs to detect VF progression exist along with sectoral VF analysis. But these approaches are often not aligned with clinical ground truth nor with one another [41,42]. Yousefi et al developed a machine-based algorithm that detected VF progression earlier than these conventional strategies [43]. More machine learning algorithms that provide quantitative information about regional VF progression can be expected in the future.
AI in Cataract
Cataract is the leading cause of visual impairment worldwide,
accounting for 65.2 million cases of vision impairment and
blindness globally [44]. These numbers are projected to increase
to 70.5 million by 2020 worldwide as the population will age and
therefore, they remain an important health concern. Various AI
studies have been outlined in Table 2 [45-51]. Wu et al. utilized
deep learning using residual neural network (ResNet) to establish
a 3-step sequential AI algorithm for the diagnosis and referral of
cataracts [48]. First, in the capture mode recognition phase, the
AI system would first differentiate slit lamp photographs between
mydriatic and nonmydriatic images, and between optical section
and diffuse slit-lamp illumination. The second step would involve
categorization of image into either normal (ie, no cataract),
cataractous, or postoperative IOL. The third step would entail
evaluation of type and severity of cataract based on the Lens
Opacities Classification System II scale. A decision would be made
whether to follow-up or refer the patient for tertiary care would be
derived.
The system was validated using 37,638 photographs (18,819
eyes) from a Chinese cataract screening program, the AI achieved
area under the receiver-operating characteristic curve (AUC)
of >99% for both steps 1 and 2, AUCs for evaluation of cataract
severity (step 3) were most optimal using mydriatic images with
optical sections (AUC 0.9915) and least optimal using nonmydriatic
images with diffuse illumination (AUC 0.9328), whereas AUCs for
referral accuracy were highest for pediatric cataracts with visual
axis involvement (AUC 1.00), and lowest for posterior capsular
opacification with visual axis involvement (AUC 0.919). This AI
algorithm was put on trial as part of a web- based platform, in a
pilot study conducted in the Yuexiu district of Guangzhou, China. On
comparing with ophthalmologist’s final diagnosis, sensitivity and
specificity of the algorithm for cataract detection were 92.00% and
83.85%, respectively. Based on results of pilot study, the authors
proposed to switch the first “point- of-care” from ophthalmologists
to community-based health care facilities based on AI algorithm.
Further AI is being used in IOL power calculation. A new machine
learning technique by Gonzalez et al showed that the SD of the
prediction error in order of lowest to highest was the new method
(designated Karmona) (0.30), Haigis (0.36), Holladay 2 (0.38),
Barrett Universal II (0.38), and Hill-RBF v2.0 (0.40). Using the
Karmona method, 90.38% and 100% of eyes were within ±0.50 and
±1.00 D respectively [52].
AI for Corneal Diseases
Keratoconus being a progressive disease has attracted the attention of AI developers to detect it at the earliest. This can help in better preservation of vision in these patients. Also, with an increase in number of refractive surgeries the number of iatrogenic keratectasias is on the rise because of possible biomechanics failure which we were unable to pick before surgery. So to identify these susceptible corneas various AI models have been developed (Table 1). In diabetic sensorimotor polyneuropathy with introduction of neural network and random forest models, the nerve can be fully segmented, and morphology can be studied hence allowing the development of an objective and precise method to early characterise the disease [53,54]. AI models can predict early graft dislocation based on larger residual interface fluid following refractive surgery [55]. Identifying subclinical corneal ectasia is challenging but the topography and tomography provides data to the ophthalmologist for every cornea, but still subclinical keratoconus remains a diagnostic challenge. Often a decision is often made by individual ophthalmologist’s subjective interpretation of patterns or empiric cut-off values, which vary from machine to machine thus is unreliable and time consuming. In this scenario AI could provide an alternative solution to recognising those patients most at risk and diagnosing subclinical ectasias (Table 3) [56-60].
AI in Paediatric Ophthalmology
Retinopathy of Prematurity (ROP)
It is intuitive to expect that AI in ROP has a colossal potential. ROP compared to DR is relatively limited by retinal findings but the complexity lies in the urgency of intervention in treatable ROP and in the management of systemic comorbidity in a neonate compared to adults with DR. Several semi-automated AI tools like Vessel Finder [61], VesselMap [62], ROPtool [63], Retinal Image multiScale Analysis [64-66] , Computer- Aided Image Analysis of the Retina [67,68], and IVAN [67,69] have been studied. These CNN models accurately assessed retinal fundus image quality in ROP in a manner comparable with the experts. The i-ROP deep learning [70] and DeepROP system [71] have been found to accurately identify diagnostic categories and overall disease severity in an automated fashion. This iROP DL system has only been trained on posterior pole vascular morphology. The data provides a proof to concept that a deep learning system can be used in an automated fashion to diagnose ROP. These tools when incorporated in successful tele ROP programs can be revolutionary as it will help in early and rapid triage of infants needing treatment even in rural areas. AI in ROP is going to have a tremendous impact in a country like India where preterm births have crossed 3.5 million mark annually more than any other country. Estimated 215 specialist that is even less than 1% of the ophthalmologists are engaged in ROP services directly. AI seems to provide us with the solutions and mend road ahead for optimal ROP care
Eye as a Window
For long philosophers has defined the eye as a window to the soul before scientists addressed this cliché to prove its scientific basis and clinical relevance. Recent work has applied DNN on retinal OCT and fundus images for assessing age, gender, systolic blood pressure, smoking status, haemoglobin A1c, and likelihood of having a major adverse cardiac event. The AUC for gender was found to be 0.97 while the others were in the range of 0.70. This suggests that through further advancements many more information can be gathered by these images using AI based algorithms [72]. AI has widespread application in ophthalmological practice. AI still is in its stage of infancy. There are three main limitation of AI which needs consideration [73]. Usually, the studies use homogenous population data as training data sets. This leads to their questionable generalisation in diverse population and different ethnicity. The second pitfall being the “black box” nature of the AI where the physician is not able to understand the algorithm being used. This leads to trust issues with the AI platforms. The third being the power calculation done for an independent data sets used in these studies. This brings a questionable calibration of the algorithm being used in these AI platforms. In addition, the medico-legal aspects and the regulatory approvals vary in different countries and need to be addressed.
Nonetheless, with development of the Eye Grader clinician interface a new era has ushered where an immediate grading report for clinicians are generated in an integrated and automated fashion that can function both online and offline. Eye Grader has been designed to grade for four common blinding eye diseases including referable DR, suspect glaucoma, wet AMD, and cataract. The feasibility and acceptability of the Eye Grader system has been pilot-tested in real-world settings in Australia with great success and commendable patient satisfaction [74]. These AI systems will help bridge the significant patient doctor ratio gap. Even the patient in remote areas would be able to access the specialised healthcare system. The AI platforms also will enable health care providers like physicians and endocrinologist, who are first point contact in systemic diseases, to perform screening procedures in their patient at the earliest. Even non eye health care professional would be able to actively involved in the screening and diagnosis in the early stage of disease. This in turn will lead to timely diagnosis and treatment thereby bringing down the burden of visual impairment and blindness.
Conclusion
AI is the next big leap in ophthalmology. With combined clinical skill of ophthalmologists and AI platforms the medicine field is all set for the next big revolution. The long lived dream of medical care for everyone, at every doorstep has been an ever alluding dream since long but with each passing day we are inching closer to get this dream fulfilled with mankind’s one of the great invention “AI”.
Acknowledgement
None.
Conflict of Interest
No conflict of interest.
References
- Jiang F, Jiang Y, Zhi H, Dong Y, Li H, et al. (2017) Artificial intelligence in healthcare: past, present and future. Stroke and vascular neurology 2(4): 230-243.
- Schmidt-Erfurth U, Sadeghipour A, Gerendas BS, Waldstein SM, Bogunović H (2018) Artificial intelligence in retina. Prog Ret Eye Res 67: 1-29.
- Resnikoff S, Lansingh VC, Washburn L, Felch W, Gauthier TM, et al. (2019) Estimated number of ophthalmologists worldwide (International Council of Ophthalmology update): will we meet the needs? Br J Ophthalmol pp. 314336.
- Resnikoff S, Felch W, Gauthier TM, Spivey B (2012) The number of ophthalmologists in practice and training worldwide: a growing gap despite more than 200 000 practitioners. Br J Ophthalmol 96: 783-787.
- Kortuem K, Fasler K, Charnley A, Hussain Khambati, Sandro Fasolo, et al. (2018) Implementation of medical retina virtual clinics in a tertiary eye care referral centre. Br J Ophthalmol 102: 1391-1395.
- Kotecha A, Brookes J, Foster PJ (2017) A technician-delivered ‘virtual clinic’for triaging low-risk glaucoma referrals. Eye 31: 899-905.
- McCarthy J, Minsky ML, Rochester N, Claude E Shannon (2006) A proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955. AI Magazine pp. 2712-2714.
- Balyen L, Peto T (2019) Promising artificial intelligence-machine learning-deep learning algorithms in ophthalmology. Asia Pac J Ophthalmol 8: 264-272.
- Samuel AL (1988) Some studies in machine learning using the game of checkers. I. In: Levy DNL, editor. Computer Games I. Springer, New York, USA, pp. 335-365.
- LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553): 436-444.
- Schmidt-ErfurthU, Sadeghipour, A, Gerendas BS, Waldstein SM, BogunovićH(2018). Artificial intelligence in retina. Prog Ret Eye Res67: 1-29.
- Zhang X, Saaddine JB, Chou CF, Mary Frances Cotch, Yiling J Cheng, et al. (2010) Prevalence of diabetic retinopathy in the United States, 2005-2008. JAMA304:649-656.
- Raman R, Rani PK, ReddiRachepalle S, Perumal Gnanamoorthy, SatagopanUthra, et al. (2009) Prevalence of diabetic retinopathy in India: SankaraNethralaya Diabetic Retinopathy Epidemiology and Molecular Genetics Study report 2. Ophthalmology116:311-318.
- Taylor CR, Merin LM, Salunga AM, Hepworth JT, Crutcher TD, et al. (2007) Improving diabetic retinopathy screening ratios using telemedicine-based digital retinal imaging technology: The Vine Hill study. Diabetes Care30:574-578.
- US Food and Drug Administration. FDA permits marketing of artificial intelligence-based device to detect certain diabetes-related eye problems
- Abràmoff MD, Lou Y, Erginay A, Clarida W, Amelon R, et al. (2016) Improved automated detection of diabetic retinopathy on a publicly available dataset through integration of deep learning. Invest Ophthalmol Vis Sci. 57:5200-5206.
- Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, et al. (2016) Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. Jama316:2402-2410.
- Gargeya R, Leng T (2017) Automated identification of diabetic retinopathy using deep learning. Ophthalmology 124:962-969.
- Ting DSW, Cheung CY, Lim G, Tan GSW, Quang ND, et al.(2017) Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA318:2211-2223.
- Abramoff MD, Lavin PT, Birch M, Shah N, Folk JC (2018) Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. NPJ Digit Med1:39.
- Ramachandran N, Hong SC, Sime MJ, Wilson GA (2018) Diabetic retinopathy screening using deep neural network. Clin Exp Ophthalmol46:412-416.
- Shah P, Mishra DK, Shanmugam MP, Doshi B, Jayaraj H, et al.(2020) Validation of Deep Convolutional Neural Network-based algorithm for detection of diabetic retinopathy–Artificial intelligence versus clinician for screening. Indian J Ophthalmol68:398-405.
- Abramoff M (2018) Artificial intelligence for automated detection of diabetic retinopathy in primary care. Paper presented at: Macular Society; February 22, 2018; Beverly Hills, CA.
- Pros and Cons of Using an AI-Based Diagnosis for Diabetic Retinopathy: Page 4 of 5 N.d. Optometry Times.
- Bhaskaranand M, Ramachandra C, Bhat S, Jorge Cuadros, Muneeswar G Nittala, et al. (2019) The value of automated diabetic retinopathy screening with the EyeArt system: a study of more than 100,000 consecutive encounters from people with diabetes. Diabetes TechnolTher 21:635-643.
- Rajalakshmi R, Arulmalar S, Usha M, VijayaraghavanPrathiba, Khaji Syed Kareemuddin, et al. (2015) Validation of smartphone based retinal photography for diabetic retinopathy screening. PLoS One10:e0138285.
- Sosale B, Aravind SR, Murthy H,Narayana S, Sharma U, et al. (2020) Simple, Mobile-based Artificial Intelligence Algorithm in the detection of Diabetic Retinopathy (SMART) study. BMJ Open Diabetes Research Care8:
- Chew EY, Clemons TE, Agrón E, Lenore J Launer , Francine Grodstein , et al. (2015) Effect of omega-3 fatty acids, lutein/zeaxanthin, or other nutrient supplementation on cognitive function: the areds2 randomized clinical trial. JAMA314:791-801.
- Wong WL, Su X, Li X, Chui Ming G Cheung, Ronald Klein, et al. (2014) Global prevalence of age-related macular degeneration and disease burden projection for 2020 and 2040: a systematic review and meta-analysis. Lancet Glob Health2: e106-116.
- Burlina PM, Joshi N, Pekala M, Katia D Pacheco, David E Freund, et al. (2017) Automated grading of age-related macular degeneration from color fundus images using deep convolutional neural networks. JAMA Ophthalmol135:1170-1176.
- Grassmann F, Mengelkamp J, Brandl C, Sebastian Harsch , Martina E Zimmermann, et al. (2018) A deep learning algorithm for prediction of age-related eye disease study severity scale for age-related macular degeneration from color fundus photography. Ophthalmology125:1410–1420.
- Schmidt-Erfurth U, Waldstein SM, Klimscha S, Sadeghipour A, Hu X, et al. (2018) Prediction of individual disease conversion in early AMD using artificial intelligence. Invest Ophthalmol Vis Sci59:3199-3208.
- Prahs P, Märker D, Mayer C, Helbig H (2018) Deep learning to support therapy decisions for intravitreal injections. Der Ophthalmologe: Zeitschrift der DeutschenOphthalmologischen Gesellschaft115:722-727.
- Schlegl T, Waldstein SM, Bogunovic H, Franz Endstraßer 3, Amir Sadeghipour, et al. (2018) Fully Automated Detection and Quantification of Macular Fluid in OCT Using Deep Learning. Ophthalmology125: 549-58.
- Resnikoff S, Pascolini D, Etya’ale D, Ivo Kocur, Ramachandra Pararajasegaram, et al. (2004) Global data on visual impairment in the year 2002. Bull World Health Organ 82: 844-851.
- Quigley HA, Broman AT (2006) The number of people with glaucoma worldwide in 2010 and 2020. Br J Ophthalmol 90: 262-267.
- Li Z, He Y, Keel S, Stuart Keel, Wei Meng, et al. (2018) Efficacy of a deep learning system for detecting glaucomatous optic neuropathy based on color fundus photographs. Ophthalmology125:1199-206.
- Christopher M, Belghith A, Weinreb RN, Christopher Bowd, Michael H Goldbaum, et al. (2018) Retinal nerve fiber layer features identified by unsupervised machine learning on optical coherence tomography scans predict glaucoma progression. Invest Ophthalmol Vis Sci59:2748-2756.
- Elze T, Pasquale LR, Shen LQ, Teresa C Chen, Janey L Wiggs, et al. (2015) Patterns of functional vision loss in glaucoma determined with archetypal analysis. J R Soc Interface12:20141118
- Wang M, Pasquale LR, Shen LQ, Michael V Boland, Sarah R Wellik, et al. (2018) Reversal of glaucoma hemifield test results and visual field features in glaucoma. Ophthalmology125:352-360.
- Tanna AP, Bandi JR, Budenz DL, William J Feuer, Robert M Feldman, et al. (2011) Interobserver agreement and intraobserver reproducibility of the subjective determination of glaucomatous visual field progression. Ophthalmology118:60-65.
- Viswanathan AC, Crabb DP, McNaught AI, eM C Westcott, D Kamal, et al. (2003) Interobserver agreement on visual field progression in glaucoma: a comparison of methods. Br J Ophthalmol87:726-730.
- Yousefi S, Kiwaki T, Zheng Y, Hiroki Sugiura, Ryo Asaoka, et al. (2018) Detection of longitudinal visual field progression in glaucoma using machine learning. Am J Ophthalmol193:71-79.
- Flaxman SR, Bourne RRA, Resnikoff S, Peter Ackland,Tasanee Braithwaite, et al. (2017) Global causes of blindness and distance vision impairment 1990-2020: a systematic review and meta- analysis. Lancet Global Health5:e1221--e1234.
- Li H, Lim JH, Liu J, Damon Wing Kee Wong, Ngan Meng Tan, et al. (2009) An automatic diagnosis system of nuclear cataract using slit-lamp images. Conf Proc IEEE Eng Med Biol Soc2009:3693-3696.
- Xu Y, Gao X, Lin S, Damon Wing Kee Wong, Jiang Liu, et al. (2013) Automatic Grading of Nuclear Cataracts from Slit-Lamp Lens Images Using Group Sparsity Regression. Berlin, Heidelberg: Springer Berlin Heidelberg pp.468-475.
- Gao X, Lin S, Wong TY (2015) Automatic feature learning to grade nuclear cataracts based on deep learning. IEEE Trans Biomed Eng 62:2693- 2701.
- Wu X, Huang Y, Liu Z, WeiyiLai,Erping Long, et al. (2019) Universal artificial intelligence platform for collaborative management of cataracts. Br J Ophthalmol103:1553-1560.
- Dong Y, Zhang Q, Qiao Z, Yang J (2017) Classification of cataract fundus image based on deep learning. 2017 IEEE International Conference on Imaging Systems and Techniques (IST): 1-5.
- Ran J, Niu K, He Z, Zhang H, Song H (2018) Cataract Detection and Grading Based on Combination of Deep Convolutional Neural Network and Random Forests. 2018 International Conference on Network Infrastructure and Digital Content (IC-NIDC): 155-159.
- Pratap T, Kokil P (2019) Computer-aided diagnosis of cataract using deep transfer learning. Biomed Signal Process Control53:101533.
- González DC, Bautista CP (2020) Accuracy of a new intraocular lens power calculation method based on artificial intelligence. Eye 28:1-6.
- Al-Fahdawi S,Rami Qahwaji , Alaa S Al-Waisy, Stanley Ipson, Rayaz A Malik, et al. (2016) A fully automatic nerve segmentation and morphometric parameter quantification system for early diagnosis of diabetic neuropathy in corneal images. Comput Methods Programs Biomed 135:151-166.
- Chen X, Graham J, Dabbah MA, Petropoulos IN, Tavakoli M, et al. (2017) An automatic tool for quantification of nerve fibers in corneal confocal microscopy images. IEEE Trans Biomed Eng64:786-794.
- Treder M, Jost Lennart Lauermann, MagedAlnawaiseh, Nicole Eter(2019)Using deep learning in automated detection of graft detachment in Descemet membrane endothelial keratoplasty: a pilot study. Cornea 38:157-161.
- Souza MB, Medeiros FW, Souza DB, Garcia R, Alves MR (2010) Evaluation of machine learning classifiers in keratoconus detection from orbscan II examinations. Clinics65: 1223-1228.
- Ruiz Hidalgo I, Rozema JJ, Saad A,Pablo Rodriguez, Nadia Zakaria, et al.(2017) Validation of an Objective Keratoconus Detection System Implemented in a ScheimpflugTomographer and Comparison with Other Methods. Cornea36: 689-695.
- Arbelaez MC, Versaci F, Vestri G, Barboni P, Savini G (2012) Use of a support vector machine for keratoconus and subclinical keratoconus detection by topographic and tomographic data. Ophthalmology119: 2231-2238.
- Kovacs I, Mihaltz K, Kranitz K, ÉvaJuhász, A Takács, et al. (2016) Accuracy of machine learning classifiers using bilateral data from Schiempflug camera for identifying eyes with preclinical signs of keratoconus. J Cataract Refract Surg 42: 275-283.
- Ambrósio R Jr, Lopes BT, Faria-Correia F, Marcella Q Salomão, Jens Bühren, et al. (2017) Integration of Scheimpflug- Based Corneal Tomography and Biomechanical Assessments for Enhancing Ectasia Detection. J Refract Surg33: 434-443.
- Heneghan C, Flynn J, O’Keefe M, Cahill M (2002) Characterization of changes in blood vessel width and tortuosity in retinopathy of prematurity using image analysis. Med Image Anal6:407-429.
- Rabinowitz MP, Grunwald JE, Karp KA, Gui-Shuang Ying, Monte D Mills(2007) Progression to severe retinopathy predicted by retinal vessel diameter between 31 and 34 weeks of postconception age. Arch Ophthalmol125:1495-1500.
- Gelman R, Jiang L, Du YE,M Elena Martinez-Perez, John T Flynn, et al. (2007) Plus disease in retinopathy of prematurity: pilot study of computer-based and expert diagnosis. J Am Assoc Pediatr Ophthalmol Strabismus11:532–540.
- Wallace DK, Zhao Z, Freedman SF (2007) A pilot study using ‘ROPtool’ to quantify plus disease in retinopathy of prematurity. J Am Assoc Pediatr Ophthalmol Strabismus11:381-387.
- Swanson C, Cocker KD, Parker KH, M J Moseley, A R Fielder (2003) Semiautomated computer analysis of vessel growth in preterm infants without and with ROP. Br J Ophthalmol87:1474-1477.
- Gelman R, Martinez-Perez ME, Vanderveen DK,Anne Moskowitz, Anne B Fulton (2005) Diagnosis of plus disease in retinopathy of prematurity using retinal image multiscale analysis. Invest Opthalmol Vis Sci46:4734-4738.
- Shah DN, Wilson CM, Ying GS, Karen A Karp, Alistair R Fielder, et al.(2009) Semiautomated digital image analysis of posterior pole vessels in retinopathy of prematurity. J Am Assoc Pediatr Ophthalmol Strabismus 13:504-506.
- Wilson CM, Cocker KD, Moseley MJ, Carl Paterson, Simon T Clay, et al. (2008) Computerized analysis of retinal vessel width and tortuosity in premature infants. Invest Ophthalmol Vis Sci49:3577-3585.
- Sherry LM, Jin Wang J, Rochtchina E, TienY Wong, Ronald Klein, et al. (2002) Reliability of computer-assisted retinal vessel measurement in a population. Clin Exp Ophthalmol 30:179-182.
- Brown JM, Campbell JP, Beers A, Ken Chang, Susan Ostmo, et al. (2018) Automated diagnosis of plus disease in retinopathy of prematurity using deep convolutional neural networks. JAMA Ophthalmol136:803-810.
- Wang J, Ju R, Chen Y, Lei Zhang, JunjieHu,et al. (2018) Automated retinopathy of prematurity screening using deep neural networks. EBioMedicine35:361-368.
- Poplin R,Avinash V Varadarajan, Katy Blumer, Yun Liu, Michael V McConnell, et al. (2018) Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nat Biomed Eng2:158-164.
- Ting DS, Pasquale LR, Peng L, Campbell JP, Lee AY, et al. (2019). Artificial intelligence and deep learning in ophthalmology. Br J Ophthalmol103:167-175.
- Tan Z, Scheetz J, He M (2019) Artificial Intelligence in Ophthalmology: Accuracy, Challenges, and Clinical Application. Asia Pac J Ophthalmol (Phila) 8:197‐199.