Telemedicine diagnosis of cytomegalovirus retinitis by nonophthalmologists

Michael Yen, Somsanguan Ausayakhun, Jenny Chen, Sakarin Ausayakhun, Choeng Jirawison, David Heiden, Gary N. Holland, Todd P. Margolis, Jeremy D. Keenan

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

IMPORTANCE: Cytomegalovirus (CMV) retinitis continues to be a leading cause of blindness in many developing countries. Telemedicine holds the potential to increase the number of people screened for CMV retinitis, but it is unclear whether nonophthalmologists could be responsible for interpreting fundus photographs captured in a telemedicine program. OBJECTIVE: To determine the accuracy of nonophthalmologist photographic graders in diagnosing CMV retinitis from digital fundus photographs. DESIGN, SETTING, AND PARTICIPANTS: Fifteen nonexpert graders each evaluated 182 mosaic retinal images taken from the eyes of patients with AIDS who were evaluated at the Ocular Infectious Diseases Clinic at Chiang Mai University in Chiang Mai, Thailand. MAIN OUTCOMES AND MEASURES: Graders diagnosed each image as CMV retinitis present, CMV retinitis absent, or unknown. The results from each grader were compared with those of an indirect ophthalmoscopic examination from an experienced on-site ophthalmologist as well as with the consensus grade given by a panel of CMV retinitis experts. RESULTS: Relative to the on-site ophthalmologist, the sensitivity of remote CMV retinitis diagnosis by nonexpert graders ranged from 64.0%to 95.5% (mean, 84.1%; 95% CI, 78.6%-89.6%)), and the specificity ranged from 65.6%to 92.5% (mean, 82.3%; 95% CI, 76.6%-88.0%)). Agreement between nonexpert and expert graders was high: the mean sensitivity and specificity values of nonexpert diagnosis using expert consensus as the reference standard were 93.2% (95% CI, 90.6%-95.8%) and 88.4% (95% CI, 85.4%-91.1%), respectively. Mean intrarater reliability also was high (mean Cohen κ, 0.83; 95% CI, 0.78-0.87). CONCLUSIONS AND RELEVANCE: The sensitivity and specificity of remote diagnosis of CMV retinitis by nonexpert graders was variable, although several nonexperts achieved a level of accuracy comparable to that of CMV retinitis experts. More intensive training and periodic evaluations would be required if nonexperts are to be used in clinical practice.

Original languageEnglish (US)
Pages (from-to)1052-1058
Number of pages7
JournalJAMA ophthalmology
Volume132
Issue number9
DOIs
StatePublished - Sep 1 2014
Externally publishedYes

Fingerprint

Cytomegalovirus Retinitis
Telemedicine
Sensitivity and Specificity
Eye Diseases
Thailand
Blindness
Developing Countries
Communicable Diseases
Acquired Immunodeficiency Syndrome

ASJC Scopus subject areas

  • Ophthalmology

Cite this

Yen, M., Ausayakhun, S., Chen, J., Ausayakhun, S., Jirawison, C., Heiden, D., ... Keenan, J. D. (2014). Telemedicine diagnosis of cytomegalovirus retinitis by nonophthalmologists. JAMA ophthalmology, 132(9), 1052-1058. https://doi.org/10.1001/jamaophthalmol.2014.1108

Telemedicine diagnosis of cytomegalovirus retinitis by nonophthalmologists. / Yen, Michael; Ausayakhun, Somsanguan; Chen, Jenny; Ausayakhun, Sakarin; Jirawison, Choeng; Heiden, David; Holland, Gary N.; Margolis, Todd P.; Keenan, Jeremy D.

In: JAMA ophthalmology, Vol. 132, No. 9, 01.09.2014, p. 1052-1058.

Research output: Contribution to journalArticle

Yen, M, Ausayakhun, S, Chen, J, Ausayakhun, S, Jirawison, C, Heiden, D, Holland, GN, Margolis, TP & Keenan, JD 2014, 'Telemedicine diagnosis of cytomegalovirus retinitis by nonophthalmologists', JAMA ophthalmology, vol. 132, no. 9, pp. 1052-1058. https://doi.org/10.1001/jamaophthalmol.2014.1108
Yen, Michael ; Ausayakhun, Somsanguan ; Chen, Jenny ; Ausayakhun, Sakarin ; Jirawison, Choeng ; Heiden, David ; Holland, Gary N. ; Margolis, Todd P. ; Keenan, Jeremy D. / Telemedicine diagnosis of cytomegalovirus retinitis by nonophthalmologists. In: JAMA ophthalmology. 2014 ; Vol. 132, No. 9. pp. 1052-1058.
@article{c7d6c8a1880d4e6382388eef775cded0,
title = "Telemedicine diagnosis of cytomegalovirus retinitis by nonophthalmologists",
abstract = "IMPORTANCE: Cytomegalovirus (CMV) retinitis continues to be a leading cause of blindness in many developing countries. Telemedicine holds the potential to increase the number of people screened for CMV retinitis, but it is unclear whether nonophthalmologists could be responsible for interpreting fundus photographs captured in a telemedicine program. OBJECTIVE: To determine the accuracy of nonophthalmologist photographic graders in diagnosing CMV retinitis from digital fundus photographs. DESIGN, SETTING, AND PARTICIPANTS: Fifteen nonexpert graders each evaluated 182 mosaic retinal images taken from the eyes of patients with AIDS who were evaluated at the Ocular Infectious Diseases Clinic at Chiang Mai University in Chiang Mai, Thailand. MAIN OUTCOMES AND MEASURES: Graders diagnosed each image as CMV retinitis present, CMV retinitis absent, or unknown. The results from each grader were compared with those of an indirect ophthalmoscopic examination from an experienced on-site ophthalmologist as well as with the consensus grade given by a panel of CMV retinitis experts. RESULTS: Relative to the on-site ophthalmologist, the sensitivity of remote CMV retinitis diagnosis by nonexpert graders ranged from 64.0{\%}to 95.5{\%} (mean, 84.1{\%}; 95{\%} CI, 78.6{\%}-89.6{\%})), and the specificity ranged from 65.6{\%}to 92.5{\%} (mean, 82.3{\%}; 95{\%} CI, 76.6{\%}-88.0{\%})). Agreement between nonexpert and expert graders was high: the mean sensitivity and specificity values of nonexpert diagnosis using expert consensus as the reference standard were 93.2{\%} (95{\%} CI, 90.6{\%}-95.8{\%}) and 88.4{\%} (95{\%} CI, 85.4{\%}-91.1{\%}), respectively. Mean intrarater reliability also was high (mean Cohen κ, 0.83; 95{\%} CI, 0.78-0.87). CONCLUSIONS AND RELEVANCE: The sensitivity and specificity of remote diagnosis of CMV retinitis by nonexpert graders was variable, although several nonexperts achieved a level of accuracy comparable to that of CMV retinitis experts. More intensive training and periodic evaluations would be required if nonexperts are to be used in clinical practice.",
author = "Michael Yen and Somsanguan Ausayakhun and Jenny Chen and Sakarin Ausayakhun and Choeng Jirawison and David Heiden and Holland, {Gary N.} and Margolis, {Todd P.} and Keenan, {Jeremy D.}",
year = "2014",
month = "9",
day = "1",
doi = "10.1001/jamaophthalmol.2014.1108",
language = "English (US)",
volume = "132",
pages = "1052--1058",
journal = "JAMA Ophthalmology",
issn = "2168-6165",
publisher = "American Medical Association",
number = "9",

}

TY - JOUR

T1 - Telemedicine diagnosis of cytomegalovirus retinitis by nonophthalmologists

AU - Yen, Michael

AU - Ausayakhun, Somsanguan

AU - Chen, Jenny

AU - Ausayakhun, Sakarin

AU - Jirawison, Choeng

AU - Heiden, David

AU - Holland, Gary N.

AU - Margolis, Todd P.

AU - Keenan, Jeremy D.

PY - 2014/9/1

Y1 - 2014/9/1

N2 - IMPORTANCE: Cytomegalovirus (CMV) retinitis continues to be a leading cause of blindness in many developing countries. Telemedicine holds the potential to increase the number of people screened for CMV retinitis, but it is unclear whether nonophthalmologists could be responsible for interpreting fundus photographs captured in a telemedicine program. OBJECTIVE: To determine the accuracy of nonophthalmologist photographic graders in diagnosing CMV retinitis from digital fundus photographs. DESIGN, SETTING, AND PARTICIPANTS: Fifteen nonexpert graders each evaluated 182 mosaic retinal images taken from the eyes of patients with AIDS who were evaluated at the Ocular Infectious Diseases Clinic at Chiang Mai University in Chiang Mai, Thailand. MAIN OUTCOMES AND MEASURES: Graders diagnosed each image as CMV retinitis present, CMV retinitis absent, or unknown. The results from each grader were compared with those of an indirect ophthalmoscopic examination from an experienced on-site ophthalmologist as well as with the consensus grade given by a panel of CMV retinitis experts. RESULTS: Relative to the on-site ophthalmologist, the sensitivity of remote CMV retinitis diagnosis by nonexpert graders ranged from 64.0%to 95.5% (mean, 84.1%; 95% CI, 78.6%-89.6%)), and the specificity ranged from 65.6%to 92.5% (mean, 82.3%; 95% CI, 76.6%-88.0%)). Agreement between nonexpert and expert graders was high: the mean sensitivity and specificity values of nonexpert diagnosis using expert consensus as the reference standard were 93.2% (95% CI, 90.6%-95.8%) and 88.4% (95% CI, 85.4%-91.1%), respectively. Mean intrarater reliability also was high (mean Cohen κ, 0.83; 95% CI, 0.78-0.87). CONCLUSIONS AND RELEVANCE: The sensitivity and specificity of remote diagnosis of CMV retinitis by nonexpert graders was variable, although several nonexperts achieved a level of accuracy comparable to that of CMV retinitis experts. More intensive training and periodic evaluations would be required if nonexperts are to be used in clinical practice.

AB - IMPORTANCE: Cytomegalovirus (CMV) retinitis continues to be a leading cause of blindness in many developing countries. Telemedicine holds the potential to increase the number of people screened for CMV retinitis, but it is unclear whether nonophthalmologists could be responsible for interpreting fundus photographs captured in a telemedicine program. OBJECTIVE: To determine the accuracy of nonophthalmologist photographic graders in diagnosing CMV retinitis from digital fundus photographs. DESIGN, SETTING, AND PARTICIPANTS: Fifteen nonexpert graders each evaluated 182 mosaic retinal images taken from the eyes of patients with AIDS who were evaluated at the Ocular Infectious Diseases Clinic at Chiang Mai University in Chiang Mai, Thailand. MAIN OUTCOMES AND MEASURES: Graders diagnosed each image as CMV retinitis present, CMV retinitis absent, or unknown. The results from each grader were compared with those of an indirect ophthalmoscopic examination from an experienced on-site ophthalmologist as well as with the consensus grade given by a panel of CMV retinitis experts. RESULTS: Relative to the on-site ophthalmologist, the sensitivity of remote CMV retinitis diagnosis by nonexpert graders ranged from 64.0%to 95.5% (mean, 84.1%; 95% CI, 78.6%-89.6%)), and the specificity ranged from 65.6%to 92.5% (mean, 82.3%; 95% CI, 76.6%-88.0%)). Agreement between nonexpert and expert graders was high: the mean sensitivity and specificity values of nonexpert diagnosis using expert consensus as the reference standard were 93.2% (95% CI, 90.6%-95.8%) and 88.4% (95% CI, 85.4%-91.1%), respectively. Mean intrarater reliability also was high (mean Cohen κ, 0.83; 95% CI, 0.78-0.87). CONCLUSIONS AND RELEVANCE: The sensitivity and specificity of remote diagnosis of CMV retinitis by nonexpert graders was variable, although several nonexperts achieved a level of accuracy comparable to that of CMV retinitis experts. More intensive training and periodic evaluations would be required if nonexperts are to be used in clinical practice.

UR - http://www.scopus.com/inward/record.url?scp=84907546140&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84907546140&partnerID=8YFLogxK

U2 - 10.1001/jamaophthalmol.2014.1108

DO - 10.1001/jamaophthalmol.2014.1108

M3 - Article

C2 - 24945306

AN - SCOPUS:84907546140

VL - 132

SP - 1052

EP - 1058

JO - JAMA Ophthalmology

JF - JAMA Ophthalmology

SN - 2168-6165

IS - 9

ER -