Computing the surveillance error grid analysis: Procedure and examples

Boris P. Kovatchev, Christian A. Wakeman, Marc D. Breton, Gerald J Kost, Richard F. Louie, Nam Tran, David C. Klonoff

Research output: Contribution to journalArticle

21 Citations (Scopus)

Abstract

The surveillance error grid (SEG) analysis is a tool for analysis and visualization of blood glucose monitoring (BGM) errors, based on the opinions of 206 diabetes clinicians who rated 4 distinct treatment scenarios. Resulting from this large-scale inquiry is a matrix of 337 561 risk ratings, 1 for each pair of (reference, BGM) readings ranging from 20 to 580 mg/dl. The computation of the SEG is therefore complex and in need of automation. The SEG software introduced in this article automates the task of assigning a degree of risk to each data point for a set of measured and reference blood glucose values so that the data can be distributed into 8 risk zones. The software's 2 main purposes are to (1) distribute a set of BG Monitor data into 8 risk zones ranging from none to extreme and (2) present the data in a color coded display to promote visualization. Besides aggregating the data into 8 zones corresponding to levels of risk, the SEG computes the number and percentage of data pairs in each zone and the number/percentage of data pairs above/below the diagonal line in each zone, which are associated with BGM errors creating risks for hypo-or hyperglycemia, respectively. To illustrate the action of the SEG software we first present computer-simulated data stratified along error levels defined by ISO 15197:2013. This allows the SEG to be linked to this established standard. Further illustration of the SEG procedure is done with a series of previously published data, which reflect the performance of BGM devices and test strips under various environmental conditions. We conclude that the SEG software is a useful addition to the SEG analysis presented in this journal, developed to assess the magnitude of clinical risk from analytically inaccurate data in a variety of high-impact situations such as intensive care and disaster settings.

Original languageEnglish (US)
Pages (from-to)673-684
Number of pages12
JournalJournal of diabetes science and technology
Volume8
Issue number4
DOIs
StatePublished - 2014

Fingerprint

Blood Glucose
Software
Glucose
Blood
Monitoring
Automation
Disasters
Critical Care
Hyperglycemia
Visualization
Reading
Color
Equipment and Supplies
Medical problems

Keywords

  • Blood glucose monitoring
  • Error grid analysis
  • Hyperglycemia
  • Hypoglycemia
  • Meter errors

ASJC Scopus subject areas

  • Endocrinology, Diabetes and Metabolism
  • Internal Medicine
  • Bioengineering
  • Biomedical Engineering

Cite this

Computing the surveillance error grid analysis : Procedure and examples. / Kovatchev, Boris P.; Wakeman, Christian A.; Breton, Marc D.; Kost, Gerald J; Louie, Richard F.; Tran, Nam; Klonoff, David C.

In: Journal of diabetes science and technology, Vol. 8, No. 4, 2014, p. 673-684.

Research output: Contribution to journalArticle

Kovatchev, Boris P. ; Wakeman, Christian A. ; Breton, Marc D. ; Kost, Gerald J ; Louie, Richard F. ; Tran, Nam ; Klonoff, David C. / Computing the surveillance error grid analysis : Procedure and examples. In: Journal of diabetes science and technology. 2014 ; Vol. 8, No. 4. pp. 673-684.
@article{140caf91b71c455288c83332bc5114e4,
title = "Computing the surveillance error grid analysis: Procedure and examples",
abstract = "The surveillance error grid (SEG) analysis is a tool for analysis and visualization of blood glucose monitoring (BGM) errors, based on the opinions of 206 diabetes clinicians who rated 4 distinct treatment scenarios. Resulting from this large-scale inquiry is a matrix of 337 561 risk ratings, 1 for each pair of (reference, BGM) readings ranging from 20 to 580 mg/dl. The computation of the SEG is therefore complex and in need of automation. The SEG software introduced in this article automates the task of assigning a degree of risk to each data point for a set of measured and reference blood glucose values so that the data can be distributed into 8 risk zones. The software's 2 main purposes are to (1) distribute a set of BG Monitor data into 8 risk zones ranging from none to extreme and (2) present the data in a color coded display to promote visualization. Besides aggregating the data into 8 zones corresponding to levels of risk, the SEG computes the number and percentage of data pairs in each zone and the number/percentage of data pairs above/below the diagonal line in each zone, which are associated with BGM errors creating risks for hypo-or hyperglycemia, respectively. To illustrate the action of the SEG software we first present computer-simulated data stratified along error levels defined by ISO 15197:2013. This allows the SEG to be linked to this established standard. Further illustration of the SEG procedure is done with a series of previously published data, which reflect the performance of BGM devices and test strips under various environmental conditions. We conclude that the SEG software is a useful addition to the SEG analysis presented in this journal, developed to assess the magnitude of clinical risk from analytically inaccurate data in a variety of high-impact situations such as intensive care and disaster settings.",
keywords = "Blood glucose monitoring, Error grid analysis, Hyperglycemia, Hypoglycemia, Meter errors",
author = "Kovatchev, {Boris P.} and Wakeman, {Christian A.} and Breton, {Marc D.} and Kost, {Gerald J} and Louie, {Richard F.} and Nam Tran and Klonoff, {David C.}",
year = "2014",
doi = "10.1177/1932296814539590",
language = "English (US)",
volume = "8",
pages = "673--684",
journal = "Journal of diabetes science and technology",
issn = "1932-2968",
publisher = "Diabetes Technology Society",
number = "4",

}

TY - JOUR

T1 - Computing the surveillance error grid analysis

T2 - Procedure and examples

AU - Kovatchev, Boris P.

AU - Wakeman, Christian A.

AU - Breton, Marc D.

AU - Kost, Gerald J

AU - Louie, Richard F.

AU - Tran, Nam

AU - Klonoff, David C.

PY - 2014

Y1 - 2014

N2 - The surveillance error grid (SEG) analysis is a tool for analysis and visualization of blood glucose monitoring (BGM) errors, based on the opinions of 206 diabetes clinicians who rated 4 distinct treatment scenarios. Resulting from this large-scale inquiry is a matrix of 337 561 risk ratings, 1 for each pair of (reference, BGM) readings ranging from 20 to 580 mg/dl. The computation of the SEG is therefore complex and in need of automation. The SEG software introduced in this article automates the task of assigning a degree of risk to each data point for a set of measured and reference blood glucose values so that the data can be distributed into 8 risk zones. The software's 2 main purposes are to (1) distribute a set of BG Monitor data into 8 risk zones ranging from none to extreme and (2) present the data in a color coded display to promote visualization. Besides aggregating the data into 8 zones corresponding to levels of risk, the SEG computes the number and percentage of data pairs in each zone and the number/percentage of data pairs above/below the diagonal line in each zone, which are associated with BGM errors creating risks for hypo-or hyperglycemia, respectively. To illustrate the action of the SEG software we first present computer-simulated data stratified along error levels defined by ISO 15197:2013. This allows the SEG to be linked to this established standard. Further illustration of the SEG procedure is done with a series of previously published data, which reflect the performance of BGM devices and test strips under various environmental conditions. We conclude that the SEG software is a useful addition to the SEG analysis presented in this journal, developed to assess the magnitude of clinical risk from analytically inaccurate data in a variety of high-impact situations such as intensive care and disaster settings.

AB - The surveillance error grid (SEG) analysis is a tool for analysis and visualization of blood glucose monitoring (BGM) errors, based on the opinions of 206 diabetes clinicians who rated 4 distinct treatment scenarios. Resulting from this large-scale inquiry is a matrix of 337 561 risk ratings, 1 for each pair of (reference, BGM) readings ranging from 20 to 580 mg/dl. The computation of the SEG is therefore complex and in need of automation. The SEG software introduced in this article automates the task of assigning a degree of risk to each data point for a set of measured and reference blood glucose values so that the data can be distributed into 8 risk zones. The software's 2 main purposes are to (1) distribute a set of BG Monitor data into 8 risk zones ranging from none to extreme and (2) present the data in a color coded display to promote visualization. Besides aggregating the data into 8 zones corresponding to levels of risk, the SEG computes the number and percentage of data pairs in each zone and the number/percentage of data pairs above/below the diagonal line in each zone, which are associated with BGM errors creating risks for hypo-or hyperglycemia, respectively. To illustrate the action of the SEG software we first present computer-simulated data stratified along error levels defined by ISO 15197:2013. This allows the SEG to be linked to this established standard. Further illustration of the SEG procedure is done with a series of previously published data, which reflect the performance of BGM devices and test strips under various environmental conditions. We conclude that the SEG software is a useful addition to the SEG analysis presented in this journal, developed to assess the magnitude of clinical risk from analytically inaccurate data in a variety of high-impact situations such as intensive care and disaster settings.

KW - Blood glucose monitoring

KW - Error grid analysis

KW - Hyperglycemia

KW - Hypoglycemia

KW - Meter errors

UR - http://www.scopus.com/inward/record.url?scp=84905923754&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84905923754&partnerID=8YFLogxK

U2 - 10.1177/1932296814539590

DO - 10.1177/1932296814539590

M3 - Article

C2 - 25562887

AN - SCOPUS:84905923754

VL - 8

SP - 673

EP - 684

JO - Journal of diabetes science and technology

JF - Journal of diabetes science and technology

SN - 1932-2968

IS - 4

ER -