Improvements are needed in reporting of accuracy studies for diagnostic tests used for detection of finfish pathogens

Ian Gardner, Timothy Burnley, Charles Caraguel

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Indices of test accuracy, such as diagnostic sensitivity and specificity, are important considerations in test selection for a defined purpose (e.g., screening or confirmation) and affect the interpretation of test results. Many biomedical journals recommend that authors clearly and transparently report test accuracy studies following the Standards for Reporting of Diagnostic Accuracy (STARD) guidelines (www.stard-statement.org). This allows readers to evaluate overall study validity and assess potential bias in diagnostic sensitivity and specificity estimates. The purpose of the present study was to evaluate the reporting quality of studies evaluating test accuracy for finfish diseases using the 25 items in the STARD checklist. Based on a database search, 11 studies that included estimates of diagnostic accuracy were identified for independent evaluation by three reviewers. For each study, STARD checklist items were scored as "yes," "no," or "not applicable." Only 10 of the 25 items were consistently reported in most (>80%) papers, and reporting of the other items was highly variable (mostly between 30% and 60%). Three items ("number, training, and expertise of readers and testers"; "time interval between index tests and reference standard"; and "handling of indeterminate results, missing data, and outliers of the index tests") were reported in less than 10% of papers. Two items ("time interval between index tests and reference standard" and "adverse effects from testing") were considered minimally relevant to fish health because test samples usually are collected postmortem. Modification of STARD to fit finfish studies should increase use by authors and thereby improve the overall reporting quality regardless of how the study was designed. Furthermore, the use of STARD may lead to the improved design of future studies.

Original languageEnglish (US)
Pages (from-to)203-209
Number of pages7
JournalJournal of Aquatic Animal Health
Volume26
Issue number4
DOIs
StatePublished - Sep 17 2014
Externally publishedYes

Fingerprint

finfish
Routine Diagnostic Tests
diagnostic techniques
pathogen
pathogens
fish
testing
Checklist
diagnostic specificity
diagnostic sensitivity
reference standards
Sensitivity and Specificity
test
detection
fish health
Fishes
outlier
Databases
Guidelines
Health

ASJC Scopus subject areas

  • Aquatic Science
  • Medicine(all)

Cite this

Improvements are needed in reporting of accuracy studies for diagnostic tests used for detection of finfish pathogens. / Gardner, Ian; Burnley, Timothy; Caraguel, Charles.

In: Journal of Aquatic Animal Health, Vol. 26, No. 4, 17.09.2014, p. 203-209.

Research output: Contribution to journalArticle

@article{2bbe04ad60bf4a92af0d5cc6bc570535,
title = "Improvements are needed in reporting of accuracy studies for diagnostic tests used for detection of finfish pathogens",
abstract = "Indices of test accuracy, such as diagnostic sensitivity and specificity, are important considerations in test selection for a defined purpose (e.g., screening or confirmation) and affect the interpretation of test results. Many biomedical journals recommend that authors clearly and transparently report test accuracy studies following the Standards for Reporting of Diagnostic Accuracy (STARD) guidelines (www.stard-statement.org). This allows readers to evaluate overall study validity and assess potential bias in diagnostic sensitivity and specificity estimates. The purpose of the present study was to evaluate the reporting quality of studies evaluating test accuracy for finfish diseases using the 25 items in the STARD checklist. Based on a database search, 11 studies that included estimates of diagnostic accuracy were identified for independent evaluation by three reviewers. For each study, STARD checklist items were scored as {"}yes,{"} {"}no,{"} or {"}not applicable.{"} Only 10 of the 25 items were consistently reported in most (>80{\%}) papers, and reporting of the other items was highly variable (mostly between 30{\%} and 60{\%}). Three items ({"}number, training, and expertise of readers and testers{"}; {"}time interval between index tests and reference standard{"}; and {"}handling of indeterminate results, missing data, and outliers of the index tests{"}) were reported in less than 10{\%} of papers. Two items ({"}time interval between index tests and reference standard{"} and {"}adverse effects from testing{"}) were considered minimally relevant to fish health because test samples usually are collected postmortem. Modification of STARD to fit finfish studies should increase use by authors and thereby improve the overall reporting quality regardless of how the study was designed. Furthermore, the use of STARD may lead to the improved design of future studies.",
author = "Ian Gardner and Timothy Burnley and Charles Caraguel",
year = "2014",
month = "9",
day = "17",
doi = "10.1080/08997659.2014.938867",
language = "English (US)",
volume = "26",
pages = "203--209",
journal = "Journal of Aquatic Animal Health",
issn = "0899-7659",
publisher = "American Fisheries Society",
number = "4",

}

TY - JOUR

T1 - Improvements are needed in reporting of accuracy studies for diagnostic tests used for detection of finfish pathogens

AU - Gardner, Ian

AU - Burnley, Timothy

AU - Caraguel, Charles

PY - 2014/9/17

Y1 - 2014/9/17

N2 - Indices of test accuracy, such as diagnostic sensitivity and specificity, are important considerations in test selection for a defined purpose (e.g., screening or confirmation) and affect the interpretation of test results. Many biomedical journals recommend that authors clearly and transparently report test accuracy studies following the Standards for Reporting of Diagnostic Accuracy (STARD) guidelines (www.stard-statement.org). This allows readers to evaluate overall study validity and assess potential bias in diagnostic sensitivity and specificity estimates. The purpose of the present study was to evaluate the reporting quality of studies evaluating test accuracy for finfish diseases using the 25 items in the STARD checklist. Based on a database search, 11 studies that included estimates of diagnostic accuracy were identified for independent evaluation by three reviewers. For each study, STARD checklist items were scored as "yes," "no," or "not applicable." Only 10 of the 25 items were consistently reported in most (>80%) papers, and reporting of the other items was highly variable (mostly between 30% and 60%). Three items ("number, training, and expertise of readers and testers"; "time interval between index tests and reference standard"; and "handling of indeterminate results, missing data, and outliers of the index tests") were reported in less than 10% of papers. Two items ("time interval between index tests and reference standard" and "adverse effects from testing") were considered minimally relevant to fish health because test samples usually are collected postmortem. Modification of STARD to fit finfish studies should increase use by authors and thereby improve the overall reporting quality regardless of how the study was designed. Furthermore, the use of STARD may lead to the improved design of future studies.

AB - Indices of test accuracy, such as diagnostic sensitivity and specificity, are important considerations in test selection for a defined purpose (e.g., screening or confirmation) and affect the interpretation of test results. Many biomedical journals recommend that authors clearly and transparently report test accuracy studies following the Standards for Reporting of Diagnostic Accuracy (STARD) guidelines (www.stard-statement.org). This allows readers to evaluate overall study validity and assess potential bias in diagnostic sensitivity and specificity estimates. The purpose of the present study was to evaluate the reporting quality of studies evaluating test accuracy for finfish diseases using the 25 items in the STARD checklist. Based on a database search, 11 studies that included estimates of diagnostic accuracy were identified for independent evaluation by three reviewers. For each study, STARD checklist items were scored as "yes," "no," or "not applicable." Only 10 of the 25 items were consistently reported in most (>80%) papers, and reporting of the other items was highly variable (mostly between 30% and 60%). Three items ("number, training, and expertise of readers and testers"; "time interval between index tests and reference standard"; and "handling of indeterminate results, missing data, and outliers of the index tests") were reported in less than 10% of papers. Two items ("time interval between index tests and reference standard" and "adverse effects from testing") were considered minimally relevant to fish health because test samples usually are collected postmortem. Modification of STARD to fit finfish studies should increase use by authors and thereby improve the overall reporting quality regardless of how the study was designed. Furthermore, the use of STARD may lead to the improved design of future studies.

UR - http://www.scopus.com/inward/record.url?scp=84907874400&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84907874400&partnerID=8YFLogxK

U2 - 10.1080/08997659.2014.938867

DO - 10.1080/08997659.2014.938867

M3 - Article

C2 - 25252270

AN - SCOPUS:84907874400

VL - 26

SP - 203

EP - 209

JO - Journal of Aquatic Animal Health

JF - Journal of Aquatic Animal Health

SN - 0899-7659

IS - 4

ER -