Assessment of a novel hybrid Delphi and nominal groups technique to evaluate quality indicators

Sheryl Davies, Patrick S Romano, Eric M. Schmidt, Ellen Schultz, Jeffrey J. Geppert, Kathryn M. McDonald

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

Objective. To test the implementation of a novel structured panel process in the evaluation of quality indicators. Data Source. National panel of 64 clinicians rating usefulness of indicator applications in 2008-2009. Study Design. Hybrid panel combined Delphi Group and Nominal Group (NG) techniques to evaluate 81 indicator applications. Principal Findings. The Delphi Group and NG rated 56 percent of indicator applications similarly. Group assignment (Delphi versus Nominal) was not significantly associated with mean ratings, but specialty and research interests of panelists, and indicator factors such as denominator level and proposed use were. Rating distributions narrowed significantly in 20.8 percent of applications between review rounds. Conclusions. The hybrid panel process facilitated information exchange and tightened rating distributions. Future assessments of this method might include a control panel.

Original languageEnglish (US)
Pages (from-to)2005-2018
Number of pages14
JournalHealth Services Research
Volume46
Issue number6 PART 1
DOIs
StatePublished - Dec 2011

Fingerprint

Information Storage and Retrieval
Research

Keywords

  • Delphi method
  • Nominal Group technique
  • Quality indicators

ASJC Scopus subject areas

  • Health Policy

Cite this

Assessment of a novel hybrid Delphi and nominal groups technique to evaluate quality indicators. / Davies, Sheryl; Romano, Patrick S; Schmidt, Eric M.; Schultz, Ellen; Geppert, Jeffrey J.; McDonald, Kathryn M.

In: Health Services Research, Vol. 46, No. 6 PART 1, 12.2011, p. 2005-2018.

Research output: Contribution to journalArticle

Davies, Sheryl ; Romano, Patrick S ; Schmidt, Eric M. ; Schultz, Ellen ; Geppert, Jeffrey J. ; McDonald, Kathryn M. / Assessment of a novel hybrid Delphi and nominal groups technique to evaluate quality indicators. In: Health Services Research. 2011 ; Vol. 46, No. 6 PART 1. pp. 2005-2018.
@article{3e5b7b3b68d64cdfa0f2e7d536d49ea8,
title = "Assessment of a novel hybrid Delphi and nominal groups technique to evaluate quality indicators",
abstract = "Objective. To test the implementation of a novel structured panel process in the evaluation of quality indicators. Data Source. National panel of 64 clinicians rating usefulness of indicator applications in 2008-2009. Study Design. Hybrid panel combined Delphi Group and Nominal Group (NG) techniques to evaluate 81 indicator applications. Principal Findings. The Delphi Group and NG rated 56 percent of indicator applications similarly. Group assignment (Delphi versus Nominal) was not significantly associated with mean ratings, but specialty and research interests of panelists, and indicator factors such as denominator level and proposed use were. Rating distributions narrowed significantly in 20.8 percent of applications between review rounds. Conclusions. The hybrid panel process facilitated information exchange and tightened rating distributions. Future assessments of this method might include a control panel.",
keywords = "Delphi method, Nominal Group technique, Quality indicators",
author = "Sheryl Davies and Romano, {Patrick S} and Schmidt, {Eric M.} and Ellen Schultz and Geppert, {Jeffrey J.} and McDonald, {Kathryn M.}",
year = "2011",
month = "12",
doi = "10.1111/j.1475-6773.2011.01297.x",
language = "English (US)",
volume = "46",
pages = "2005--2018",
journal = "Health Services Research",
issn = "0017-9124",
publisher = "Wiley-Blackwell",
number = "6 PART 1",

}

TY - JOUR

T1 - Assessment of a novel hybrid Delphi and nominal groups technique to evaluate quality indicators

AU - Davies, Sheryl

AU - Romano, Patrick S

AU - Schmidt, Eric M.

AU - Schultz, Ellen

AU - Geppert, Jeffrey J.

AU - McDonald, Kathryn M.

PY - 2011/12

Y1 - 2011/12

N2 - Objective. To test the implementation of a novel structured panel process in the evaluation of quality indicators. Data Source. National panel of 64 clinicians rating usefulness of indicator applications in 2008-2009. Study Design. Hybrid panel combined Delphi Group and Nominal Group (NG) techniques to evaluate 81 indicator applications. Principal Findings. The Delphi Group and NG rated 56 percent of indicator applications similarly. Group assignment (Delphi versus Nominal) was not significantly associated with mean ratings, but specialty and research interests of panelists, and indicator factors such as denominator level and proposed use were. Rating distributions narrowed significantly in 20.8 percent of applications between review rounds. Conclusions. The hybrid panel process facilitated information exchange and tightened rating distributions. Future assessments of this method might include a control panel.

AB - Objective. To test the implementation of a novel structured panel process in the evaluation of quality indicators. Data Source. National panel of 64 clinicians rating usefulness of indicator applications in 2008-2009. Study Design. Hybrid panel combined Delphi Group and Nominal Group (NG) techniques to evaluate 81 indicator applications. Principal Findings. The Delphi Group and NG rated 56 percent of indicator applications similarly. Group assignment (Delphi versus Nominal) was not significantly associated with mean ratings, but specialty and research interests of panelists, and indicator factors such as denominator level and proposed use were. Rating distributions narrowed significantly in 20.8 percent of applications between review rounds. Conclusions. The hybrid panel process facilitated information exchange and tightened rating distributions. Future assessments of this method might include a control panel.

KW - Delphi method

KW - Nominal Group technique

KW - Quality indicators

UR - http://www.scopus.com/inward/record.url?scp=81755161513&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=81755161513&partnerID=8YFLogxK

U2 - 10.1111/j.1475-6773.2011.01297.x

DO - 10.1111/j.1475-6773.2011.01297.x

M3 - Article

VL - 46

SP - 2005

EP - 2018

JO - Health Services Research

JF - Health Services Research

SN - 0017-9124

IS - 6 PART 1

ER -