Are nonspecific practice guidelines potentially harmful? A randomized comparison of the effect of nonspecific versus specific guidelines on physician decision making

Paul G. Shekelle, Richard L. Kravitz, Jennifer Beart, Michael Marger, Mingming Wang, Martin Lee

Research output: Contribution to journalArticle

90 Citations (Scopus)

Abstract

Objective. To test the ability of two different clinical practice guideline formats to influence physician ordering of electrodiagnostic tests in low back pain. Data Sources/Study Design. Randomized controlled trial of the effect of practice guidelines on self-reported physician test ordering behavior in response to a series of 12 clinical vignettes. Data came from a national random sample of 900 U.S. neurologists, physical medicine physicians, and general internists. Intervention. Two different versions of a practice guideline for the use of electrodiagnostic tests (EDT) were developed by the U.S. Agency for Health Care Policy and Research Low Back Problems Panel. The two guidelines were similar in content but varied in the specificity of their recommendations. Data Collection. The proportion of clinical vignettes for which EDTs were ordered for appropriate and inappropriate clinical indications in each of three physician groups were randomly assigned to receive vignettes alone, vignettes plus the nonspecific version of the guideline, or vignettes plus the specific version of the guideline. Principal Findings. The response rate to the survey was 71 percent. The proportion of appropriate vignettes for which EDTs were ordered averaged 77 percent for the no guideline group, 71 percent for the nonspecific guideline group, and 79 percent for the specific guideline group (p = .002). The corresponding values for the number of EDTs ordered for inappropriate vignettes were 32 percent, 32 percent, and 26 percent, respectively (p = .08). Pairwise comparisons showed that physicians receiving the nonspecific guidelines ordered fewer EDTs for appropriate clinical vignettes than did physicians receiving no guidelines (p = .02). Furthermore, compared to physicians receiving nonspecific guidelines, physicians receiving specific guidelines ordered significantly more EDTs for appropriate vignettes (p = .0007) and significantly fewer EDTs for inappropriate vignettes (p = .04). Conclusions. The clarity and clinical applicability of a guideline may be important attributes that contribute to the effects of practice guidelines.

Original languageEnglish (US)
Pages (from-to)1429-1448
Number of pages20
JournalHealth Services Research
Volume34
Issue number7
StatePublished - Mar 2000

Fingerprint

Practice Guidelines
Decision Making
physician
Guidelines
Physicians
decision making
Group
United States Agency for Healthcare Research and Quality
random sample
Physical and Rehabilitation Medicine
Aptitude
pain
indication
Information Storage and Retrieval
Low Back Pain
medicine
health care
Randomized Controlled Trials
ability
Values

Keywords

  • Physician decision making
  • Practice guidelines: Nonspecific, specific

ASJC Scopus subject areas

  • Nursing(all)
  • Health(social science)
  • Health Professions(all)
  • Health Policy

Cite this

Are nonspecific practice guidelines potentially harmful? A randomized comparison of the effect of nonspecific versus specific guidelines on physician decision making. / Shekelle, Paul G.; Kravitz, Richard L.; Beart, Jennifer; Marger, Michael; Wang, Mingming; Lee, Martin.

In: Health Services Research, Vol. 34, No. 7, 03.2000, p. 1429-1448.

Research output: Contribution to journalArticle

@article{b33795452a0241aa99c9a834263d7b2d,
title = "Are nonspecific practice guidelines potentially harmful? A randomized comparison of the effect of nonspecific versus specific guidelines on physician decision making",
abstract = "Objective. To test the ability of two different clinical practice guideline formats to influence physician ordering of electrodiagnostic tests in low back pain. Data Sources/Study Design. Randomized controlled trial of the effect of practice guidelines on self-reported physician test ordering behavior in response to a series of 12 clinical vignettes. Data came from a national random sample of 900 U.S. neurologists, physical medicine physicians, and general internists. Intervention. Two different versions of a practice guideline for the use of electrodiagnostic tests (EDT) were developed by the U.S. Agency for Health Care Policy and Research Low Back Problems Panel. The two guidelines were similar in content but varied in the specificity of their recommendations. Data Collection. The proportion of clinical vignettes for which EDTs were ordered for appropriate and inappropriate clinical indications in each of three physician groups were randomly assigned to receive vignettes alone, vignettes plus the nonspecific version of the guideline, or vignettes plus the specific version of the guideline. Principal Findings. The response rate to the survey was 71 percent. The proportion of appropriate vignettes for which EDTs were ordered averaged 77 percent for the no guideline group, 71 percent for the nonspecific guideline group, and 79 percent for the specific guideline group (p = .002). The corresponding values for the number of EDTs ordered for inappropriate vignettes were 32 percent, 32 percent, and 26 percent, respectively (p = .08). Pairwise comparisons showed that physicians receiving the nonspecific guidelines ordered fewer EDTs for appropriate clinical vignettes than did physicians receiving no guidelines (p = .02). Furthermore, compared to physicians receiving nonspecific guidelines, physicians receiving specific guidelines ordered significantly more EDTs for appropriate vignettes (p = .0007) and significantly fewer EDTs for inappropriate vignettes (p = .04). Conclusions. The clarity and clinical applicability of a guideline may be important attributes that contribute to the effects of practice guidelines.",
keywords = "Physician decision making, Practice guidelines: Nonspecific, specific",
author = "Shekelle, {Paul G.} and Kravitz, {Richard L.} and Jennifer Beart and Michael Marger and Mingming Wang and Martin Lee",
year = "2000",
month = "3",
language = "English (US)",
volume = "34",
pages = "1429--1448",
journal = "Health Services Research",
issn = "0017-9124",
publisher = "Wiley-Blackwell",
number = "7",

}

TY - JOUR

T1 - Are nonspecific practice guidelines potentially harmful? A randomized comparison of the effect of nonspecific versus specific guidelines on physician decision making

AU - Shekelle, Paul G.

AU - Kravitz, Richard L.

AU - Beart, Jennifer

AU - Marger, Michael

AU - Wang, Mingming

AU - Lee, Martin

PY - 2000/3

Y1 - 2000/3

N2 - Objective. To test the ability of two different clinical practice guideline formats to influence physician ordering of electrodiagnostic tests in low back pain. Data Sources/Study Design. Randomized controlled trial of the effect of practice guidelines on self-reported physician test ordering behavior in response to a series of 12 clinical vignettes. Data came from a national random sample of 900 U.S. neurologists, physical medicine physicians, and general internists. Intervention. Two different versions of a practice guideline for the use of electrodiagnostic tests (EDT) were developed by the U.S. Agency for Health Care Policy and Research Low Back Problems Panel. The two guidelines were similar in content but varied in the specificity of their recommendations. Data Collection. The proportion of clinical vignettes for which EDTs were ordered for appropriate and inappropriate clinical indications in each of three physician groups were randomly assigned to receive vignettes alone, vignettes plus the nonspecific version of the guideline, or vignettes plus the specific version of the guideline. Principal Findings. The response rate to the survey was 71 percent. The proportion of appropriate vignettes for which EDTs were ordered averaged 77 percent for the no guideline group, 71 percent for the nonspecific guideline group, and 79 percent for the specific guideline group (p = .002). The corresponding values for the number of EDTs ordered for inappropriate vignettes were 32 percent, 32 percent, and 26 percent, respectively (p = .08). Pairwise comparisons showed that physicians receiving the nonspecific guidelines ordered fewer EDTs for appropriate clinical vignettes than did physicians receiving no guidelines (p = .02). Furthermore, compared to physicians receiving nonspecific guidelines, physicians receiving specific guidelines ordered significantly more EDTs for appropriate vignettes (p = .0007) and significantly fewer EDTs for inappropriate vignettes (p = .04). Conclusions. The clarity and clinical applicability of a guideline may be important attributes that contribute to the effects of practice guidelines.

AB - Objective. To test the ability of two different clinical practice guideline formats to influence physician ordering of electrodiagnostic tests in low back pain. Data Sources/Study Design. Randomized controlled trial of the effect of practice guidelines on self-reported physician test ordering behavior in response to a series of 12 clinical vignettes. Data came from a national random sample of 900 U.S. neurologists, physical medicine physicians, and general internists. Intervention. Two different versions of a practice guideline for the use of electrodiagnostic tests (EDT) were developed by the U.S. Agency for Health Care Policy and Research Low Back Problems Panel. The two guidelines were similar in content but varied in the specificity of their recommendations. Data Collection. The proportion of clinical vignettes for which EDTs were ordered for appropriate and inappropriate clinical indications in each of three physician groups were randomly assigned to receive vignettes alone, vignettes plus the nonspecific version of the guideline, or vignettes plus the specific version of the guideline. Principal Findings. The response rate to the survey was 71 percent. The proportion of appropriate vignettes for which EDTs were ordered averaged 77 percent for the no guideline group, 71 percent for the nonspecific guideline group, and 79 percent for the specific guideline group (p = .002). The corresponding values for the number of EDTs ordered for inappropriate vignettes were 32 percent, 32 percent, and 26 percent, respectively (p = .08). Pairwise comparisons showed that physicians receiving the nonspecific guidelines ordered fewer EDTs for appropriate clinical vignettes than did physicians receiving no guidelines (p = .02). Furthermore, compared to physicians receiving nonspecific guidelines, physicians receiving specific guidelines ordered significantly more EDTs for appropriate vignettes (p = .0007) and significantly fewer EDTs for inappropriate vignettes (p = .04). Conclusions. The clarity and clinical applicability of a guideline may be important attributes that contribute to the effects of practice guidelines.

KW - Physician decision making

KW - Practice guidelines: Nonspecific, specific

UR - http://www.scopus.com/inward/record.url?scp=0034094267&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0034094267&partnerID=8YFLogxK

M3 - Article

C2 - 10737446

AN - SCOPUS:0034094267

VL - 34

SP - 1429

EP - 1448

JO - Health Services Research

JF - Health Services Research

SN - 0017-9124

IS - 7

ER -