Heterogeneity of Treatment Effects: Implications for Guidelines, Payment, and Quality Assessment

Sheldon Greenfield, Richard L Kravitz, Naihua Duan, Sherrie H. Kaplan

Research output: Contribution to journalArticle

66 Citations (Scopus)

Abstract

Randomized controlled trial results are needed for developing guidelines, payment rules, and quality-of-care measures; however, 2 phenomena reduce the usefulness of randomized controlled trial findings. First, these studies now enroll patients with less severe disease, who are less likely to benefit from a drug or treatment. Second, patients are living longer but, as a result, have more chronic diseases. Although randomized controlled trials often exclude these older patients, trial findings continue to be generalized to them. Together, these phenomena impose challenges to the usefulness of the results of randomized controlled trials for clinical and policy applications. The convergence of these phenomena makes the current research paradigm underlying evidence-based medicine, guideline development and quality assessment fundamentally flawed in 2 ways. First, the "evidence" includes patients who may have a minimal benefit from the treatment being tested. This could reduce the power for the trial and yield negative or null results, leading to undertreatment of a group of patients with potential for a greater-than-observed benefit. Second, attempts to generalize the results from positive trials to patients who have been excluded from those trials may result in the overtreatment of those who could not benefit (e.g., because they will die from other causes before the benefit of treatment would occur) and therefore represents a parallel hazard. In this article, we describe sources of heterogeneity of treatment effects (HTE) within trials, which can compromise the interpretation and generalizability of results. We also examine strategies for understanding and managing HTE in practice, to increase the usefulness of trial results.

Original languageEnglish (US)
JournalAmerican Journal of Medicine
Volume120
Issue number4 SUPPL.
DOIs
StatePublished - Apr 2007

Fingerprint

Guidelines
Randomized Controlled Trials
Therapeutics
Quality of Health Care
Evidence-Based Medicine
Chronic Disease
Research
Pharmaceutical Preparations

Keywords

  • Health policy
  • Healthcare quality assurance
  • Heterogeneity
  • Population genetics
  • Practice guidelines

ASJC Scopus subject areas

  • Nursing(all)

Cite this

Heterogeneity of Treatment Effects : Implications for Guidelines, Payment, and Quality Assessment. / Greenfield, Sheldon; Kravitz, Richard L; Duan, Naihua; Kaplan, Sherrie H.

In: American Journal of Medicine, Vol. 120, No. 4 SUPPL., 04.2007.

Research output: Contribution to journalArticle

@article{341c0f17e2e54da994fdc41ecc285170,
title = "Heterogeneity of Treatment Effects: Implications for Guidelines, Payment, and Quality Assessment",
abstract = "Randomized controlled trial results are needed for developing guidelines, payment rules, and quality-of-care measures; however, 2 phenomena reduce the usefulness of randomized controlled trial findings. First, these studies now enroll patients with less severe disease, who are less likely to benefit from a drug or treatment. Second, patients are living longer but, as a result, have more chronic diseases. Although randomized controlled trials often exclude these older patients, trial findings continue to be generalized to them. Together, these phenomena impose challenges to the usefulness of the results of randomized controlled trials for clinical and policy applications. The convergence of these phenomena makes the current research paradigm underlying evidence-based medicine, guideline development and quality assessment fundamentally flawed in 2 ways. First, the {"}evidence{"} includes patients who may have a minimal benefit from the treatment being tested. This could reduce the power for the trial and yield negative or null results, leading to undertreatment of a group of patients with potential for a greater-than-observed benefit. Second, attempts to generalize the results from positive trials to patients who have been excluded from those trials may result in the overtreatment of those who could not benefit (e.g., because they will die from other causes before the benefit of treatment would occur) and therefore represents a parallel hazard. In this article, we describe sources of heterogeneity of treatment effects (HTE) within trials, which can compromise the interpretation and generalizability of results. We also examine strategies for understanding and managing HTE in practice, to increase the usefulness of trial results.",
keywords = "Health policy, Healthcare quality assurance, Heterogeneity, Population genetics, Practice guidelines",
author = "Sheldon Greenfield and Kravitz, {Richard L} and Naihua Duan and Kaplan, {Sherrie H.}",
year = "2007",
month = "4",
doi = "10.1016/j.amjmed.2007.02.002",
language = "English (US)",
volume = "120",
journal = "American Journal of Medicine",
issn = "0002-9343",
publisher = "Elsevier Inc.",
number = "4 SUPPL.",

}

TY - JOUR

T1 - Heterogeneity of Treatment Effects

T2 - Implications for Guidelines, Payment, and Quality Assessment

AU - Greenfield, Sheldon

AU - Kravitz, Richard L

AU - Duan, Naihua

AU - Kaplan, Sherrie H.

PY - 2007/4

Y1 - 2007/4

N2 - Randomized controlled trial results are needed for developing guidelines, payment rules, and quality-of-care measures; however, 2 phenomena reduce the usefulness of randomized controlled trial findings. First, these studies now enroll patients with less severe disease, who are less likely to benefit from a drug or treatment. Second, patients are living longer but, as a result, have more chronic diseases. Although randomized controlled trials often exclude these older patients, trial findings continue to be generalized to them. Together, these phenomena impose challenges to the usefulness of the results of randomized controlled trials for clinical and policy applications. The convergence of these phenomena makes the current research paradigm underlying evidence-based medicine, guideline development and quality assessment fundamentally flawed in 2 ways. First, the "evidence" includes patients who may have a minimal benefit from the treatment being tested. This could reduce the power for the trial and yield negative or null results, leading to undertreatment of a group of patients with potential for a greater-than-observed benefit. Second, attempts to generalize the results from positive trials to patients who have been excluded from those trials may result in the overtreatment of those who could not benefit (e.g., because they will die from other causes before the benefit of treatment would occur) and therefore represents a parallel hazard. In this article, we describe sources of heterogeneity of treatment effects (HTE) within trials, which can compromise the interpretation and generalizability of results. We also examine strategies for understanding and managing HTE in practice, to increase the usefulness of trial results.

AB - Randomized controlled trial results are needed for developing guidelines, payment rules, and quality-of-care measures; however, 2 phenomena reduce the usefulness of randomized controlled trial findings. First, these studies now enroll patients with less severe disease, who are less likely to benefit from a drug or treatment. Second, patients are living longer but, as a result, have more chronic diseases. Although randomized controlled trials often exclude these older patients, trial findings continue to be generalized to them. Together, these phenomena impose challenges to the usefulness of the results of randomized controlled trials for clinical and policy applications. The convergence of these phenomena makes the current research paradigm underlying evidence-based medicine, guideline development and quality assessment fundamentally flawed in 2 ways. First, the "evidence" includes patients who may have a minimal benefit from the treatment being tested. This could reduce the power for the trial and yield negative or null results, leading to undertreatment of a group of patients with potential for a greater-than-observed benefit. Second, attempts to generalize the results from positive trials to patients who have been excluded from those trials may result in the overtreatment of those who could not benefit (e.g., because they will die from other causes before the benefit of treatment would occur) and therefore represents a parallel hazard. In this article, we describe sources of heterogeneity of treatment effects (HTE) within trials, which can compromise the interpretation and generalizability of results. We also examine strategies for understanding and managing HTE in practice, to increase the usefulness of trial results.

KW - Health policy

KW - Healthcare quality assurance

KW - Heterogeneity

KW - Population genetics

KW - Practice guidelines

UR - http://www.scopus.com/inward/record.url?scp=33947617788&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33947617788&partnerID=8YFLogxK

U2 - 10.1016/j.amjmed.2007.02.002

DO - 10.1016/j.amjmed.2007.02.002

M3 - Article

C2 - 17403380

AN - SCOPUS:33947617788

VL - 120

JO - American Journal of Medicine

JF - American Journal of Medicine

SN - 0002-9343

IS - 4 SUPPL.

ER -