Detection of postoperative respiratory failure: How predictive is the agency for healthcare research and quality's patient safety indicator?

Garth H Utter, Joanne Cuny, Pradeep Sama, Michael R. Silver, Patricia A. Zrelak, Ruth Baron, Saskia E. Drsler, Patrick S Romano

Research output: Contribution to journalArticlepeer-review

38 Scopus citations


BACKGROUND: Patient Safety Indicator (PSI) 11, or postoperative respiratory failure, was developed by the US Agency for Healthcare Research and Quality to detect incident cases of respiratory failure after elective operations through use of ICD-9-CM diagnosis and procedure codes. We sought to determine the positive predictive value (PPV) of this indicator. STUDY DESIGN: We conducted a retrospective cross-sectional study, sampling consecutive cases that met PSI 11 criteria from 18 geographically diverse academic medical centers on or before June 30, 2007. Trained abstractors from each center reviewed medical records using a standard instrument. We assessed the PPV of the indicator (with 95% CI adjusted for clustering within centers) and conducted descriptive analyses of the cases. RESULTS: Of 609 cases that met PSI 11 criteria, 551 (90.5%; 95% CI, 86.594.4%) satisfied the technical criteria of the indicator and 507 (83.2%; 95% CI, 77.289.3%) represented true cases of postoperative respiratory failure from a clinical standpoint. The most frequent reasons for being falsely positive were nonelective hospitalization, prolonged intubation for airway protection, and insufficient evidence to support a diagnosis of acute respiratory failure. Fifty percent of true-positive cases involved substantial baseline comorbidities, and 23% resulted in death. CONCLUSIONS: Although PSI 11 predicts true postoperative respiratory failure with relatively high frequency, the indicator does not limit detection to preventable cases. The PPV of PSI 11 might be increased by excluding cases with a principal diagnosis suggestive of a nonelective hospitalization and those with head or neck procedures. Removing the diagnosis code criterion from the indicator might also increase PPV, but would decrease the number of true positive cases detected by 20%.

Original languageEnglish (US)
JournalJournal of the American College of Surgeons
Issue number3
StatePublished - Sep 2010


  • major diagnostic category
  • MDC
  • National Surgical Quality Improvement Program
  • patient safety indicator
  • positive predictive value
  • postoperative respiratory failure
  • PPV
  • PRF
  • PSI
  • UHC
  • University HealthSystem Consortium

ASJC Scopus subject areas

  • Surgery


Dive into the research topics of 'Detection of postoperative respiratory failure: How predictive is the agency for healthcare research and quality's patient safety indicator?'. Together they form a unique fingerprint.

Cite this