Detecting the effects of physician training in self-care interviewing skills

Coding of standardized patient (SP) visit recordings versus SP post-visit ratings

Anthony F Jerant, Brent Hanson, Richard L Kravitz, Daniel J Tancredi, Emily Hanes, Sanjeet Grewal, Rimaben Cabrera, Peter Franks

Research output: Contribution to journalArticle

Abstract

Objective: To compare how coder ratings of standardized patient (SP) visit recordings and SP ratings of the visits detect primary care physician (PCP) training in self-efficacy enhancing interviewing techniques (SEE IT). Methods: Analyses of data from 50 PCPs who participated in a randomized controlled trial of SEE IT training, which led to increased SEE IT use during three SP visits 1-3 months post-intervention. Untrained SPs rated SEE IT use post-visit. Subsequently, three trained coders generated a consensus SEE IT rating from visit audio recordings. SPs and coders were blinded to provider study arm, and coders to SP ratings. Results: SP and coder ratings were correlated (r = 0.62). In detecting the intervention effect, the areas under the receiver operating characteristic curve were 0.80 (95% CI 0.74-0.87) and 0.76 (95% CI 0.69-0.84) for consensus coder and SP ratings, respectively (difference 0.04, 95% CI -0.04-0.11; z = 1.04, p = 0.30). Conclusion: SP ratings were not significantly different from coder ratings of SP visit recordings in detecting PCP SEE IT training. Practice implications: If similar findings are observed in larger studies, it would suggest a greater role for SP ratings in detecting provider interviewing skills training, given the relative simplicity, low cost, and non-intrusiveness of the approach.

Original languageEnglish (US)
JournalPatient Education and Counseling
DOIs
StateAccepted/In press - Apr 19 2016

Fingerprint

Self Care
Self Efficacy
Physicians
Primary Care Physicians
Consensus
Teaching
Post and Core Technique
ROC Curve
Randomized Controlled Trials
Costs and Cost Analysis

Keywords

  • Area under curve
  • Audio recording
  • Interviews as topic
  • Motivation
  • Predictive validity
  • Primary care
  • Self-efficacy
  • Standardized patients

ASJC Scopus subject areas

  • Medicine(all)

Cite this

@article{943fc095c59f4234b565a02f5dc0a9c8,
title = "Detecting the effects of physician training in self-care interviewing skills: Coding of standardized patient (SP) visit recordings versus SP post-visit ratings",
abstract = "Objective: To compare how coder ratings of standardized patient (SP) visit recordings and SP ratings of the visits detect primary care physician (PCP) training in self-efficacy enhancing interviewing techniques (SEE IT). Methods: Analyses of data from 50 PCPs who participated in a randomized controlled trial of SEE IT training, which led to increased SEE IT use during three SP visits 1-3 months post-intervention. Untrained SPs rated SEE IT use post-visit. Subsequently, three trained coders generated a consensus SEE IT rating from visit audio recordings. SPs and coders were blinded to provider study arm, and coders to SP ratings. Results: SP and coder ratings were correlated (r = 0.62). In detecting the intervention effect, the areas under the receiver operating characteristic curve were 0.80 (95{\%} CI 0.74-0.87) and 0.76 (95{\%} CI 0.69-0.84) for consensus coder and SP ratings, respectively (difference 0.04, 95{\%} CI -0.04-0.11; z = 1.04, p = 0.30). Conclusion: SP ratings were not significantly different from coder ratings of SP visit recordings in detecting PCP SEE IT training. Practice implications: If similar findings are observed in larger studies, it would suggest a greater role for SP ratings in detecting provider interviewing skills training, given the relative simplicity, low cost, and non-intrusiveness of the approach.",
keywords = "Area under curve, Audio recording, Interviews as topic, Motivation, Predictive validity, Primary care, Self-efficacy, Standardized patients",
author = "Jerant, {Anthony F} and Brent Hanson and Kravitz, {Richard L} and Tancredi, {Daniel J} and Emily Hanes and Sanjeet Grewal and Rimaben Cabrera and Peter Franks",
year = "2016",
month = "4",
day = "19",
doi = "10.1016/j.pec.2016.08.021",
language = "English (US)",
journal = "Patient Education and Counseling",
issn = "0738-3991",
publisher = "Elsevier Ireland Ltd",

}

TY - JOUR

T1 - Detecting the effects of physician training in self-care interviewing skills

T2 - Coding of standardized patient (SP) visit recordings versus SP post-visit ratings

AU - Jerant, Anthony F

AU - Hanson, Brent

AU - Kravitz, Richard L

AU - Tancredi, Daniel J

AU - Hanes, Emily

AU - Grewal, Sanjeet

AU - Cabrera, Rimaben

AU - Franks, Peter

PY - 2016/4/19

Y1 - 2016/4/19

N2 - Objective: To compare how coder ratings of standardized patient (SP) visit recordings and SP ratings of the visits detect primary care physician (PCP) training in self-efficacy enhancing interviewing techniques (SEE IT). Methods: Analyses of data from 50 PCPs who participated in a randomized controlled trial of SEE IT training, which led to increased SEE IT use during three SP visits 1-3 months post-intervention. Untrained SPs rated SEE IT use post-visit. Subsequently, three trained coders generated a consensus SEE IT rating from visit audio recordings. SPs and coders were blinded to provider study arm, and coders to SP ratings. Results: SP and coder ratings were correlated (r = 0.62). In detecting the intervention effect, the areas under the receiver operating characteristic curve were 0.80 (95% CI 0.74-0.87) and 0.76 (95% CI 0.69-0.84) for consensus coder and SP ratings, respectively (difference 0.04, 95% CI -0.04-0.11; z = 1.04, p = 0.30). Conclusion: SP ratings were not significantly different from coder ratings of SP visit recordings in detecting PCP SEE IT training. Practice implications: If similar findings are observed in larger studies, it would suggest a greater role for SP ratings in detecting provider interviewing skills training, given the relative simplicity, low cost, and non-intrusiveness of the approach.

AB - Objective: To compare how coder ratings of standardized patient (SP) visit recordings and SP ratings of the visits detect primary care physician (PCP) training in self-efficacy enhancing interviewing techniques (SEE IT). Methods: Analyses of data from 50 PCPs who participated in a randomized controlled trial of SEE IT training, which led to increased SEE IT use during three SP visits 1-3 months post-intervention. Untrained SPs rated SEE IT use post-visit. Subsequently, three trained coders generated a consensus SEE IT rating from visit audio recordings. SPs and coders were blinded to provider study arm, and coders to SP ratings. Results: SP and coder ratings were correlated (r = 0.62). In detecting the intervention effect, the areas under the receiver operating characteristic curve were 0.80 (95% CI 0.74-0.87) and 0.76 (95% CI 0.69-0.84) for consensus coder and SP ratings, respectively (difference 0.04, 95% CI -0.04-0.11; z = 1.04, p = 0.30). Conclusion: SP ratings were not significantly different from coder ratings of SP visit recordings in detecting PCP SEE IT training. Practice implications: If similar findings are observed in larger studies, it would suggest a greater role for SP ratings in detecting provider interviewing skills training, given the relative simplicity, low cost, and non-intrusiveness of the approach.

KW - Area under curve

KW - Audio recording

KW - Interviews as topic

KW - Motivation

KW - Predictive validity

KW - Primary care

KW - Self-efficacy

KW - Standardized patients

UR - http://www.scopus.com/inward/record.url?scp=84994475148&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84994475148&partnerID=8YFLogxK

U2 - 10.1016/j.pec.2016.08.021

DO - 10.1016/j.pec.2016.08.021

M3 - Article

JO - Patient Education and Counseling

JF - Patient Education and Counseling

SN - 0738-3991

ER -