Abstract
Objective: To compare how coder ratings of standardized patient (SP) visit recordings and SP ratings of the visits detect primary care physician (PCP) training in self-efficacy enhancing interviewing techniques (SEE IT). Methods: Analyses of data from 50 PCPs who participated in a randomized controlled trial of SEE IT training, which led to increased SEE IT use during three SP visits 1-3 months post-intervention. Untrained SPs rated SEE IT use post-visit. Subsequently, three trained coders generated a consensus SEE IT rating from visit audio recordings. SPs and coders were blinded to provider study arm, and coders to SP ratings. Results: SP and coder ratings were correlated (r = 0.62). In detecting the intervention effect, the areas under the receiver operating characteristic curve were 0.80 (95% CI 0.74-0.87) and 0.76 (95% CI 0.69-0.84) for consensus coder and SP ratings, respectively (difference 0.04, 95% CI -0.04-0.11; z = 1.04, p = 0.30). Conclusion: SP ratings were not significantly different from coder ratings of SP visit recordings in detecting PCP SEE IT training. Practice implications: If similar findings are observed in larger studies, it would suggest a greater role for SP ratings in detecting provider interviewing skills training, given the relative simplicity, low cost, and non-intrusiveness of the approach.
| Original language | English (US) |
|---|---|
| Journal | Patient Education and Counseling |
| DOIs | |
| State | Accepted/In press - Apr 19 2016 |
Fingerprint
Keywords
- Area under curve
- Audio recording
- Interviews as topic
- Motivation
- Predictive validity
- Primary care
- Self-efficacy
- Standardized patients
ASJC Scopus subject areas
- Medicine(all)
Cite this
Detecting the effects of physician training in self-care interviewing skills : Coding of standardized patient (SP) visit recordings versus SP post-visit ratings. / Jerant, Anthony F; Hanson, Brent; Kravitz, Richard L; Tancredi, Daniel J; Hanes, Emily; Grewal, Sanjeet; Cabrera, Rimaben; Franks, Peter.
In: Patient Education and Counseling, 19.04.2016.Research output: Contribution to journal › Article
}
TY - JOUR
T1 - Detecting the effects of physician training in self-care interviewing skills
T2 - Coding of standardized patient (SP) visit recordings versus SP post-visit ratings
AU - Jerant, Anthony F
AU - Hanson, Brent
AU - Kravitz, Richard L
AU - Tancredi, Daniel J
AU - Hanes, Emily
AU - Grewal, Sanjeet
AU - Cabrera, Rimaben
AU - Franks, Peter
PY - 2016/4/19
Y1 - 2016/4/19
N2 - Objective: To compare how coder ratings of standardized patient (SP) visit recordings and SP ratings of the visits detect primary care physician (PCP) training in self-efficacy enhancing interviewing techniques (SEE IT). Methods: Analyses of data from 50 PCPs who participated in a randomized controlled trial of SEE IT training, which led to increased SEE IT use during three SP visits 1-3 months post-intervention. Untrained SPs rated SEE IT use post-visit. Subsequently, three trained coders generated a consensus SEE IT rating from visit audio recordings. SPs and coders were blinded to provider study arm, and coders to SP ratings. Results: SP and coder ratings were correlated (r = 0.62). In detecting the intervention effect, the areas under the receiver operating characteristic curve were 0.80 (95% CI 0.74-0.87) and 0.76 (95% CI 0.69-0.84) for consensus coder and SP ratings, respectively (difference 0.04, 95% CI -0.04-0.11; z = 1.04, p = 0.30). Conclusion: SP ratings were not significantly different from coder ratings of SP visit recordings in detecting PCP SEE IT training. Practice implications: If similar findings are observed in larger studies, it would suggest a greater role for SP ratings in detecting provider interviewing skills training, given the relative simplicity, low cost, and non-intrusiveness of the approach.
AB - Objective: To compare how coder ratings of standardized patient (SP) visit recordings and SP ratings of the visits detect primary care physician (PCP) training in self-efficacy enhancing interviewing techniques (SEE IT). Methods: Analyses of data from 50 PCPs who participated in a randomized controlled trial of SEE IT training, which led to increased SEE IT use during three SP visits 1-3 months post-intervention. Untrained SPs rated SEE IT use post-visit. Subsequently, three trained coders generated a consensus SEE IT rating from visit audio recordings. SPs and coders were blinded to provider study arm, and coders to SP ratings. Results: SP and coder ratings were correlated (r = 0.62). In detecting the intervention effect, the areas under the receiver operating characteristic curve were 0.80 (95% CI 0.74-0.87) and 0.76 (95% CI 0.69-0.84) for consensus coder and SP ratings, respectively (difference 0.04, 95% CI -0.04-0.11; z = 1.04, p = 0.30). Conclusion: SP ratings were not significantly different from coder ratings of SP visit recordings in detecting PCP SEE IT training. Practice implications: If similar findings are observed in larger studies, it would suggest a greater role for SP ratings in detecting provider interviewing skills training, given the relative simplicity, low cost, and non-intrusiveness of the approach.
KW - Area under curve
KW - Audio recording
KW - Interviews as topic
KW - Motivation
KW - Predictive validity
KW - Primary care
KW - Self-efficacy
KW - Standardized patients
UR - http://www.scopus.com/inward/record.url?scp=84994475148&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84994475148&partnerID=8YFLogxK
U2 - 10.1016/j.pec.2016.08.021
DO - 10.1016/j.pec.2016.08.021
M3 - Article
JO - Patient Education and Counseling
JF - Patient Education and Counseling
SN - 0738-3991
ER -