Program Factors That Influence American Board of Surgery In-Training Examination Performance: A Multi-Institutional Study

Jerry J. Kim, Edward D. Gifford, Ashkan Moazzez, Richard A. Sidwell, Mark E. Reeves, Thomas H. Hartranft, Kenji Inaba, Benjamin T. Jarman, Chandrakanth Are, Joseph M Galante, Farin Amersi, Brian R. Smith, Marc L. Melcher, M. Timothy Nelson, Timothy Donahue, Garth Jacobsen, Tracey D. Arnell, Steven Lee, Angela Neville, Christian de Virgilio

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

Objective: To determine the influence of program strategies, such as program directors' (PD) attitudes about the American Board of Surgery In-Training Examination (ABSITE) and approach to ABSITE preparation, on residents' ABSITE performance. Design: A 17-item questionnaire was sent to PDs at surgical residency programs. The questions were designed to elicit information regarding the educational curriculum, remediation protocols, and opinions relating to the ABSITE. Main outcome measure was categorical resident ABSITE percentile scores from the January 2014 examination. Statistical analysis was performed using the Student t-test, analysis of variance, and linear regression as appropriate. Setting: The study was carried out at general surgery residency programs across the country. Participants: In total, 15 general surgery residency PDs participated in the study. Results: The PD response rate was 100%. All 460 resident ABSITE scores from the 15 programs were obtained. In total, 10 programs (67%) identified as university affiliated, 4 programs (27%) as independent academic, and 1 program (7%) as hybrid. The mean number of residents per program was 30.7 (range: 15-57). In total, 14 PDs (93%) indicated that an ABSITE review curriculum was in place and 13 PDs (87%) indicated they had a remediation protocol for residents with low ABSITE scores (with differing thresholds of <30th, <35th, and <40th percentile). The median overall ABSITE score for all residents was 61st percentile (interquartile range = 39.5). The mean ABSITE score for each program ranged from 39th to 75th percentile. Program factors associated with higher ABSITE scores included tracking resident reading throughout the year (median 63rd percentile with tracking vs 59th percentile without, p = 0.040) and the type of remediation (by PD: 77th percentile, by PD and faculty: 57th percentile, faculty only: 64th percentile, with Surgical Education and Self-Assessment Program (SESAP): 63rd percentile, outside review course: 43rd percentile; p < 0.001). Programs with a remediation protocol trended toward higher ABSITE scores compared with programs without remediation protocols (median 61st percentile vs 53rd percentile, p = 0.098). Factors not significantly associated with ABSITE performance included number of structured educational hours per week and frequency of ABSITE review sessions. Conclusions: Program factors appear to significantly influence ABSITE performance. Programs where the PD was actively involved in remediation mentorship and the tracking of resident reading achieved higher ABSITE percentile scores on the January 2014 examination. Counterintuitively, residents from programs with a lower ABSITE threshold for remediation performed better on the examination.

Original languageEnglish (US)
JournalJournal of Surgical Education
DOIs
StateAccepted/In press - 2015

Fingerprint

surgery
examination
performance
resident
director
Internship and Residency
Curriculum
Reading
A 17
Mentors
curriculum
self-assessment
analysis of variance

Keywords

  • ABSITE
  • Medical Knowledge
  • Patient Care
  • Practice-Based Learning and Improvement
  • Program director
  • Surgery residency
  • Surgical education
  • Systems-Based Practice

ASJC Scopus subject areas

  • Surgery
  • Education

Cite this

Kim, J. J., Gifford, E. D., Moazzez, A., Sidwell, R. A., Reeves, M. E., Hartranft, T. H., ... Virgilio, C. D. (Accepted/In press). Program Factors That Influence American Board of Surgery In-Training Examination Performance: A Multi-Institutional Study. Journal of Surgical Education. https://doi.org/10.1016/j.jsurg.2015.06.014

Program Factors That Influence American Board of Surgery In-Training Examination Performance : A Multi-Institutional Study. / Kim, Jerry J.; Gifford, Edward D.; Moazzez, Ashkan; Sidwell, Richard A.; Reeves, Mark E.; Hartranft, Thomas H.; Inaba, Kenji; Jarman, Benjamin T.; Are, Chandrakanth; Galante, Joseph M; Amersi, Farin; Smith, Brian R.; Melcher, Marc L.; Nelson, M. Timothy; Donahue, Timothy; Jacobsen, Garth; Arnell, Tracey D.; Lee, Steven; Neville, Angela; Virgilio, Christian de.

In: Journal of Surgical Education, 2015.

Research output: Contribution to journalArticle

Kim, JJ, Gifford, ED, Moazzez, A, Sidwell, RA, Reeves, ME, Hartranft, TH, Inaba, K, Jarman, BT, Are, C, Galante, JM, Amersi, F, Smith, BR, Melcher, ML, Nelson, MT, Donahue, T, Jacobsen, G, Arnell, TD, Lee, S, Neville, A & Virgilio, CD 2015, 'Program Factors That Influence American Board of Surgery In-Training Examination Performance: A Multi-Institutional Study', Journal of Surgical Education. https://doi.org/10.1016/j.jsurg.2015.06.014
Kim, Jerry J. ; Gifford, Edward D. ; Moazzez, Ashkan ; Sidwell, Richard A. ; Reeves, Mark E. ; Hartranft, Thomas H. ; Inaba, Kenji ; Jarman, Benjamin T. ; Are, Chandrakanth ; Galante, Joseph M ; Amersi, Farin ; Smith, Brian R. ; Melcher, Marc L. ; Nelson, M. Timothy ; Donahue, Timothy ; Jacobsen, Garth ; Arnell, Tracey D. ; Lee, Steven ; Neville, Angela ; Virgilio, Christian de. / Program Factors That Influence American Board of Surgery In-Training Examination Performance : A Multi-Institutional Study. In: Journal of Surgical Education. 2015.
@article{0be10686e73d4334a3c0eb78e3996e80,
title = "Program Factors That Influence American Board of Surgery In-Training Examination Performance: A Multi-Institutional Study",
abstract = "Objective: To determine the influence of program strategies, such as program directors' (PD) attitudes about the American Board of Surgery In-Training Examination (ABSITE) and approach to ABSITE preparation, on residents' ABSITE performance. Design: A 17-item questionnaire was sent to PDs at surgical residency programs. The questions were designed to elicit information regarding the educational curriculum, remediation protocols, and opinions relating to the ABSITE. Main outcome measure was categorical resident ABSITE percentile scores from the January 2014 examination. Statistical analysis was performed using the Student t-test, analysis of variance, and linear regression as appropriate. Setting: The study was carried out at general surgery residency programs across the country. Participants: In total, 15 general surgery residency PDs participated in the study. Results: The PD response rate was 100{\%}. All 460 resident ABSITE scores from the 15 programs were obtained. In total, 10 programs (67{\%}) identified as university affiliated, 4 programs (27{\%}) as independent academic, and 1 program (7{\%}) as hybrid. The mean number of residents per program was 30.7 (range: 15-57). In total, 14 PDs (93{\%}) indicated that an ABSITE review curriculum was in place and 13 PDs (87{\%}) indicated they had a remediation protocol for residents with low ABSITE scores (with differing thresholds of <30th, <35th, and <40th percentile). The median overall ABSITE score for all residents was 61st percentile (interquartile range = 39.5). The mean ABSITE score for each program ranged from 39th to 75th percentile. Program factors associated with higher ABSITE scores included tracking resident reading throughout the year (median 63rd percentile with tracking vs 59th percentile without, p = 0.040) and the type of remediation (by PD: 77th percentile, by PD and faculty: 57th percentile, faculty only: 64th percentile, with Surgical Education and Self-Assessment Program (SESAP): 63rd percentile, outside review course: 43rd percentile; p < 0.001). Programs with a remediation protocol trended toward higher ABSITE scores compared with programs without remediation protocols (median 61st percentile vs 53rd percentile, p = 0.098). Factors not significantly associated with ABSITE performance included number of structured educational hours per week and frequency of ABSITE review sessions. Conclusions: Program factors appear to significantly influence ABSITE performance. Programs where the PD was actively involved in remediation mentorship and the tracking of resident reading achieved higher ABSITE percentile scores on the January 2014 examination. Counterintuitively, residents from programs with a lower ABSITE threshold for remediation performed better on the examination.",
keywords = "ABSITE, Medical Knowledge, Patient Care, Practice-Based Learning and Improvement, Program director, Surgery residency, Surgical education, Systems-Based Practice",
author = "Kim, {Jerry J.} and Gifford, {Edward D.} and Ashkan Moazzez and Sidwell, {Richard A.} and Reeves, {Mark E.} and Hartranft, {Thomas H.} and Kenji Inaba and Jarman, {Benjamin T.} and Chandrakanth Are and Galante, {Joseph M} and Farin Amersi and Smith, {Brian R.} and Melcher, {Marc L.} and Nelson, {M. Timothy} and Timothy Donahue and Garth Jacobsen and Arnell, {Tracey D.} and Steven Lee and Angela Neville and Virgilio, {Christian de}",
year = "2015",
doi = "10.1016/j.jsurg.2015.06.014",
language = "English (US)",
journal = "Journal of Surgical Education",
issn = "1931-7204",
publisher = "Elsevier Inc.",

}

TY - JOUR

T1 - Program Factors That Influence American Board of Surgery In-Training Examination Performance

T2 - A Multi-Institutional Study

AU - Kim, Jerry J.

AU - Gifford, Edward D.

AU - Moazzez, Ashkan

AU - Sidwell, Richard A.

AU - Reeves, Mark E.

AU - Hartranft, Thomas H.

AU - Inaba, Kenji

AU - Jarman, Benjamin T.

AU - Are, Chandrakanth

AU - Galante, Joseph M

AU - Amersi, Farin

AU - Smith, Brian R.

AU - Melcher, Marc L.

AU - Nelson, M. Timothy

AU - Donahue, Timothy

AU - Jacobsen, Garth

AU - Arnell, Tracey D.

AU - Lee, Steven

AU - Neville, Angela

AU - Virgilio, Christian de

PY - 2015

Y1 - 2015

N2 - Objective: To determine the influence of program strategies, such as program directors' (PD) attitudes about the American Board of Surgery In-Training Examination (ABSITE) and approach to ABSITE preparation, on residents' ABSITE performance. Design: A 17-item questionnaire was sent to PDs at surgical residency programs. The questions were designed to elicit information regarding the educational curriculum, remediation protocols, and opinions relating to the ABSITE. Main outcome measure was categorical resident ABSITE percentile scores from the January 2014 examination. Statistical analysis was performed using the Student t-test, analysis of variance, and linear regression as appropriate. Setting: The study was carried out at general surgery residency programs across the country. Participants: In total, 15 general surgery residency PDs participated in the study. Results: The PD response rate was 100%. All 460 resident ABSITE scores from the 15 programs were obtained. In total, 10 programs (67%) identified as university affiliated, 4 programs (27%) as independent academic, and 1 program (7%) as hybrid. The mean number of residents per program was 30.7 (range: 15-57). In total, 14 PDs (93%) indicated that an ABSITE review curriculum was in place and 13 PDs (87%) indicated they had a remediation protocol for residents with low ABSITE scores (with differing thresholds of <30th, <35th, and <40th percentile). The median overall ABSITE score for all residents was 61st percentile (interquartile range = 39.5). The mean ABSITE score for each program ranged from 39th to 75th percentile. Program factors associated with higher ABSITE scores included tracking resident reading throughout the year (median 63rd percentile with tracking vs 59th percentile without, p = 0.040) and the type of remediation (by PD: 77th percentile, by PD and faculty: 57th percentile, faculty only: 64th percentile, with Surgical Education and Self-Assessment Program (SESAP): 63rd percentile, outside review course: 43rd percentile; p < 0.001). Programs with a remediation protocol trended toward higher ABSITE scores compared with programs without remediation protocols (median 61st percentile vs 53rd percentile, p = 0.098). Factors not significantly associated with ABSITE performance included number of structured educational hours per week and frequency of ABSITE review sessions. Conclusions: Program factors appear to significantly influence ABSITE performance. Programs where the PD was actively involved in remediation mentorship and the tracking of resident reading achieved higher ABSITE percentile scores on the January 2014 examination. Counterintuitively, residents from programs with a lower ABSITE threshold for remediation performed better on the examination.

AB - Objective: To determine the influence of program strategies, such as program directors' (PD) attitudes about the American Board of Surgery In-Training Examination (ABSITE) and approach to ABSITE preparation, on residents' ABSITE performance. Design: A 17-item questionnaire was sent to PDs at surgical residency programs. The questions were designed to elicit information regarding the educational curriculum, remediation protocols, and opinions relating to the ABSITE. Main outcome measure was categorical resident ABSITE percentile scores from the January 2014 examination. Statistical analysis was performed using the Student t-test, analysis of variance, and linear regression as appropriate. Setting: The study was carried out at general surgery residency programs across the country. Participants: In total, 15 general surgery residency PDs participated in the study. Results: The PD response rate was 100%. All 460 resident ABSITE scores from the 15 programs were obtained. In total, 10 programs (67%) identified as university affiliated, 4 programs (27%) as independent academic, and 1 program (7%) as hybrid. The mean number of residents per program was 30.7 (range: 15-57). In total, 14 PDs (93%) indicated that an ABSITE review curriculum was in place and 13 PDs (87%) indicated they had a remediation protocol for residents with low ABSITE scores (with differing thresholds of <30th, <35th, and <40th percentile). The median overall ABSITE score for all residents was 61st percentile (interquartile range = 39.5). The mean ABSITE score for each program ranged from 39th to 75th percentile. Program factors associated with higher ABSITE scores included tracking resident reading throughout the year (median 63rd percentile with tracking vs 59th percentile without, p = 0.040) and the type of remediation (by PD: 77th percentile, by PD and faculty: 57th percentile, faculty only: 64th percentile, with Surgical Education and Self-Assessment Program (SESAP): 63rd percentile, outside review course: 43rd percentile; p < 0.001). Programs with a remediation protocol trended toward higher ABSITE scores compared with programs without remediation protocols (median 61st percentile vs 53rd percentile, p = 0.098). Factors not significantly associated with ABSITE performance included number of structured educational hours per week and frequency of ABSITE review sessions. Conclusions: Program factors appear to significantly influence ABSITE performance. Programs where the PD was actively involved in remediation mentorship and the tracking of resident reading achieved higher ABSITE percentile scores on the January 2014 examination. Counterintuitively, residents from programs with a lower ABSITE threshold for remediation performed better on the examination.

KW - ABSITE

KW - Medical Knowledge

KW - Patient Care

KW - Practice-Based Learning and Improvement

KW - Program director

KW - Surgery residency

KW - Surgical education

KW - Systems-Based Practice

UR - http://www.scopus.com/inward/record.url?scp=84940062209&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84940062209&partnerID=8YFLogxK

U2 - 10.1016/j.jsurg.2015.06.014

DO - 10.1016/j.jsurg.2015.06.014

M3 - Article

C2 - 26319103

AN - SCOPUS:84940062209

JO - Journal of Surgical Education

JF - Journal of Surgical Education

SN - 1931-7204

ER -