- •Oral examinations in undergraduate medical education helps test core clinical Entrustable Professional Activities (EPA).
- •Community-based medical school can increase engagement of faculty with medical education when exams are conducted virtually.
- •Student submission of cases provides flexibility, while aiding comparability, especially when student experiences are varied.
As a community-based medical school which recruited faculty preceptors new to teaching, we sought to create objective assessments for fourth-year surgery experiences via administration of an oral exam. Students provided three authentic cases, which faculty used as a springboard to ascertain student proficiency in five entrustable professional activities: 1-oral presentation, 2-recognition of urgency/instability, 3-calling consults, 4-transitions of care, 5-informed consent. We present proof-of-concept and analysis of student case submissions.
Twenty-seven student submissions (79 cases in total) were evaluated for case complexity, level-appropriateness, and an estimation of the ability to conduct a quality exam based on the information provided (subjective measures). Objective metrics included word count, instruction adherence, inclusion of figures/captions. A resident-in-training rated cases via the same metrics. In-examination data was separately culled.
The average word count was 281.70 (SD 140.23; range 40–743). Figures were included in 26.1% of cases. Faculty raters scored 29.0% as low-complexity, 37.7% medium-complexity, and 33.3% high-complexity. Raters felt 62.3% of cases provided enough information to conduct a quality exam. The majority of cases submitted (65.2%) were level-appropriate or higher. The resident rater scored cases more favorably than surgeons (Cohen's kappa of −0.5), suggesting low inter-rater agreement between those of differing experience levels.
Student's case submissions lessened faculty burden and provided assessors with adequate information to deliver a quality exam to assess proficiency in clinical skills essential for residency. Cases demonstrated sufficient complexity and level-appropriateness. The request to correlate case rating with exam performance is under review by our institution's assessment office. Near-peer tutoring by resident alumni is a program under development.
To read this article in full you will need to make a payment
Purchase one-time access:Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
One-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:Subscribe to The American Journal of Surgery
Already a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
- Medical student subinternships in surgery: characterization and needs assessment.Am J Surg. 2013; 205: 175-181
- Core entrustable professional activities for entering residency pilot program. Medical students' views on implementing the core EPAs: recommendations from student leaders at the core EPAs pilot institutions.Acad Med. 2021; 96: 193-198
- Association of American medical colleges core EPAs for entering residency pilot team. Revisiting the core entrustable professional activities for entering residency.Acad Med. 2021; 96: S14-S21
- Design and implementation of a core EPA-based acting internship curriculum.Med Teach. 2022; 44: 922-927
- Content of an educational handover letter from medical schools to surgery residencies: a mixed method analysis.Acad Med. 2021; 96: S136-S143
- A targeted needs assessment for the development of a surgical sub-internship curriculum.J Surg Educ. 2021; 78: e121-e128
- Redefining the acting internship in the era of entrustment: one institution's approach to reforming the acting internship.Med Sci Educ. 2019; 29: 583-591
- Medical student attitudes and actions that encourage teaching on surgery clerkships.Am J Surg. 2021; 222: 1066-1071
- Effectivity of near-peer teaching in training of basic surgical skills – a randomized controlled trial.BMC Med Educ. 2021; 21: 156
- Sequential participation in a multi-institutional mock oral examination is associated with improved American board of surgery certifying examination first-time pass rate.J Surg Educ. 2016; 73: e95-e103
- Standardized oral examinations allow for assessment of medical student clinical knowledge and decrease racial grading differences in a surgery clerkship.Surgery. 2022; 171: 590-597
Published online: January 27, 2023
Accepted: January 20, 2023
Received in revised form: January 10, 2023
Received: November 15, 2022
Publication stageIn Press Journal Pre-Proof
© 2023 Published by Elsevier Inc.