Abstract
Background
In medicine, the development of expertise requires the recognition of one’s capabilities
and limitations. This study aimed to verify the accuracy of self-assessment for the
performance of a surgical task, and to determine whether self-assessment may be improved
through self-observation or exposure to relevant standards of performance.
Methods
Twenty-six senior surgical residents were videotaped performing a laparoscopic Nissen
fundoplication in a pig. Experts rated the videos using two scoring systems. Subjects
evaluated their performances after performance of the Nissen, after self-observation
of their videotaped performance, and after review of four videotaped “benchmark” performances.
Results
Expert interrater reliability was 0.66 (intraclass correlation coefficient). The correlation
between experts’ and residents’ self-evaluations was initially moderate (r = 0.50, P <0.01), increasing significantly after the residents reviewed their own videotaped
performance to r = 0.63 (Δr = 0.13, P <0.01), yet did not change after review of the benchmarks.
Conclusions
Self-observation of videotaped performance improved the residents’ ability to self-evaluate.
Keywords
To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to The American Journal of SurgeryAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- Learner centred approaches in medical education.BMJ. 1999; 318: 1280-1288
- Student self-assessment in higher education.Rev Educ Res. 1989; 59: 395-430
- A review of the validity and accuracy of self-assessments in health professions training.Acad Med. 1991; 66: 762-769
- Accuracy of student self-evaluations of dental sealants.J Dent Hyg. 1990; 64: 339-342
- Self and tutor evaluations in problem-based learning tutorials.Med Educ. 1998; 32: 411-418
- The influence of task formats on the accuracy of medical students’ self-assessments.Acad Med. 2000; 75: 737-741
- Medical students’ self-assessment accuracy in communication skills.Acad Med. 1997; 72: S57-59
- Applying a relative ranking model to the self-assessment of extended performances.Adv Health Sci Educ. 1997; 2: 17-25
- Student evaluation in obstetrics and gynecology.Obstet Gynecol. 1990; 76: 458-461
- Medical students’ clinical self-assessments.Acad Med. 1993; 68: 285-294
- Accuracy of second-year medical students’ self-assessment of clinical skills.Acad Med. 1997; 72: S63-65
- Comparison of self, nurse, and physician assessment of residents rotating through an intensive care unit.Crit Care Med. 1998; 26: 1811-1816
- Ratings of surgical residents by self, supervisors and peers.Surg Gynecol Obstet. 1989; 169: 519-526
- Self-evaluation of videotaped consultations.Teach Learn Med. 1990; 2: 232-236
- Effect of videotape replay on the quality and accuracy of student self-evaluation.Phys Ther. 1985; 65: 497-501
- Using videotaped benchmarks to improve the self-assessment ability of family practice residents.Acad Med. 1998; 73: 1201-1206
- Correlations between staff, peer and self assessments of fourth-year students in surgery.Med Educ. 1977; 11: 167-170
- Objective structured assessment of technical skill (OSATS) for surgical residents.Br J Surg. 1997; 84: 273-278
- Testing technical skill via an innovative “bench station” examination.Am J Surg. 1996; 172: 226-230
Dath D, MacRae H, Birch D, et al. Towards reliable operative assessment: the reliability and feasibility of videotaped assessment of laparoscopic technical skills. Presented at the meeting of the Association for Surgical Education, Nashville, Tennessee, April 2001
- Medical students’ development of self- and peer-assessment skills.Teach Learn Med. 1990; 2: 25-29
- Development of self-assessment skills in medical students.Med Educ. 1984; 84: 226-231
- Measuring self-assessment.Adv Health Sci Educ. 2000; 7: 63-80
Article info
Publication history
Received in revised form:
October 9,
2002
Received:
September 3,
2002
Identification
Copyright
© 2003 Excerpta Medica Inc. Published by Elsevier Inc. All rights reserved.
