The American Journal of Surgery
Volume 199, Issue 4 , Pages 529-541 , April 2010

Contemporary virtual reality laparoscopy simulators: quicksand or solid grounds for assessing surgical trainees?

  • Anthony S. Thijssen, M.D.

      Affiliations

    • Department of Surgery, University Medical Center Utrecht, Utrecht, The Netherlands
    • ,
  • Marlies P. Schijven, M.D., Ph.D., M.H.Sc.

      Affiliations

    • Department of Surgery, Academic Medical Center Amsterdam, Amsterdam, The Netherlands
    • Corresponding Author InformationCorresponding author. Tel.: +31(0) 205662166; fax: +31(0) 206914858

Received 7 July 2008 ,Revised 14 April 2009

References 

  1. Scott DJ, Bergen PC, Rege RV, et al. Laparoscopic training on bench models: better and more cost effective than operating room experience?. J Am Coll Surg. 2000;191:272–283
  2. Nelson AA. Research design: measurement, reliability, and validity. Am J Hosp Pharm. 1980;37:851–857
  3. Wanzel KR, Ward M, Reznick RK. Teaching the surgical craft: from selection to certification. Curr Probl Surg. 2002;39:573–659
  4. Schijven M, Jakimowicz J. Construct validity: experts and novices performing on the Xitact LS 500 laparoscopy simulator. Surg Endosc. 2003;17:803–810
  5. Gallagher AG, Ritter EM, Satava RM. Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc. 2003;17:1525–1529
  6. Ritter EM, Kindelan TW, Michael C, et al. Concurrent validity of augmented reality metrics applied to the Fundamentals of Laparoscopic Surgery (FLS). Surg Endosc. 2007;21:1441–1445
  7. Hart R, Doherty DA, Karthigasu K, et al. The value of virtual reality-simulator training in the development of laparoscopic surgical skills. J Minim Invasive Gynecol. 2006;13:126–133
  8. Verdaasdonk EG, Stassen LP, Schijven MP, et al. Construct validity and assessment of the learning curve for the SIMENDO endoscopic simulator. Surg Endosc. 2007;21:1406–1412
  9. Verdaasdonk EG, Stassen LP, Monteny LJ, et al. Validation of a new basic virtual reality simulator for training of basic endoscopic skills: the SIMENDO. Surg Endosc. 2006;20:511–518
  10. Broe D, Ridgway PF, Johnson S, et al. Construct validation of a novel hybrid surgical simulator. Surg Endosc. 2006;20:900–904
  11. Van Sickle KR, McClusky DA, Gallagher AG, et al. Construct validation of the ProMIS simulator using a novel laparoscopic suturing task. Surg Endosc. 2005;19:1227–1231
  12. Van Sickle KR, Ritter EM, McClusky DA, et al. Attempted establishment of proficiency levels for laparoscopic performance on a national scale using simulation: the results from the 2004 SAGES Minimally Invasive Surgical Trainer-Virtual Reality (MIST-VR) Learning Center study. Surg Endosc. 2007;21:5–10
  13. Datta V, Bann S, Aggarwal R, et al. Technical skills examination for general surgical trainees. Br J Surg. 2006;93:1139–1146
  14. Brunner WC, Korndorffer JR, Sierra R, et al. Determining standards for laparoscopic proficiency using virtual reality. Am Surg. 2005;71:29–35
  15. Avgerinos DV, Goodell KH, Waxberg S, et al. Comparison of the sensitivity of physical and virtual laparoscopic surgical training simulators to the user's level of experience. Surg Endosc. 2005;19:1211–1215
  16. Gallagher AG, Lederman AB, McGlade K, et al. Discriminative validity of the Minimally Invasive Surgical Trainer in Virtual Reality (MIST-VR) using criteria levels based on expert performance. Surg Endosc. 2004;18:660–665
  17. Grantcharov TP, Bardram L, Funch-Jensen P, et al. Learning curves and impact of previous operative experience on performance on a virtual reality simulator to test laparoscopic surgical skills. Am J Surg. 2003;185:146–149
  18. Gallagher AG, Satava RM. Virtual reality as a metric for the assessment of laparoscopic psychomotor skills (Learning curves and reliability measures). Surg Endosc. 2002;16:1746–1752
  19. Gallagher AG, Richie K, McClure N, et al. Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg. 2001;25:1478–1483
  20. McNatt SS, Smith CD. A computer-based laparoscopic skills assessment device differentiates experienced from novice laparoscopic surgeons. Surg Endosc. 2001;15:1085–1089
  21. Zhang A, Hunerbein M, Dai Y, et al. Construct validity testing of a laparoscopic surgery simulator (Lap Mentor): evaluation of surgical skill with a virtual laparoscopic training simulator. Surg Endosc. 2008;22:1440–1444
  22. Yamaguchi S, Konishi K, Yasunaga , et al. Construct validity for eye-hand coordination skill on a virtual reality laparoscopic surgical simulator. Surg Endosc. 2007;21:2253–2257
  23. McDougall EM, Corica FA, Boker JR, et al. Construct validity testing of a laparoscopic surgical simulator. J Am Coll Surg. 2006;202:779–787
  24. Ahlberg G, Enochsson L, Gallagher AG, et al. Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg. 2007;193:797–804
  25. Petrin P, Baggio E, Spisni R, et al. Use of virtual reality simulator in the training of postgraduated surgical residents. Ann Ital Chir. 2006;77:465–468
  26. van Dongen KW, Tournoij E, Van Der Zee DC, et al. Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts?. Surg Endosc. 2007;21:1413–1417
  27. Aggarwal R, Tully A, Grantcharov T, et al. Virtual reality simulation training can improve technical skills during laparoscopic salpingectomy for ectopic pregnancy. Br J Obstet Gynaecol. 2006;113:1382–1387
  28. Aggarwal R, Grantcharov TP, Eriksen JR, et al. An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg. 2006;244:310–314
  29. Larsen CR, Grantcharov T, Aggarwal R, et al. Objective assessment of gynecologic laparoscopic skills using the LapSimGyn virtual reality simulator. Surg Endosc. 2006;20:1460–1466
  30. Hassan I, Maschuw K, Rothmund M, et al. Novices in surgery are the target group of a virtual reality training laboratory. Eur Surg Res. 2006;38:109–113
  31. Woodrum DT, Andreatta PB, Yellamanchilli RK, et al. Construct validity of the LapSim laparoscopic surgical simulator. Am J Surg. 2006;191:28–32
  32. Eriksen JR, Grantcharov T. Objective assessment of laparoscopic skills using a virtual reality stimulator. Surg Endosc. 2005;19:1216–1219
  33. Langelotz C, Kilian M, Paul C, et al. Virtual reality laparoscopic simulator reflects clinical experience in German surgeons. Langenbecks Arch Surg. 2005;390:534–537
  34. Sherman V, Feldman LS, Stanbridge D, et al. Assessing the learning curve for the acquisition of laparoscopic skills on a virtual reality simulator. Surg Endosc. 2005;19:678–682
  35. Duffy AJ, Hogle NJ, McCarthy H, et al. Construct validity for the LapSim laparoscopic surgical simulator. Surg Endosc. 2005;19:401–405
  36. Stefanidis D, Haluck R, Pham T, et al. Construct and face validity and task workload for laparoscopic camera navigation: virtual reality versus videotrainer systems at the SAGES Learning Center. Surg Endosc. 2007;21:1158–1164
  37. Rosenthal R, Gantert WA, Hamel C, et al. Assessment of construct validity of a virtual reality laparoscopy simulator. J Laparoendosc Adv Surg Tech A. 2007;17:407–413
  38. Botden SM, Buzink SN, Schijven MP, et al. Augmented versus virtual reality laparoscopic simulation: what is the difference? (A comparison of the ProMIS augmented reality laparoscopic simulator versus LapSim virtual reality laparoscopic simulator). World J Surg. 2007;31:764–772
  39. Maithel S, Sierra R, Korndorffer J, et al. Construct and face validity of MIST-VR, Endotower, and Celts: are we ready for skills assessment using simulators?. Surg Endosc. 2006;20:104–112
  40. Felländer-Tsai L, Kjellin A, Wredmark T, et al. Basic accreditation for invasive image-guided intervention: a shift of paradigm for high technology education, embedding performance criterion levels in advanced medical simulators in a modern educational curriculum. The Journal on Information Technology in Healthcare. 2004;3:165–173
  41. Hassan I, Gerdes B, Koller M, et al. Clinical background is required for optimum performance with a VR laparoscopy simulator. Comput Aid Surg. 2006;11:103–106
  42. Ro CY, Toumpoulis IK, Ashton RC, et al. The LapSim: a learning environment for both experts and novices. Stud Health Technol Inform. 2005;111:414–417
  43. Chaudhry A, Sutton C, Wood J, et al. Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human-computer interface. Ann R Coll Surg Engl. 1999;81:281–286
  44. Heinrichs WL, Lukoff B, Youngblood P, et al. Criterion-based training with surgical simulators: proficiency of experienced surgeons. JSLS. 2007;11:273–302
  45. Strom P, Kjellin A, Hedman L, et al. Validation and learning in the Procedicus KSA virtual reality surgical simulator. Surg Endosc. 2003;17:227–231
  46. Madan AK, Frantzides CT, Shervin N, et al. Assessment of individual hand performance in box trainers compared to virtual reality trainers. Am Surg. 2003;69:1112–1114
  47. Fellander-Tsai L, Stahre C, Anderberg B, et al. Simulator training in medicine and health care (A new pedagogic model for good patient safety). Lakartidningen. 2001;98:3772–3776
  48. Newmark J, Dandolu V, Milner R, et al. Correlating virtual reality and box trainer tasks in the assessment of laparoscopic surgical skills. Am J Obstet Gynecol. 2007;197:e1–e4
  49. Schijven MP, Jakimowicz JJ, Carter FJ. How to select aspirant laparoscopic surgical trainees: establishing concurrent validity comparing Xitact LS 500 index performance scores with standardized psychomotor aptitude test battery scores. J Surg Res. 2004;121:112–119
  50. Haluck RS, Gallagher AG, Satava RM, et al. Reliability and validity of Endotower, a virtual reality trainer for angled endoscope navigation. Stud Health Technol Inform. 2002;85:179–184
  51. Ahlberg G, Kruuna O, Leijonmarck CE, et al. Is the learning curve for laparoscopic fundoplication determined by the teacher or the pupil?. Am J Surg. 2005;189:184–189
  52. Madan AK, Frantzides CT, Sasso LM. Laparoscopic baseline ability assessment by virtual reality. Laparoendosc J Surg Tech A. 2005;15:13–17
  53. Grantcharov TP, Kristiansen VB, Bendix J, et al. Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg. 2004;91:146–150
  54. Seymour NE, Gallagher AG, Roman SA, et al. Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg. 2002;236:458–463
  55. Ahlberg G, Heikkinen T, Iselius L, et al. Does training in a virtual reality simulator improve surgical performance?. Surg Endosc. 2002;16:126–129
  56. Hamilton EC, Scott DJ, Fleming JB, et al. Comparison of video trainer and virtual reality training systems on acquisition of laparoscopic skills. Surg Endosc. 2002;16:406–411
  57. Grantcharov TP, Rosenberg J, Pahle E, et al. Virtual reality computer simulation. Surg Endosc. 2001;15:242–244
  58. Andreatta PB, Woodrum DT, Birkmeyer JD, et al. Laparoscopic skills are improved with LapMentor training: results of a randomized, double-blinded study. Ann Surg. 2006;243:854–860
  59. Aggarwal R, Ward J, Balasundaram I, et al. Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann Surg. 2007;246:771–779
  60. Youngblood PL, Srivastava S, Curet M, et al. Comparison of training on two laparoscopic simulators and assessment of skills transfer to surgical performance. J Am Coll Surg. 2005;200:546–551
  61. Hyltander A, Liljegren E, Rhodin PH, et al. The transfer of basic skills learned in a laparoscopic simulator to the operating room. Surg Endosc. 2002;16:1324–1328
  62. Ganai S, Donroe JA, St. Louis MR, et al. Virtual-reality training improves angled telescope skills in novice laparoscopists. Am J Surg. 2007;193:260–265
  63. Schijven MP, Jakimowicz JJ, Broeders IA, et al. The Eindhoven laparoscopic cholecystectomy training course—improving operating room performance using virtual reality training: results from the first E.A.E.S. accredited virtual reality trainings curriculum. Surg Endosc. 2005;19:1220–1226
  64. Kimura T, Kawabe A, Suzuki K, et al. Usefulness of a virtual reality simulator or training box for endoscopic surgery training. Surg Endosc. 2006;20:656–659
  65. Meade MO, Richardson WS. Selecting and appraising studies for a systematic review. Ann Intern Med. 1997;127:531–537
  66. Carter FJ, Schijven MP, Aggarwal R, et al. Consensus guidelines for validation of virtual reality surgical simulators. Surg Endosc. 2005;19:1523–1532
  67. Centre for Evidence-Based Medicine Levels of Evidence. http://www.cebm.net/index.aspx?o=10252001;Accessed April 4, 2008
  68. Vassiliou MC, Feldman LS, Andrew CG, et al. A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg. 2005;190:107–113
  69. Gurusamy KS, Aggarwal R, Palanivelu L, et al. Virtual reality training for surgical trainees in laparoscopic surgery. Cochrane Database Syst Rev. 2009;1:CD006575

PII: S0002-9610(09)00431-0

doi: 10.1016/j.amjsurg.2009.04.015

The American Journal of Surgery
Volume 199, Issue 4 , Pages 529-541 , April 2010

Article Tools

* Image Usage & Resolution