Join the 200th Anniversary Celebration

Editorial

Technical-Skills Training in the 21st Century

Rajesh Aggarwal, M.R.C.S., and Ara Darzi, M.D.

N Engl J Med 2006; 355:2695-2696December 21, 2006

Article

Medical education is undergoing a paradigm shift, from the traditional experience-based model to a program that requires documentation of proficiency.1 Technological advances in health care, the development of day-case surgery, and the setting of quality-assurance targets have led to a striking reduction in training opportunities for young doctors. It is no longer acceptable, or appropriate, for students at any level of training to practice new skills on patients, even if they have a patient's explicit consent.

As Reznick and MacRae point out in this issue of the Journal, these “changes in the wind” are beginning to transform surgical residency programs.2 A primary aim is for trainees to practice skills in a safe environment, before refining them in the real world. At present, simulation-based training is a prerequisite for all high-reliability organizations (e.g., in the airline, nuclear, and oil industries) yet remains a niche player in medical education.3 The often-quoted criticism is that surgical simulators lack “fidelity,” or are not truly lifelike, though the real problem has more to do with a lack of motivation or understanding on the part of educational leaders than with the eventual outcomes, which for the most part have been remarkably good.4-6

This success notwithstanding, there remains a chasm between proficiency in technical skills and the translation of those skills into expert performance in a complex clinical environment. It may be unrealistic to expect even technically proficient trainees to move directly into a dynamic space such as the operating room and exercise appropriate judgment, especially during crisis situations such as those involving major-vessel bleeding. To some extent, judgment — which relies on both cognitive and professional skills — can be modeled in an environment such as a simulated operating room, enabling trainees for the first time to receive feedback about both their technical and their nontechnical performance.7 Though difficult to assess objectively, this type of training can translate into improved performance in the clinical setting.8

With the development of proficiency-based training and practice comes the need to set benchmarks of achievement in skills and behaviors during prespecified tasks.9 Such criteria can be used not only to confirm the completion of a particular training module with the attainment of an appropriate level of technical proficiency, but also to reconfirm the soundness of the skills that have been acquired. We believe that in the future, expertise rather than experience will underlie competency-based practice and specialty certification. Validation and revalidation of expertise necessitate the use of tools that have high validity and reliability for assessing performance, many of which are described by Reznick and MacRae.

At present, these tools assess only technical skill, though recent advances in eye-tracking technology may enable us to elucidate the cognitive processes behind surgical tasks. For example, an analysis of eye movements during laparoscopic surgery can provide, on a two-dimensional screen, information regarding depth perception. This technology has already been used to assess skill in reading radiologic images, enabling researchers to delineate the strategies that are used by experienced radiologists.10 It may soon be possible to make the eye movements of such radiologists the basis of a decision-support system that will aid trainees in identifying abnormal areas on radiologic images. The application of this technology to strategies for assessing surgical skills, perhaps with analysis performed by artificial neural networks, is not far behind.

But there is no reason why we have to stop there. The psychological components of motor-skill acquisition are inevitably related to the plasticity of the motor, premotor, and supplementary motor cortices of the brain. Recent developments in functional brain mapping can provide information regarding these changes — and perhaps ultimately a measure of skill in completing a technically demanding procedure.11,12 It may also be possible to determine whether students possess the prerequisite baseline characteristics of depth perception and hand–eye coordination before they choose to enter technically demanding specialties.

For these tools to be used effectively, technical and nontechnical skills must be assessed in a standardized and reproducible environment. What, then, of situations in which a real patient has a congenital anomaly or is morbidly obese? In such challenging cases, a surgeon would normally take longer to perform a given procedure, owing in part to unclear anatomy. Ideally, one could scan the patient's anatomical data into a virtual-reality simulator and perform a virtual procedure in a simulated operating room the day before the real one was to take place. In essence, the team would rehearse the actual procedure before performing it live, the learning curve for difficult or unusual cases would not involve risk for the patient, and the real-world surgical outcome would be enhanced.

Such tools can address the increasingly limited opportunities for technical training and assessment that are offered to doctors, not only during training but throughout their careers. It is no longer necessary to educate students, residents, and practicing physicians in a system that relies on chance opportunities for learning new skills. Simulation allows for risk-free training in technical skills. For the first time, a proficiency-based curriculum can make the actual level of skill rather than a predetermined period of time the primary factor in physicians' progression up the training ladder, ensuring that patients are cared for by doctors with expertise in the procedures they perform. Although simulations alone cannot improve the quality of health care, they do significantly advance clinical education — especially when combined with enriched curricular and educational environments such as virtual operating suites — and lead to enhanced clinical reasoning and professionalism.

Dr. Aggarwal reports receiving grant support from Tyco Healthcare; and Dr. Darzi, consulting fees from Tyco and grant support from Tyco Healthcare. No other potential conflict of interest relevant to this article was reported.

Source Information

From the Department of Biosurgery and Surgical Technology (R.A.) and the Division of Surgery, Oncology, Reproductive Biology, and Anaesthetics (A.D.), Imperial College, London.

References

References

  1. 1

    Debas HT, Bass BL, Brennan MF, et al. American Surgical Association Blue Ribbon Committee Report on Surgical Education: 2004. Ann Surg 2005;241:1-8
    Web of Science | Medline

  2. 2

    Reznick RK, MacRae H. Teaching surgical skills -- changes in the wind. N Engl J Med 2006;355:2664-2669
    Full Text | Web of Science | Medline

  3. 3

    Flin R, O'Connor P, Mearns K. Crew resource management: improving team work in high reliability industries. Team Perform Manage 2002;8:68-78
    CrossRef

  4. 4

    Blum MG, Powers TW, Sundaresan S. Bronchoscopy simulator effectively prepares junior residents to competently perform basic clinical bronchoscopy. Ann Thorac Surg 2004;78:287-291
    CrossRef | Web of Science | Medline

  5. 5

    Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P. Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 2004;91:146-150
    CrossRef | Web of Science | Medline

  6. 6

    Sedlack RE, Kolars JC. Computer simulator training enhances the competency of gastroenterology fellows at colonoscopy: results of a pilot study. Am J Gastroenterol 2004;99:33-37
    CrossRef | Web of Science | Medline

  7. 7

    Aggarwal R, Undre S, Moorthy K, Vincent C, Darzi A. The simulated operating theatre: comprehensive training for surgical teams. Qual Saf Health Care 2004;13:Suppl 1:i27-i32
    CrossRef | Web of Science | Medline

  8. 8

    Guerlain S, Adams RB, Turrentine FB, et al. Assessing team performance in the operating room: development and use of a “black-box” recorder and other tools for the intraoperative environment. J Am Coll Surg 2005;200:29-37
    CrossRef | Web of Science | Medline

  9. 9

    Aggarwal R, Grantcharov TP, Erikson JR, et al. An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg 2006;244:310-314
    CrossRef | Web of Science | Medline

  10. 10

    Hu XP, Dempere-Marco L, Yang GZ. Hot spot detection based on feature space representation of visual search. IEEE Trans Med Imaging 2003;22:1152-1162
    CrossRef | Web of Science | Medline

  11. 11

    Tracy J, Flanders A, Madi S, et al. Regional brain activation associated with different performance patterns during learning of a complex motor skill. Cereb Cortex 2003;13:904-910
    CrossRef | Web of Science | Medline

  12. 12

    Leff DR, Koh P, Aggarwal R, et al. Optical mapping of the left frontal cortex during a surgical knot tying task. Lect Notes Comput Sci 2006;4091:140-147
    CrossRef

Citing Articles (38)

Citing Articles

  1. 1

    Debbie Hatfield, Jane Lovegrove. (2012) The use of skills inventories to assess and grade practice: Part 2 – Evaluation of assessment strategy. Nurse Education in Practice
    CrossRef

  2. 2

    Marta Wais, Eng Ooi, Randy M. Leung, Allan D. Vescan, John Lee, Ian J. Witterick. (2012) The effect of low-fidelity endoscopic sinus surgery simulators on surgical skill. International Forum of Allergy & Rhinology 2:1, 20
    CrossRef

  3. 3

    Trystan Lewis, Rajesh Aggarwal, Richard Kwasnicki, Ara Darzi, Paraskevas Paraskeva. (2011) Does previous laparoscopic experience improve ability to perform single-incision laparoscopic surgery?. Surgical Endoscopy
    CrossRef

  4. 4

    Cynthia R. Whitehead, Zubin Austin, Brian D. Hodges. (2011) Flower power: the armoured expert in the CanMEDS competency framework?. Advances in Health Sciences Education 16:5, 681-694
    CrossRef

  5. 5

    Jane Lovegrove, Debbie Hatfield. (2011) The use of skills inventories to assess and grade practice: Part 1 – Design and implementation. Nurse Education in Practice
    CrossRef

  6. 6

    Nicoleta O. Kolozsvari, Liane S. Feldman, Melina C. Vassiliou, Sebastian Demyttenaere, Michael L. Hoover. (2011) Sim One, Do One, Teach One: Considerations in Designing Training Curricula for Surgical Simulation. Journal of Surgical Education 68:5, 421-427
    CrossRef

  7. 7

    T.M. Lewis, R. Aggarwal, N. Rajaretnam, T.P. Grantcharov, A. Darzi. (2011) Training in surgical oncology – The role of VR simulation. Surgical Oncology 20:3, 134-139
    CrossRef

  8. 8

    Lars O. Häll, Tor Söderström. 2011. Designing for Learning in Computer-Assisted Health Care Simulations. , 167-192.
    CrossRef

  9. 9

    D. BREEN, L. BOGAR, P. HEIGL, J. RITTBERGER, G. D. SHORTEN. (2011) Validation of a clinical assessment tool for spinal anaesthesia. Acta Anaesthesiologica Scandinavica 55:6, 653-657
    CrossRef

  10. 10

    Roberta Corona, Jasper Verguts, Maria Mercedes Binda, Carlos Roger Molinas, Ron Schonman, Philippe R. Koninckx. (2011) The impact of the learning curve on adhesion formation in a laparoscopic mouse model. Fertility and Sterility 96:1, 193-197
    CrossRef

  11. 11

    M. J. Det, W. J. H. J. Meijerink, C. Hoff, L. J. Middel, S. A. Koopal, J. P. E. N. Pierie. (2011) The learning effect of intraoperative video-enhanced surgical procedure training. Surgical Endoscopy 25:7, 2261-2267
    CrossRef

  12. 12

    Constantinos Loukas, Nikolaos Nikiteas, Meletios Kanakis, Evangelos Georgiou. (2011) Deconstructing laparoscopic competence in a virtual reality simulation environment. Surgery 149:6, 750-760
    CrossRef

  13. 13

    Patrice Crochet, Rajesh Aggarwal, Sukhpreet Singh Dubb, Paul Ziprin, Niroshini Rajaretnam, Teodor Grantcharov, K. Anders Ericsson, Ara Darzi. (2011) Deliberate Practice on a Virtual Reality Laparoscopic Simulator Enhances the Quality of Surgical Technical Skills. Annals of Surgery 253:6, 1216-1222
    CrossRef

  14. 14

    Juliette KOCH, Sarah CLEMENTS, Jason ABBOTT. (2011) Basic surgical skills training: Does it work?. Australian and New Zealand Journal of Obstetrics and Gynaecology 51:1, 57-60
    CrossRef

  15. 15

    Debra Nestel, Diana Tabak, Tanya Tierney, Carine Layat-Burn, Anja Robb, Susan Clark, Tracy Morrison, Norma Jones, Rachel Ellis, Cathy Smith, Nancy McNaughton, Kerry Knickle, Jenny Higham, Roger Kneebone. (2011) Key challenges in simulated patient programs: An international comparative case study. BMC Medical Education 11:1, 69
    CrossRef

  16. 16

    Seth J. Worley, Kenneth A. Ellenbogen. 2011. Interventional Techniques for Device Implantation. , 618-718.
    CrossRef

  17. 17

    Laurent Riffaud, Thomas Neumuth, Xavier Morandi, Christos Trantakis, Jürgen Meixensberger, Oliver Burgert, Brivael Trelhu, Pierre Jannin. (2010) Recording of Surgical Processes: A Study Comparing Senior and Junior Neurosurgeons During Lumbar Disc Herniation Surgery. Neurosurgery 67, ons325-ons332
    CrossRef

  18. 18

    Hilary Sanfey, Janet Ketchum, Jennifer Bartlett, Stephen Markwell, Andreas H. Meier, Reed Williams, Gary Dunnington. (2010) Verification of proficiency in basic skills for postgraduate year 1 residents. Surgery 148:4, 759-767
    CrossRef

  19. 19

    J Sándor, B Lengyel, T Haidegger, G Saftics, G Papp, Á Nagy, G Wéber. (2010) Minimally invasive surgical technologies: Challenges in education and training. Asian Journal of Endoscopic Surgery 3:3, 101-108
    CrossRef

  20. 20

    A P George, R De. (2010) Review of temporal bone dissection teaching: how it was, is and will be. The Journal of Laryngology & Otology 124:02, 119
    CrossRef

  21. 21

    Karim Qayumi, Vancouver. (2010) Surgical Skills Lab: A Hub for Competency Training. Journal of Investigative Surgery 23:1, 48-56
    CrossRef

  22. 22

    H.-D. Saeger, S. Kersting, P. Vogelbach, C. Hamel, D. Oertli, A. Hölscher, W.E.G. Thomas. (2010) Kurssystem der Arbeitsgemeinschaft für Gastrointestinale Chirurgie Davos. Der Chirurg 81:1, 25-30
    CrossRef

  23. 23

    Oleg Safir, Adam Dubrowski, Yvonne Hui, David Backstein, Heather Carnahan. (2010) Self-directed practice scheduling is equivalent to instructor guided practice when learning a complex surgical skill. Procedia - Social and Behavioral Sciences 2:2, 792-796
    CrossRef

  24. 24

    Ryan Brydges, Heather Carnahan, Adam Dubrowski. (2009) Assessing suturing skills in a self-guided learning setting: absolute symmetry error. Advances in Health Sciences Education 14:5, 685-695
    CrossRef

  25. 25

    R. Aggarwal, P. Crochet, A. Dias, A. Misra, P. Ziprin, A. Darzi. (2009) Development of a virtual reality training curriculum for laparoscopic cholecystectomy. British Journal of Surgery 96:9, 1086-1093
    CrossRef

  26. 26

    Roger Kneebone. (2009) Perspective: Simulation and Transformational Change: The Paradox of Expertise. Academic Medicine 84:7, 954-957
    CrossRef

  27. 27

    J. Jakimowicz, A. Fingerhut. (2009) Simulation in surgery. British Journal of Surgery 96:6, 563-564
    CrossRef

  28. 28

    Paul B. Roach, Kevin K. Roggin, Eugene Selkov, Mitchell C. Posner, Jonathan C. Silverstein. (2009) Use of a Novel, Web-Based Educational Platform Facilitates Intraoperative Training in a Surgical Oncology Fellowship Program. Annals of Surgical Oncology 16:5, 1100-1107
    CrossRef

  29. 29

    Javier Salgado, Teodor P. Grantcharov, Pavlos K. Papasavas, Daniel J. Gagne, Philip F. Caushaj. (2009) Technical skills assessment as part of the selection process for a fellowship in minimally invasive surgery. Surgical Endoscopy 23:3, 641-644
    CrossRef

  30. 30

    Andrée Sansregret, Gerald M. Fried, Harrith Hasson, Dennis Klassen, Maryse Lagacé, Robert Gagnon, Stephen Pooler, Bernard Charlin. (2009) Choosing the right physical laparoscopic simulator? comparison of LTS2000-ISM60 with MISTELS: validation, correlation, and user satisfaction. The American Journal of Surgery 197:2, 258-265
    CrossRef

  31. 31

    Z. Kulcsar, A. Aboulafia, T. Hall, G. D. Shorten. (2008) Determinants of learning to perform spinal anaesthesia. European Journal of Anaesthesiology 25:12, 1026-1031
    CrossRef

  32. 32

    Ernest E. Wang, Joshua Quinones, Michael T. Fitch, Suzanne Dooley-Hash, Sharon Griswold-Theodorson, Ron Medzon, Frederick Korley, Torrey Laack, Adam Robinett, Lamont Clay. (2008) Developing Technical Expertise in Emergency Medicine-The Role of Simulation in Procedural Skill Acquisition. Academic Emergency Medicine 15:11, 1046-1057
    CrossRef

  33. 33

    Rajesh Aggarwal, Teodor Grantcharov. (2008) Laparoscopic Colorectal Surgical Training: A Curricular Approach. Seminars in Colon and Rectal Surgery 19:2, 115-121
    CrossRef

  34. 34

    Rajesh Aggarwal, Julian Leong, Daniel Leff, Oliver Warren, Guang-Zhong Yang, Ara Darzi. (2008) New Technologies for the Surgical Curriculum. World Journal of Surgery 32:2, 213-216
    CrossRef

  35. 35

    Ryan Brydges, Allison Kurahashi, Vera Brümmer, Lisa Satterthwaite, Roger Classen, Adam Dubrowski. (2008) Developing Criteria for Proficiency-Based Training of Surgical Technical Skills Using Simulation: Changes in Performances as a Function of Training Year. Journal of the American College of Surgeons 206:2, 205-211
    CrossRef

  36. 36

    Rajesh Aggarwal, Jonnie Ward, Indran Balasundaram, Parvinderpal Sains, Thanos Athanasiou, Ara Darzi. (2007) Proving the Effectiveness of Virtual Reality Simulation for Training in Laparoscopic Surgery. Annals of Surgery 246:5, 771-779
    CrossRef

  37. 37

    Scott E. Regenbogen, Caprice C. Greenberg, David M. Studdert, Stuart R. Lipsitz, Michael J. Zinner, Atul A. Gawande. (2007) Patterns of Technical Error Among Surgical Malpractice Claims. Annals of Surgery 246:5, 705-711
    CrossRef

  38. 38

    James M. McGreevy, Tyler D. Otten. (2007) Briefing and Debriefing in the Operating Room Using Fighter Pilot Crew Resource Management. Journal of the American College of Surgeons 205:1, 169-176
    CrossRef