Highlights
- •T-NOTECHS was developed with an acceptable robust methodology.
- •The tool has good sensibility with adequate content, face validity, & feasibility.
- •Synthesis of evidence supports T-NOTECHS′ use as a discriminative & evaluative tool.
- •Ideal rater has clinical expertise in trauma care & simulation-based teaching.
- •Ideal setting to utilize T-NOTECHS is with trauma video review.
Abstract
Purpose
Conduct a scoping review to critically appraise the development and summarize the
evidence on the measurement properties of T-NOTECHS including sensibility, reliability,
and validity.
Methods
A literature search was performed using Pubmed and Ovid databases. Studies that described
the development process of T-NOTECHS and primary studies that presented evidence of
reliability and validity were identified and included. Measurement properties of T-NOTECHS
was assessed and summarized under the following: scale development, sensibility, reliability,
and validity.
Results
The literature search yielded 245 articles with 24 studies meeting inclusion criteria.
The T-NOTECHS was developed with an acceptable robust methodology. It has good sensibility
with adequate content, face validity, and feasibility. It is a reliable measure of
non-technical skills in the setting of trauma video review, which improves with expert
raters or extensive training. The T-NOTECHS is a valid discriminative and evaluative
instrument that measures non-technical skills of multidisciplinary trauma teams.
Conclusions
T-NOTECHS provides reliable and valid measurements of non-technical skills of trauma
teams, particularly when assessing trauma video review and non-technical skills training
interventions by expert raters.
Keywords
To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to The American Journal of SurgeryAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- Safety at the Sharp End: A Guide to Non-technical Skills.first ed. CRC Press, 2008
- The impact of nontechnical skills on technical performance in surgery: a systematic review.J Am Coll Surg. 2012; 214: 214-230https://doi.org/10.1016/j.jamcollsurg.2011.10.016
- Efficacy of simulation-based trauma team training of non-technical skills. A systematic review.Acta Anaesthesiol Scand. 2014; 58: 775-787https://doi.org/10.1111/aas.12336
- The impact of simulated multidisciplinary Trauma Team Training on team performance: a qualitative study.Australas Emerg Care. 2019; 22: 1-7https://doi.org/10.1016/j.auec.2018.11.003
- Pushing boundaries of video review in trauma: using comprehensive data to improve the safety of trauma care.Trauma Surg Acute Care Open. 2020; 5e000510https://doi.org/10.1136/tsaco-2020-000510
- Teamwork training improves the clinical care of trauma patients.J Surg Educ. 2010; 67: 439-443https://doi.org/10.1016/j.jsurg.2010.06.006
- Teamwork skills, shared mental models, and performance in simulated trauma teams: an independent group design.Scand J Trauma Resuscitation Emerg Med. 2010; 18: 47https://doi.org/10.1186/1757-7241-18-47
- Assessing teamwork in the trauma bay: introduction of a modified “NOTECHS” scale for trauma.Am J Surg. 2012; 203: 69-75https://doi.org/10.1016/j.amjsurg.2011.08.004
- Development of the NOTECHS (non-technical skills) system for assessing pilots' CRM skills.Hum Factors Aero Saf. 2003; 3: 97-119
- Reliability of a revised NOTECHS scale for use in surgical teams.Am J Surg. 2008; 196: 184-190https://doi.org/10.1016/j.amjsurg.2007.08.070
- Development of a rating system for surgeons' non-technical skills.Med Educ. 2006; 40: 1098-1104https://doi.org/10.1111/j.1365-2929.2006.02610.x
- A scoping review of nontechnical skill assessment tools to evaluate trauma team performance.J Trauma Acute Care Surg. Published online December. 2021; 14https://doi.org/10.1097/TA.0000000000003492
- Nontechnical skills performance and care processes in the management of the acute trauma patient.Surgery. 2014; 155: 902-909https://doi.org/10.1016/j.surg.2013.12.029
- Team assessment and decision making is associated with outcomes: a trauma video review analysis.J Surg Res. 2020; 246: 544-549https://doi.org/10.1016/j.jss.2019.09.033
- The role of nontechnical skills in simulated trauma resuscitation.J Surg Educ. 2015; 72: 732-739https://doi.org/10.1016/j.jsurg.2015.01.020
- Identifying nontechnical skill deficits in trainees through interdisciplinary trauma simulation.J Surg Educ. 2018; 75: 978-983https://doi.org/10.1016/j.jsurg.2017.10.007
- Short 2-H in situ trauma team simulation training effectively improves nontechnical skills of hospital trauma teams.Scand J Surg SJS Off Organ Finn Surg Soc Scand Surg Soc. 2019; 108: 117-123https://doi.org/10.1177/1457496918789006
- PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation.Ann Intern Med. 2018; 169: 467-473https://doi.org/10.7326/M18-0850
- Non-Technical Skills for Surgeons (NOTSS): critical appraisal of its measurement properties.Am J Surg. 2018; 216: 990-997https://doi.org/10.1016/j.amjsurg.2018.02.021
- Anaesthetists' Non-Technical Skills (ANTS): evaluation of a behavioural marker system.Br J Anaesth. 2003; 90: 580-588https://doi.org/10.1093/bja/aeg112
- Clinimetric perspectives.J Chron Dis. 1987; 40: 635-640https://doi.org/10.1016/0021-9681(87)90027-0
- Contemporary uses of trauma video review: a scoping review.Can J Emerg Med. Published online August. 2021; 28https://doi.org/10.1007/s43678-021-00178-9
- The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content.BMC Med Res Methodol. 2010; 10: 22https://doi.org/10.1186/1471-2288-10-22
Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A Practical Guide to Their Development and Use. Oxford University Press Accessed August 15, 2021. https://oxfordmedicine.com/view/10.1093/med/9780199685219.001.0001/med-9780199685219.
- Rating scales, scales of measurement, issues of reliability: resolving some critical issues for clinicians and researchers.J Nerv Ment Dis. 2006; 194: 557-564https://doi.org/10.1097/01.nmd.0000230392.83607.c5
- Multidisciplinary simulation-based trauma team training with an emphasis on crisis resource management improves residents' non-technical skills.Surgery. 2021; (Published online April 13) (S0039-6060(21)00207-5)https://doi.org/10.1016/j.surg.2021.03.015
- Team size impact on assessment of teamwork in simulation-based trauma team training.Hawaii J Med Public Health J Asia Pac Med Public Health. 2014; 73: 358-361
- Translatability and validation of non-technical skills scale for trauma (T-NOTECHS) for assessing simulated multi-professional trauma team resuscitations.BMC Med Educ. 2019; 19: 40https://doi.org/10.1186/s12909-019-1474-5
- Costs of hospital trauma team simulation training: a prospective cohort study.BMJ Open. 2021; 11e046845https://doi.org/10.1136/bmjopen-2020-046845
- Using epistemic network analysis to identify targets for educational interventions in trauma team communication.Surgery. 2018; 163: 938-943https://doi.org/10.1016/j.surg.2017.11.009
- Self-assessment of team performance using T-NOTECHS in simulated pediatric trauma resuscitation is not consistent with expert assessment.Am J Surg. 2018; 216: 630-635https://doi.org/10.1016/j.amjsurg.2018.01.010
- Impact of a focused trauma course on retention of provider skills, knowledge and confidence at a regional hospital in the Dominican Republic.Injury. Published online June. 2021; 17 (S0020-1383(21)00499-X)https://doi.org/10.1016/j.injury.2021.06.001
- Role confusion and self-assessment in interprofessional trauma teams.Am J Surg. 2016; 211: 482-488https://doi.org/10.1016/j.amjsurg.2015.11.001
- Reliability of the assessment of non-technical skills by using video-recorded trauma resuscitations.Eur J Trauma Emerg Surg Off Publ Eur Trauma Soc. 2020; 2 (Published online July)https://doi.org/10.1007/s00068-020-01401-5
- Tactical and operational response to major incidents: feasibility and reliability of skills assessment using novel virtual environments.Resuscitation. 2013; 84: 992-998https://doi.org/10.1016/j.resuscitation.2012.12.011
- Virtual-world hospital simulation for real-world disaster response: design and validation of a virtual reality simulator for mass casualty incident management.J Trauma Acute Care Surg. 2014; 77: 315-321https://doi.org/10.1097/TA.0000000000000308
- A methodological framework for assessing health indices.J Chron Dis. 1985; 38: 27-36https://doi.org/10.1016/0021-9681(85)90005-0
- Nontechnical skill assessment of the collective surgical team using the Non-Technical Skills for Surgeons (NOTSS) system.Ann Surg. 2020; 272: 1158-1163https://doi.org/10.1097/SLA.0000000000003250
- In situ, multidisciplinary, simulation-based teamwork training improves early trauma care.J Surg Educ. 2011; 68: 472-477https://doi.org/10.1016/j.jsurg.2011.05.009
Article info
Publication history
Published online: May 27, 2022
Accepted:
May 23,
2022
Received in revised form:
May 16,
2022
Received:
March 6,
2022
Identification
Copyright
© 2022 Elsevier Inc. All rights reserved.
