Flowerdew, L., Gaunt, A., Spedding, J., Bhargava, A., Brown, R., Vincent, C. and Woloshynowych, M. 2013. A multicentre observational study to evaluate a new tool to assess emergency physicians' non-technical skills. Emergency Medicine Journal. 30 (6), pp. 437-443. https://doi.org/10.1136/emermed-2012-201237
| Title | A multicentre observational study to evaluate a new tool to assess emergency physicians' non-technical skills |
|---|---|
| Type | Journal article |
| Authors | Flowerdew, L., Gaunt, A., Spedding, J., Bhargava, A., Brown, R., Vincent, C. and Woloshynowych, M. |
| Abstract | Objective: To evaluate a new tool to assess emergency physicians' non-technical skills. Methods: This was a multicentre observational study using data collected at four emergency departments in England. A proportion of observations used paired observers to obtain data for inter-rater reliability. Data were also collected for test-retest reliability, observability of skills, mean ratings and dispersion of ratings for each skill, as well as a comparison of skill level between hospitals. Qualitative data described the range of non-technical skills exhibited by trainees and identified sources of rater error. Results: 96 assessments of 43 senior trainees were completed. At a scale level, intra-class coefficients were 0.575, 0.532 and 0.419 and using mean scores were 0.824, 0.702 and 0.519. Spearman's ρ for calculating test-retest reliability was 0.70 using mean scores. All skills were observed more than 60% of the time. The skill Maintenance of Standards received the lowest mean rating (4.8 on a nine-point scale) and the highest mean was calculated for Team Building (6.0). Two skills, Supervision & Feedback and Situational Awareness-Gathering Information, had significantly different distributions of ratings across the four hospitals (p<0.04 and 0.007, respectively), and this appeared to be related to the leadership roles of trainees. Conclusion: This study shows the performance of the assessment tool is acceptable and provides valuable information to structure the assessment and training of non-technical skills, especially in relation to leadership. The framework of skills may be used to identify areas for development in individual trainees, as well as guide other patient safety interventions. |
| Journal | Emergency Medicine Journal |
| Journal citation | 30 (6), pp. 437-443 |
| ISSN | 1472-0213 |
| 1472-0205 | |
| Year | 2013 |
| Publisher | British Medical Journal |
| Publisher's version | File Access Level Open (open metadata and files) |
| Digital Object Identifier (DOI) | https://doi.org/10.1136/emermed-2012-201237 |
| PubMed ID | 22707472 |
| Web address (URL) | https://emj.bmj.com/content/30/6/437.info |
| Publication dates | |
| Published | 13 May 2013 |