Directly to content
  1. Publishing |
  2. Search |
  3. Browse |
  4. Recent items rss |
  5. Open Access |
  6. Jur. Issues |
  7. DeutschClear Cookie - decide language by browser settings

Development and validation of an objective assessment scale for chest tube insertion under ‘direct’ and ‘indirect’ rating

Ober, Julian ; Haubruck, Patrick ; Nickel, Felix ; Walker, Tilman ; Friedrich, Mirco ; Müller-Stich, Peter ; Schmidmaier, Gerhard ; Tanner, Michael C.

In: BMC Medical Education, 18 (2018), Nr. 320. pp. 1-9. ISSN 1472-6920

[img] PDF, English - main document
Download (1MB) | Lizenz: Creative Commons LizenzvertragDevelopment and validation of an objective assessment scale for chest tube insertion under ‘direct’ and ‘indirect’ rating by Ober, Julian ; Haubruck, Patrick ; Nickel, Felix ; Walker, Tilman ; Friedrich, Mirco ; Müller-Stich, Peter ; Schmidmaier, Gerhard ; Tanner, Michael C. underlies the terms of Creative Commons Attribution 4.0

[img] PDF, English (Correction to the article [20.02.2019]) - Supplemental Material
Download (242kB) | Lizenz: Creative Commons LizenzvertragDevelopment and validation of an objective assessment scale for chest tube insertion under ‘direct’ and ‘indirect’ rating by Ober, Julian ; Haubruck, Patrick ; Nickel, Felix ; Walker, Tilman ; Friedrich, Mirco ; Müller-Stich, Peter ; Schmidmaier, Gerhard ; Tanner, Michael C. underlies the terms of Creative Commons Attribution 4.0

Citation of documents: Please do not cite the URL that is displayed in your browser location input, instead use the DOI, URN or the persistent URL below, as we can guarantee their long-time accessibility.

Abstract

Background: There is an increasing need for objective and validated educational concepts. This holds especially true for surgical procedures like chest tube insertion (CTI). Thus, we developed an instrument for objectification of learning successes: the assessment scale based on Objective Structured Assessment of Technical Skill (OSATS) for chest tube insertion, which is evaluated in this study. Primary endpoint was the evaluation of intermethod reliability (IM). Secondary endpoints are ‘indirect’ interrater reliability (IR) and construct validity of the scale (CV).

Methods: Every participant (N = 59) performed a CTI on a porcine thorax. Participants received three ratings (one ‘direct’ on site, two ‘indirect’ via video rating). IM compares ‘direct’ with ‘indirect’ ratings. IR was assessed between ‘indirect’ ratings. CV was investigated by subgroup analysis based on prior experience in CTI for ‘direct’ and ‘indirect’ rating.

Results: We included 59 medical students to our study. IM showed moderate conformity (‘direct’ vs. ‘indirect 1’ ICC = 0.735, 95% CI: 0.554–0.843; ‘direct’ vs. ‘indirect 2’ ICC = 0.722, 95% CI 0.533–0.835) and good conformity between ‘direct’ vs. ‘average indirect’ rating (ICC = 0.764, 95% CI: 0.6–0.86). IR showed good conformity (ICC = 0.84, 95% CI: 0.707–0.91). CV was proven between subgroups in ‘direct’ (p = 0.037) and ‘indirect’ rating (p = 0.013).

Conclusion: Results for IM suggest equivalence for ‘direct’ and ‘indirect’ ratings, while both IR and CV was demonstrated in both rating methods. Thus, the assessment scale seems a reliable method for rating trainees’ performances ‘directly’ as well as ‘indirectly’. It may help to objectify and facilitate the assessment of training of chest tube insertion.

- - - - - - - - -

CORRECTION

Published online 20.02.2019 in BMC Medical Education 19 (2019), Nr. 62; DOI: https://doi.org/10.1186/s12909-019-1491-4. Following publication of the original article, the author reported that the given name and family name of all authors were swapped. The original article has been corrected.

Item Type: Article
Journal or Publication Title: BMC Medical Education
Volume: 18
Number: 320
Publisher: BioMed Central
Place of Publication: London
Date Deposited: 08 Feb 2019 12:43
Date: 2018
ISSN: 1472-6920
Page Range: pp. 1-9
Faculties / Institutes: Medizinische Fakultät Heidelberg > Chirurgische Universitätsklinik
Medizinische Fakultät Heidelberg > Orthopädische Klinik
Subjects: 610 Medical sciences Medicine
Uncontrolled Keywords: OSATS, Chest tube insertion, Education, Training, Video rating, Intermethod reliability, Interrater reliability, Construct validity, Direct rating, Indirect rating
About | FAQ | Contact | Imprint |
OA-LogoDINI certificate 2013Logo der Open-Archives-Initiative