eprintid: 24495
rev_number: 14
eprint_status: archive
userid: 1589
dir: disk0/00/02/44/95
datestamp: 2018-05-30 09:54:59
lastmod: 2024-08-02 09:06:20
status_changed: 2018-05-30 09:58:47
type: article
metadata_visibility: show
creators_name: Schüttpelz-Brauns, Katrin
creators_name: Kadmon, Martina
creators_name: Kiessling, Claudia
creators_name: Karay, Yassin
creators_name: Gestmann, Margarita
creators_name: Kämmer, Juliane E.
title: Identifying low test-taking effort during low-stakes tests with the new Test-taking Effort Short Scale (TESS) – development and psychometrics
subjects: ddc-610
divisions: i-910100
abstract: Background: Low-stakes tests are becoming increasingly important in international assessments of educational progress, and the validity of these results is essential especially as these results are often used for benchmarking. Test scores in these tests not only mirror students’ ability but also depend on their test-taking effort. One way to obtain more valid scores from participating samples is to identify test-takers with low test-taking effort and to exclude them from further analyses. Self-assessment is a convenient and quick way of measuring test-taking effort. We present the newly developed Test-taking Effort Short Scale (TESS), which comprises three items measuring attainment value/intrinsic value, utility value, and perceived benefits, respectively.

Methods: In a multicenter validation study with N = 1837 medical students sitting a low-stakes progress test we analyzed item and test statistics including construct and external validity.

Results: TESS showed very good psychometric properties. We propose an approach using stanine norms to determine a cutoff value for identifying participants with low test-taking effort.

Conclusion: With just three items, TESS is shorter than most established self-assessment scales; it is thus suited for administration after low-stakes progress testing. However, further studies are necessary to establish its suitability for routine usage in assessment outside progress testing.
date: 2018
publisher: BioMed Central
id_scheme: DOI
ppn_swb: 1653440228
own_urn: urn:nbn:de:bsz:16-heidok-244955
language: eng
bibsort: SCHUTTPELZIDENTIFYIN2018
full_text_status: public
publication: BMC Medical Education
volume: 18
number: 101
place_of_pub: London
pagerange: 1-10
issn: 1472-6920
citation:   Schüttpelz-Brauns, Katrin ; Kadmon, Martina ; Kiessling, Claudia ; Karay, Yassin ; Gestmann, Margarita ; Kämmer, Juliane E.  (2018) Identifying low test-taking effort during low-stakes tests with the new Test-taking Effort Short Scale (TESS) – development and psychometrics.  BMC Medical Education, 18 (101).  pp. 1-10.  ISSN 1472-6920     
document_url: https://archiv.ub.uni-heidelberg.de/volltextserver/24495/1/12909_2018_Article_1196.pdf