Publication: Effects of errors on ratings of writing...
Master data
Title: | Effects of errors on ratings of writing performances |
Subtitle: | Evidence from a high-stakes exam |
Abstract: | The study reported in the paper starts with a hypothesis that errors observable in writing performances can account for much of the variability of the ratings awarded to them. The assertion is that this may be the case even when prescribed rating criteria explicitly direct rater focus towards successfully performed aspects of a writing performance rather than towards errors. The hypothesis is tested on a sample of texts rated independently of the study, using a five-point analytic rating scale involving ‘Can do’-like descriptors. The correlation between errors and ratings is ascertained using ordinal logistic regression, with Pseudo R2 of 0.51 discerned overall. Thus, with roughly 50% of score variability explainable by error occurrences, the stated hypothesis is considered confirmed. The study goes on to discuss the consequences of the findings and their potential employ in assessment of writing beyond the local assessment context. |
Keywords: | writing assessment; errors; score variability; annotation; rater cognition |
Publication type: | Article in journal (Authorship) |
Publication date: | 26.12.2023 (Online) |
Published by: |
Assessing Writing
Assessing Writing
(
Elsevier;
)
to publication |
Title of the series: | - |
Volume number: | 59 |
Issue: | - |
First publication: | Yes |
Version: | - |
Page: | - |
Versionen
Keine Version vorhanden |
Publication date: | 26.12.2023 |
ISBN (e-book): | - |
eISSN: | - |
DOI: | http://dx.doi.org/10.1016/j.asw.2023.100806 |
Homepage: | https://www.sciencedirect.com/science/article/pii/S1075293523001149?via%3Dihub |
Open access |
|
Publication date: | 01.2024 |
ISBN: | - |
ISSN: | - |
Homepage: | - |
Assignment
Organisation | Address | ||||
---|---|---|---|---|---|
Fakultät für Kultur- und Bildungswissenschaften
Institut für Anglistik und Amerikanistik
|
AT - 9020 Klagenfurt |
Categorisation
Subject areas | |
Research Cluster |
|
Citation index |
Information about the citation index: Master Journal List
|
Peer reviewed |
|
Publication focus |
Classification raster of the assigned organisational units:
|
working groups | No working group selected |
Cooperations
Research activities
Projects: | No related projects |
Publications: | No related publications |
Events: | No related events |
Lectures: | No related lectures |