Grading 600+ students

A Case Study on Peer and Self Grading

Conference Paper (2021)
Author(s)

Maurício Aniche (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Frank Mulder (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Felienne Hermans (Universiteit Leiden)

Research Group
Software Engineering
DOI related publication
https://doi.org/10.1109/ICSE-SEET52601.2021.00031 Final published version
More Info
expand_more
Publication Year
2021
Language
English
Research Group
Software Engineering
Article number
9402176
Pages (from-to)
211-220
ISBN (print)
978-1-6654-0138-8
ISBN (electronic)
9780738133201
Event
43rd International Conference on Software Engineering (2021-05-25 - 2021-05-28), Virtual/online event due to COVID-19, Virtual at Madrid, Spain
Downloads counter
340
Collections
Institutional Repository
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Grading large classes has become a challenging and expensive task for many universities. The Delft University of Technology (TU Delft), located in the Netherlands, has observed a large increase in student numbers over the past few years. Given the large growth of the student population, grading all the submissions results in high costs. We made use of self and peer grading in the 2018-2019 edition of our software testing course. Students worked in teams of two, and self and peer graded three assignments in our course. We ended up with 906 self and peer graded submissions, which we compared to 248 submissions that were graded by our TAs. In this paper, we report on the differences we observed between self, peer, and TA grading. Our findings show that: (i) self grades tend to be 8-10% higher than peer grades on average, (ii) peer grades seem to be a good approximator of TA grades; in cases where self and peer grade differ significantly, the TA grade seems to lie in between, and (iii) the gender and the nationality of the student do not seem to affect self and peer grading.

Files

Icse_jseet_2021.pdf
(pdf | 0.575 Mb)
License info not available