Grading 600+ students

A Case Study on Peer and Self Grading

Conference Paper (2021)
Author(s)

Maurício Aniche (TU Delft - Software Engineering)

F. Mulder (TU Delft - Computer Science & Engineering-Teaching Team)

Felienne Hermans (Universiteit Leiden)

Research Group
Software Engineering
Copyright
© 2021 Maurício Aniche, F. Mulder, Felienne Hermans
DOI related publication
https://doi.org/10.1109/ICSE-SEET52601.2021.00031
More Info
expand_more
Publication Year
2021
Language
English
Copyright
© 2021 Maurício Aniche, F. Mulder, Felienne Hermans
Research Group
Software Engineering
Pages (from-to)
211-220
ISBN (print)
978-1-6654-0138-8
ISBN (electronic)
9780738133201
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Grading large classes has become a challenging and expensive task for many universities. The Delft University of Technology (TU Delft), located in the Netherlands, has observed a large increase in student numbers over the past few years. Given the large growth of the student population, grading all the submissions results in high costs. We made use of self and peer grading in the 2018-2019 edition of our software testing course. Students worked in teams of two, and self and peer graded three assignments in our course. We ended up with 906 self and peer graded submissions, which we compared to 248 submissions that were graded by our TAs. In this paper, we report on the differences we observed between self, peer, and TA grading. Our findings show that: (i) self grades tend to be 8-10% higher than peer grades on average, (ii) peer grades seem to be a good approximator of TA grades; in cases where self and peer grade differ significantly, the TA grade seems to lie in between, and (iii) the gender and the nationality of the student do not seem to affect self and peer grading.

Files

Icse_jseet_2021.pdf
(pdf | 0.575 Mb)
License info not available