Print Email Facebook Twitter Exploring The Reliability, Time Efficiency, And Fairness Of Comparative Judgement In The Admission Of Architecture Students Title Exploring The Reliability, Time Efficiency, And Fairness Of Comparative Judgement In The Admission Of Architecture Students Author van den Heuvel, L. (TU Delft Education and Student Affairs) Bohm, N.L. (TU Delft Urban Development Management) Date 2023 Abstract It is common in architecture education to quantify the quality of assignments into grades, often done by one or two teachers using rubrics. However, this can have several downsides. It suggests an objective preciseness that is debatable for the creative assignments in the field of architecture, and the assessment is dependent on the judgement of only one or two people. Comparative judgement (CJ) offers an alternative to rubric-based assessment by applying pairwise comparison to student assignments, resulting in a ranking instead of a grade.We used a mixed methods approach to compare the reliability, time efficiency, and fairness of CJ in the selection of students for an undergraduate architecture programme at Delft University of Technology in the Netherlands. Teachers involved in the rubric-based approach for student selection were asked to re-assess a random selection of the assignments using CJ. Reliability and time investments for both methods were compared, and the involved assessors were asked in a focus group setting which of the two methods they perceived as more reliable and fair. Comparing rubric-based assessment to CJ is new, as previous studies have only looked at these assessment methods in isolation.Findings indicate that CJ can be serve as a more reliable and time efficient alternative to rubric-based assessment. However, teachers still perceive rubrics as having higher reliability and fairness. Though this research is particularly relevant in the context of architecture, it contributes to wider discussions about reliable and fair assessment of creative student assignments. Subject assessmentcomparative judgementfairnessreliability To reference this document use: http://resolver.tudelft.nl/uuid:bef99bc2-8cb6-4bb3-ba84-ca2ff960dc4a DOI https://doi.org/10.21427/WEY8-JZ69 Event 51st Annual Conference of the European Society for Engineering Education, SEFI 2023, 2023-09-11 → 2023-09-14, Dublin, Ireland Part of collection Institutional Repository Document type conference paper Rights © 2023 L. van den Heuvel, N.L. Bohm Files PDF Exploring_The_Reliability ... _Compa.pdf 464.51 KB Close viewer /islandora/object/uuid:bef99bc2-8cb6-4bb3-ba84-ca2ff960dc4a/datastream/OBJ/view