Moving Beyond Standardized Metrics: Rethinking Criteria for Evaluating Educational Innovations

Conference Paper (2025)
Author(s)

E. Engelbrecht (TU Delft - Spatial Planning and Strategy)

J. M. Strobel (University of Texas at El Paso)

R.M. Rooij (TU Delft - Spatial Planning and Strategy)

DOI related publication
https://doi.org/10.5281/zenodo.17631658 Final published version
More Info
expand_more
Publication Year
2025
Language
English
ISBN (electronic)
978-2-87352-029-8
Event
Downloads counter
27
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

The field of innovation evaluation in engineering education is growing, yet the perspectives of educators and educational support staff are often overlooked. As a result, critical factors such as relevance, context, and long-term value can go unrecognized, limiting both the effectiveness of evaluations and stakeholder engagement. This workshop builds on findings from a Group Concept Mapping (GCM) study conducted at a European university of technology, where engineering educators and support staff collaboratively identified and ranked 104 criteria for evaluating educational innovations. Early findings revealed a strong emphasis on qualitative aspects, such as workload, student well-being, and alignment with stakeholder needs, ranked above concerns such as scalability and regulatory compliance. The workshop has two aims: to broaden the study by involving an international group of participants from diverse professional roles, and to introduce the engineering education community to a more inclusive and stakeholder-informed view of 'quality'. Participants will collaboratively reflect on and further develop the list of evaluation criteria, and group them into conceptual themes. By the end of the session, participant groups will have explored and developed categorizations of evaluation criteria.