Evaluation of competency methods in engineering education
A systematic review
M. Leandro Cruz (Novel Aerospace Materials)
Gillian Smits (TU Delft - Aerospace Structures & Materials)
Wilhelm A. Groen (TU Delft - Aerospace Structures & Materials)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
The purpose of this systematic review is to evaluate the state-of-the-art of competency measurement methods with an aim to inform the creation of reliable and valid measures of student mastery of competencies in communication, lifelong learning, innovation/creativity and teamwork in engineering education. We identified 99 studies published in three databases over the last 17 years. For each study, purpose, corresponding methods, criteria used to establish competencies, and validity and reliability properties were evaluated. This analysis identified several measurement methods of which questionnaires and rubrics were the most used. Many measurement methods were found to lack competency definitions and evidence of validity and reliability. These show a clear need for establishing professional standards when measuring mastery of competencies. Therefore, in this paper, we propose guidelines for the design of reliable and valid measurement methods to be used by educators and researchers.
help_outline