Workshops as a research method
Guidelines for designing and evaluating artifacts through workshops
K.C. Thoring (TU Delft - Form and Experience, Anhalt University of Applied Sciences Dessau)
Roland M. Mueller (Berlin School of Economics and Law, University of Twente)
PG Badke-Schaub (TU Delft - DesIgning Value in Ecosystems)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Workshops are often used in the information systems (IS) and design fields to evaluate artifacts or to co-create business innovations. However, the evaluation of workshops is often conducted in a rather unsystematic and heterogenous way. This paper introduces a set of guidelines for designing or evaluating artifacts through workshops. These guidelines include five evaluation principles and a framework that outlines appropriate evaluation methods for different research goals. The relevant constructs and principles were identified based on related literature. The derived evaluation matrix was then revised based on ratings of five experts who independently assigned appropriate research methods for different evaluation foci. The framework's applicability was evaluated by comparing it with ten papers from the IS and design fields. The proposed guidelines can support researchers with conducting workshop evaluations in a comparable and replicable way, which will help to improve research rigor in the future.
help_outline