Evaluating and comparing language workbenches
Existing results and benchmarks for the future
Sebastian Erdweg (Technische Universität Darmstadt)
Tijs van der Storm (Centrum Wiskunde & Informatica (CWI))
Markus Völter (Voelter.de)
Laurence Tratt (King’s College London)
Remi Bosman (Sioux)
William R. Cook (The University of Texas at Austin)
Albert Gerritsen (Sioux)
Angelo Hulshout (Delphino Consultancy)
Steven Kelly (MetaCase)
Alex Loh (The University of Texas at Austin)
Gabriël Konat (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Pedro J. Molina (Icinetic)
Martin Palatnik (Sioux)
Risto Pohjonen (MetaCase)
Eugen Schindler (Sioux)
Klemens Schindler (Sioux)
Riccardo Solmi (External organisation)
Vlad Vergu (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Eelco Visser (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Kevin Van Der Vlist (Sogyo)
Guido Wachsmuth (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Jimi Van Der Woning (Young Colfield)
More Info
expand_more
Abstract
Language workbenches are environments for simplifying the creation and use of computer languages. The annual Language Workbench Challenge (LWC) was launched in 2011 to allow the many academic and industrial researchers in this area an opportunity to quantitatively and qualitatively compare their approaches. We first describe all four LWCs to date, before focussing on the approaches used, and results generated, during the third LWC. We give various empirical data for ten approaches from the third LWC. We present a generic feature model within which the approaches can be understood and contrasted. Finally, based on our experiences of the existing LWCs, we propose a number of benchmark problems for future LWCs.