Title
Third Annual Workshop on A/B Testing and Platform-Enabled Learning Research
Author
Ritter, Steven (Carnegie Learning, Inc.)
Heffernan, Neil (Worcester Polytechnic Institute)
Williams, Joseph Jay (University of Toronto)
Lomas, J.D. (TU Delft Design Aesthetics) 
Motz, Ben (Indiana University - Purdue University)
Basu Mallick, Debshila (Rice University)
Bicknell, Klinton (Duolingo)
McNamara, Danielle (Arizona State University)
Kizilcec, Rene F. (Cornell University)
Date
2022
Abstract
Learning engineering adds tools and processes to learning platforms to support improvement research. One kind of tool is A/B testing, which is common in large software companies and also represented academically at conferences like the Annual Conference on Digital Experimentation (CODE). A number of A/B testing systems focused on educational applications have arisen recently, including UpGrade and E-TRIALS. A/B testing can be part of the puzzle of how to improve educational platforms, and yet challenging issues in education go beyond the generic paradigm. For example, the importance of teachers and instructors to learning means that students are not only connecting with software as individuals, but also as part of a shared classroom experience. Further, learning in topics like mathematics can be highly dependent on prior learning, and thus A or B may not be better overall, but only in interaction with prior knowledge. In response, a set of learning platforms is opening their systems to improvement research by instructors and/or third-party researchers, with specific supports necessary for education-specific research designs. This workshop will explore how A/B testing in educational contexts is different, how learning platforms are opening up new possibilities, and how these empirical approaches can be used to drive powerful gains in student learning. It will also discuss forthcoming opportunities for funding to conduct platform-enabled learning research.
Subject
A/B testing
educational software
To reference this document use:
http://resolver.tudelft.nl/uuid:8dcb8e69-ecd9-414a-a8fa-2088f24c0362
DOI
https://doi.org/10.1145/3491140.3528288
Publisher
Association for Computing Machinery (ACM)
Embargo date
2023-07-01
ISBN
978-1-4503-9158-0
Source
L@S 2022 - Proceedings of the 9th ACM Conference on Learning @ Scale
Event
9th Annual ACM Conference on Learning at Scale, L@S 2022, 2022-06-01 → 2022-06-03, New York City, United States
Series
L@S 2022 - Proceedings of the 9th ACM Conference on Learning @ Scale
Bibliographical note
Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.
Part of collection
Institutional Repository
Document type
conference paper
Rights
© 2022 Steven Ritter, Neil Heffernan, Joseph Jay Williams, J.D. Lomas, Ben Motz, Debshila Basu Mallick, Klinton Bicknell, Danielle McNamara, Rene F. Kizilcec, More Authors