Second Workshop on Educational A/B Testing at Scale

Conference Paper (2021)
Author(s)

Steve Ritter (Carnegie Learning, Inc.)

Neil Heffernan (Worcester Polytechnic Institute)

Joseph Jay Williams (University of Toronto)

Derek Lomas (TU Delft - Form and Experience)

Klinton Bicknell (Duolingo)

Research Group
Form and Experience
Copyright
© 2021 Steve Ritter, Neil Heffernan, Joseph Jay Williams, J.D. Lomas, Klinton Bicknell
DOI related publication
https://doi.org/10.1145/3430895.3460876
More Info
expand_more
Publication Year
2021
Language
English
Copyright
© 2021 Steve Ritter, Neil Heffernan, Joseph Jay Williams, J.D. Lomas, Klinton Bicknell
Research Group
Form and Experience
Pages (from-to)
311-314
ISBN (electronic)
9781450382151
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

The emerging discipline of Learning Engineering is focused on putting into place tools and processes that use the science of learning as a basis for improving educational outcomes. An important part of Learning Engineering focuses on improving the effectiveness of educational software. In many software domains, A/B testing has become a prominent technique to achieve the software's goals. Many large companies (Amazon, Google, Facebook, etc.) run thousands of AB tests and present at the Annual Conference on Digital Experimentation (CODE), but that venue is too broad to address AB testing issues specific to EdTech platforms. We see a need to address issues with running large-scale A/B tests within the educational context, where the use of A/B testing lags other industries. This workshop will explore ways in which A/B testing in educational contexts differs from other domains and proposals to overcome current challenges so that this approach can become a more useful tool in the learning engineer's toolbox.