A Survey of Crowdsourcing in Medical Image Analysis
S. N. Ørting (University of Copenhagen)
A. Doyle (McGill Centre for Integrative Neuroscience)
A. van Hilten (Erasmus MC)
M. Hirth (Ilmenau University of Technology)
O. Inel (Vrije Universiteit Amsterdam)
C. R. Madan (University of Nottingham)
Panagiotis Mavridis (TU Delft - Web Information Systems)
H. Spiers (University of Oxford)
V. Cheplygina (Eindhoven University of Technology)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Rapid advances in image processing capabilities have been seen across many domains, fostered by the application of machine learning algorithms to "big-data". However, within the realm of medical image analysis, advances have been curtailed, in part, due to the limited availability of large-scale, well-annotated datasets. One of the main reasons for this is the high cost often associated with producing large amounts of high-quality meta-data. Recently, there has been growing interest in the application of crowdsourcing for this purpose; a technique that has proven effective for creating large-scale datasets across a range of disciplines, from computer vision to astrophysics. Despite the growing popularity of this approach, there has not yet been a comprehensive literature review to provide guidance to researchers considering using crowdsourcing methodologies in their own medical imaging analysis. In this survey, we review studies applying crowdsourcing to the analysis of medical images, published prior to July 2018. We identify common approaches, challenges and considerations, providing guidance of utility to researchers adopting this approach. Finally, we discuss future opportunities for development within this emerging domain.