Using GOMS and NASA-TLX to Evaluate Human-Computer Interaction Process in Interactive Segmentation

Using GOMS and NASA-TLX to Evaluate Human-Computer Interaction Process in Interactive Segmentation

Ramkumar, A. (TU Delft Mechatronic Design)
Stappers, P.J. (TU Delft Design Conceptualization and Communication)
Niessen, W.J. (TU Delft ImPhys/Quantitative Imaging; Erasmus MC)
Adebahr, S (Albert-Ludwigs-Universität Freiburg; German Cancer Consortium (DKTK))
Schimek-Jasch, T (Albert-Ludwigs-Universität Freiburg)
Nestle, U (Albert-Ludwigs-Universität Freiburg; German Cancer Consortium (DKTK))
Song, Y. (TU Delft Mechatronic Design)

2017

HCI plays an important role in interactive medical image segmentation. The Goals, Operators, Methods, and Selection rules (GOMS) model and the National Aeronautics and Space Administration Task Load Index (NASA-TLX) questionnaire are different methods that are often used to evaluate the HCI process. In this article, we aim at improving the HCI process of interactive segmentation using both the GOMS model and the NASA-TLX questionnaire to: 1) identify the relations between these two methods and 2) propose HCI design suggestions based on the synthesis of the evaluation results using both methods. For this, we conducted an experiment where three physicians used two interactive segmentation approaches to segment different types of organs at risk for radiotherapy planning. Using the GOMS model, we identified 16 operators and 10 methods. Further analysis discovered strong relations between the use of GOMS operators and the results of the NASA-TLX questionnaire. Finally, HCI design issues were identified, and suggestions were proposed based on the evaluation results and the identified relations.

http://resolver.tudelft.nl/uuid:ba996509-4e14-4c02-b561-50249dd53442

https://doi.org/10.1080/10447318.2016.1220729

1044-7318

International Journal of Human-Computer Interaction, 33 (2), 123-134

Institutional Repository

journal article

© 2017 A. Ramkumar, P.J. Stappers, W.J. Niessen, S Adebahr, T Schimek-Jasch, U Nestle, Y. Song