Evaluating the Accuracy of User Values Elicited through a Textual Interface
Conducting a user study with a textual interface using questions in isolation to capture user values
P.J.M. Kastelein (TU Delft - Electrical Engineering, Mathematics and Computer Science)
P.Y. Chen – Mentor (TU Delft - Interactive Intelligence)
C.M. Jonker – Mentor (TU Delft - Interactive Intelligence)
S.D.C. Wehner – Graduation committee member (TU Delft - QID/Wehner Group)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
This research paper focuses on the accuracy and limitations of user values elicited through a textual interface with questions asked in isolation. The primary objective was to conduct a user study using a textual interface that uses questions in isolation to assess the effectiveness and accuracy of this interface type and questioning style. The study involved exploring various scenarios and associated user values, as well as comparing the textual interface with graphical and audio interfaces tested in four related studies. The user study consisted of 15 participants who interacted with the textual interface. Afterwards, they were tasked with judging and adapting their behaviour models while also evaluating the interface's usability. The findings indicate that while the textual interface demonstrates decent usability, participants did not perceive a strong need for the current system and that compared to other interface types, the textual interface does not yield the most accurate results. This research provides insights into the usability and limitations of a textual interface for eliciting user values. It emphasizes the need for further exploration and development of alternative interface types to enhance accuracy and user engagement.