The accuracy of an audio interface designed for value elicitation

Abstract

Behavior support applications aim to provide personalized and flexible support to users in various domains. To achieve this, understanding users' preferences, values, and context is crucial. Creating user models that incorporate users' norms and values has been proposed as a solution to capture the relationship between desired behaviors and values. However, updating and modifying user models at run-time remains a challenge, as users' norms and values may change over time. This study investigates the accuracy of an audio interface designed to elicit values-related information using isolated questions. This involves designing an audio interface and evaluating its effectiveness through participant interactions, where they are presented with four scenarios. It was found that the audio interface performs above average in terms of usability, as indicated by the System Usability Scale score. The accuracy of the user models is evaluated through the Hamming distance and value differences between the base model and the participant-improved model. Most models required a small number of changes, and when changes were made, they were generally minimal. Additionally, feedback collected through open-ended interview questions lays down a basis for further development. The study contributes to the field by demonstrating the efficacy of the audio interface and its potential for updating user models in real-time. Overall, the research findings support the development of more effective and personalized behavior support applications that can adapt to its users.