Evaluating the Believability of the Lilobot Conversational Agent
A Bachelor Thesis
V. Makarov (TU Delft - Electrical Engineering, Mathematics and Computer Science)
M. Al Owayyed – Mentor (TU Delft - Electrical Engineering, Mathematics and Computer Science)
W.P. Brinkman – Mentor (TU Delft - Electrical Engineering, Mathematics and Computer Science)
E. Eisemann – Graduation committee member (TU Delft - Electrical Engineering, Mathematics and Computer Science)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
The aim of this research is to evaluate the believability of Lilobot, a conversational agent meant to act as a virtual child for training helpline workers. Numerous aspects of believability are explored by means of a user study involving a questionnaire and interview with 10 participants. Questionnaire results indicate that improvement to the chatbot's believability is likely necessary.
The findings from the interviews are that the use of emoticons and acknowledging the context of the application raise believability, while unresponsiveness and repeated utterances lower it. While Lilobot did express valid and real emotions, study participants suggested improving the appropriateness of its reactions and expanding its vocabulary.