Print Email Facebook Twitter Helping Chatbots To Better Understand User Requests Efficiently Using Human Computation Title Helping Chatbots To Better Understand User Requests Efficiently Using Human Computation Author Bapat, Rucha (TU Delft Electrical Engineering, Mathematics and Computer Science) Contributor Houben, Geert-Jan (graduation committee) Bozzon, Alessandro (mentor) Kucherbaev, Pavel (mentor) Wang, Huijuan (graduation committee) Degree granting institution Delft University of Technology Date 2017-08-28 Abstract Chatbots are the text based conversational agents with which users interact in natural language. They are becoming more and more popular with the immense growth in messaging apps and tools to develop text based conversational agents. Despite of advances in Artificial Intelligence and Natural Language Processing, chatbots still struggle in accurately understanding user requests, thus providing wrong answers or no response. An effective solution to tackle this problem is involving human's capabilities in chatbot’s operations for understanding user requests. There are many existing systems using humans in chatbots but they are not capable to scale up with the increasing number of users. To address this problem, we provide insights in how to design such chatbot system having humans in the loop and how to involve humans efficiently.We perform an extensive literature survey about chatbots, and human computation applied for a chatbot, to guide the design of our reference chatbot system. Then we address the problem of cold starting chatbot systems. We propose a methodology to generate high quality training data, with which, chatbot’s Natural Language Understanding (NLU) model can be trained, making a chatbot capable of handling user requests efficiently at run time. Finally we provide a methodology to estimate the reliability of black box NLU models based on the confidence threshold of their prediction functionality. We study and discuss the effect of parameters such as training data set size, type of intents on automatic NLU model. Subject ChatbotNatural Language UnderstandingHuman Computation To reference this document use: http://resolver.tudelft.nl/uuid:90d24571-dbca-4bd9-afe6-af718ea3d5c8 Part of collection Student theses Document type master thesis Rights © 2017 Rucha Bapat Files PDF Rucha_Bapat_Master_Thesis ... Report.pdf 4.12 MB Close viewer /islandora/object/uuid%3A90d24571-dbca-4bd9-afe6-af718ea3d5c8/datastream/OBJ/view