Repository hosted by TU Delft Library

Home · Contact · About · Disclaimer ·

INSPIRE: Evaluation of a Smart-Home System for Infotainment Management and Device Control

Publication files not online:

Author: Möller, S. · Krebber, J. · Raake, A. · Smeele, P. · Rajman, M. · Melichar, M. · Pallotta, V. · Tsakou, G. · Kladis, B. · Vovos, A. · Hoonhout, A. · Schuchardt, D. · Fakotakis, N. · Ganchev, T. · Potamitis, I.
Institution: TNO Technische Menskunde
Source:Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC 2004), Portugal Lisboa, 5, 1603 - 1606
Identifier: 13163
Keywords: Perception


This paper gives an overview of the assessment and evaluation methods which have been used to determine the quality of the INSPIRE smart home system. The system allows different home appliances to be controlled via speech, and consists of speech and speaker recognition, speech understanding, dialogue management, and speech output components. The performance of these components is first assessed individually, and then the entire system is evaluated in an interaction experiment with test users. Initial results of the assessment and evaluation are given, in particular with respect to the transmission channel impact on speech and speaker recognition, and the assessment of speech output for different system metaphors.