Repository hosted by TU Delft Library

Home · Contact · About · Disclaimer ·
 

A human benchmark for language recognition

Publication files not online:

Author: Orr, R. · Leeuwen, D.A. van
Type:article
Date:2009
Institution: TNO Defensie en Veiligheid
Source:Interspeech 2009, september, Brighton, UK.
Identifier: 93997
Keywords: Acoustics and Audiology · automatic speech recognition · speech · language

Abstract

In this study, we explore a human benchmark in language recognition, for the purpose of comparing human performance to machine performance in the context of the NIST LRE 2007. Humans are categorised in terms of language proficiency, and performance is presented per proficiency. Themain challenge in this work is the design of a test and application of a performance metric which allows a meaningful comparison of humans and machines. The main result of this work is that where subjects have lexical knowledge of a language, even at a low level, they perform as well as the state of the art in language recognition systems in 2007.