Neural representations of non-native speech reflect proficiency and interference from native language knowledge

Journal Article (2023)
Author(s)

Christian Brodbeck (University of Connecticut)

Katerina Danae Kandylaki (Maastricht University)

Odette Scharenborg (TU Delft - Multimedia Computing)

Multimedia Computing
Copyright
© 2023 Christian Brodbeck, Katerina Danae Kandylaki, O.E. Scharenborg
DOI related publication
https://doi.org/10.1523/JNEUROSCI.0666-23.2023
More Info
expand_more
Publication Year
2023
Language
English
Copyright
© 2023 Christian Brodbeck, Katerina Danae Kandylaki, O.E. Scharenborg
Multimedia Computing
Issue number
1
Volume number
44 (2024)
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Learning to process speech in a foreign language involves learning new representations for mapping the auditory signal to linguistic structure. Behavioral experiments suggest that even listeners that are highly proficient in a non-native language experience interference from representations of their native language. However, much of the evidence for such interference comes from tasks that may inadvertently increase the salience of native language competitors. Here we tested for neural evidence of proficiency and native language interference in a naturalistic story listening task. We studied electroencephalography responses of 39 native speakers of Dutch (14 male) to an English short story, spoken by a native speaker of either American English or Dutch. We modeled brain responses with multivariate temporal response functions, using acoustic and language models. We found evidence for activation of Dutch language statistics when listening to English, but only when it was spoken with a Dutch accent. This suggests that a naturalistic, monolingual setting decreases the interference from native language representations, whereas an accent in the listeners’ own native language may increase native language interference, by increasing the salience of the native language and activating native language phonetic and lexical representations. Brain responses suggest that such interference stems from words from the native language competing with the foreign language in a single word recognition system, rather than being activated in a parallel lexicon. We further found that secondary acoustic representations of speech (after 200 ms latency) decreased with increasing proficiency. This may reflect improved acoustic-phonetic models in more proficient listeners.

Files

License info not available