2008 · 20 citations · 4 references
Language StudiesLinguisticsComputational LinguisticsPhoneticsPhonologyLanguage ModelingMultilingual Natural Language ProcessingMultilingual ProcessingMultilingualismPhonological AnalysisSpeech RecognitionCode-switching Speech ProcessingCross-linguistic PhoneticsForced AlignmentPhoneme Inventory AnalysisPhoneme Inventory DevelopmentPhoneme-to-acoustics MappingSecond Language ProcessingSpoken Language Generation
Multilingual speech processing continues to develop as speech technology spreads to heterogeneous clients and applications. We address a distinct problem of code-switching — the spontaneous but occasional use, within speech in one language (referred to as L1), of words, phrases, expressions or idioms from a second language (L2). We examine two alternatives for modeling the acoustics of such words: creation of L1 pronunciations for the out-of-language (OOL) words for use with L1 acoustic models, and retention of their L2 pronunciations for use with multilingual acoustic models. We test the hypothesis that the latter is a better acoustic model for OOL words. We develop a set of lexica in IPA form, a global phoneme inventory, and handle the problem of L2 word pronunciation by creating linguistically motivated pairwise mappings. We show that retention of L2 pronunciations with multilingual acoustic models better explains the observations when restricted to a forced alignment. Index Terms: Cross-lingual and multi-lingual processing, Automatic speech recognition, Accent and language identification, Spoken language resources and annotation 1.
4
Treebank Penn · Medical Entomology and Zoology · 1999 · 657 citations
Combination of strongly and weakly constrained recognizers for reliable detection of OOVS
Lukáš Burget, Petr Schwarz, Pavel Matějka et al. · Proceedings of the ... IEEE International Conference on Acoustics, Speech, and Signal Processing · 2008 · 61 citations
Computing, Computer Science, Natural Language Processing +12