2021 · 11 citations · 38 references
Language StudiesEducational TechnologySecond Language StudiesLanguage ProficiencySecond Language LearningSecond Language TeachingAdaptive FeedbackAutomated Feedback GenerationCorrective FeedbackPronunciation InstructionSecond Language AcquisitionSpeaking ProficiencyCorrective Feedback DesignCorrective Feedback ModalityEnglish Language LearnersExaggerationFeedbackMetricsPronunciation FeedbackTechnology-mediated Pronunciation Instruction
Second language (L2) English learners often find it difficult to improve their pronunciations due to the lack of expressive and personalized corrective feedback. In this paper, we present Pronunciation Teacher (PTeacher), a Computer-Aided Pronunciation Training (CAPT) system that provides personalized exaggerated audio-visual corrective feedback for mispronunciations. Though the effectiveness of exaggerated feedback has been demonstrated, it is still unclear how to define the appropriate degrees of exaggeration when interacting with individual learners. To fill in this gap, we interview 100 L2 English learners and 22 professional native teachers to understand their needs and experiences. Three critical metrics are proposed for both learners and teachers to identify the best exaggeration levels in both audio and visual modalities. Additionally, we incorporate the personalized dynamic feedback mechanism given the English proficiency of learners. Based on the obtained insights, a comprehensive interactive pronunciation training course is designed to help L2 learners rectify mispronunciations in a more perceptible, understandable, and discriminative manner. Extensive user studies demonstrate that our system significantly promotes the learners’ learning efficiency.
38
Linguistic Experience Alters Phonetic Perception in Infants by 6 Months of Age
Patricia K. Kuhl, Karen A. Williams, Francisco Lacerda et al. · Science · 1992 · 2.1K citations
Montreal Forced Aligner: Trainable Text-Speech Alignment Using Kaldi
Michael McAuliffe, Michaela Socolof, Sarah Mihuc et al. · 2017 · 1.1K citations
Ann R. Bradlow, David B. Pisoni, Reiko Akahane-Yamada et al. · The Journal of the Acoustical Society of America · 1997 · 849 citations · Full text