Computer Assisted Language Learning · 2021 · 214 citations · 45 references
Language StudiesEducational TechnologyForeign LanguagesLanguage AcquisitionSecond Language EducationSecond Language LearningConversation SkillsConversational InterfacesLanguage LearningLanguage Learning ApplicationsMultimodal InteractionSecond Language AcquisitionConversationsForeign Language InstructionImmersionImmersive Language LearningMultimodal ConversationMultimodal Language LearningSpoken Dialogue SystemsStudent Feedback Conversations
AI and XR have been used to provide experiential learning akin to immersion, yet research on multimodal spoken dialogue with immersive tech and collaborative learning remains sparse, limiting L2 experiences to solo, vocabulary‑centric interactions. The study introduces the Cognitive Immersive Language Learning Environment (CILLE) to address this gap. CILLE combines AI that perceives and engages users in non‑dyadic multimodal conversations with XR that immerses students without intrusive devices, enabling naturalistic, multi‑party interactions; its effectiveness was evaluated in a seven‑week mixed‑methods study with ten university students. The study found statistically significant gains in CFL vocabulary, comprehension, and conversation skills, with student feedback and researcher observations confirming CILLE’s design and experiential impact.
Artificial Intelligence (AI) and Extended Reality (XR) have been employed in several foreign language education applications to increase the availability of experiential learning methods akin to international immersion programs. However, research in multi-modal spoken dialogue in L2 combined with immersive technologies and collaborative learning is thin, limiting students’ experiences to solo interactions focused mostly on vocabulary and grammar in such settings. We intend to fill this gap as we present the Cognitive Immersive Language Learning Environment (CILLE). The AI in CILLE can hear, see, and understand its users and can engage with them in non-dyadic multimodal conversations. The XR offers students a feeling of being somewhere else without the use of intrusive devices and supports multi-party, multi-modal interactions. Together, AI and XR create naturalistic conversational interactions targeted towards comprehensive foreign language acquisition. We evaluate CILLE as a Chinese-as-a-foreign-language (CFL) education tool through a seven-week, mixed-methods study with university students (N = 10). Results display statistical significance and retained improvement in CFL vocabulary, comprehension, and conversation skills. Coupled with an analysis of student feedback and researcher observations, we show how CILLE is designed and experienced by students to learn CFL.
45
Situated Cognition and the Culture of Learning
John Seely Brown, Allan Collins, Paul Duguid · Educational Researcher · 1989 · 13K citations · Full text
The CAVE: audio visual experience automatic virtual environment
Carolina Cruz‐Neira, Daniel J. Sandin, Thomas A. DeFanti et al. · Communications of the ACM · 1992 · 1.7K citations
Jack Burston · IALLT Journal of Language Learning Technologies · 2013 · 894 citations · Full text
Barbara F. Freed, Norman Segalowitz, Dan P. Dewey · Studies in Second Language Acquisition · 2004 · 539 citations
The Psychology of Second Language Acquisition
Cecily Clayton · rEFLections · 2010 · 535 citations · Full text