2023 · 11 citations · 6 references
EducationEducational TechnologySpecial EducationAssistive TechnologyAutism Spectrum DisordersNonverbal CommunicationAlternative CommunicationCommunicative CompetenceEmbodied InteractionHand-eye CoordinationMultimodal InteractionSpeech InteractionCommunication Skills SupportCommunicative Competence DevelopmentMultimodal Speech InteractionPerceptual Motor SkillsPerformer Interaction
About 30% of autistic people are nonspeakers; they cannot use speech to communicate effectively. Pointing to letters on a letterboard held by a Communication and Regulation Partner (CRP) is one alternative method of expressive communication that some members of this population use. In the training of this method, a CRP delivers engaging and customized lessons. Additionally, the CRP provides regulatory, sensory, and attentional support and also works to strengthen the subject’s pointing skills. The goal of this training is to equip individuals with the required skills to be able to type independently. Recent studies have proposed using AR to provide opportunities for nonspeakers to practice the motor skills involved in typing. To use such systems, however, there needs to be a transition phase where a CRP teaches their subject how to interact with a virtual letterboard. In this paper, we explore the feasibility of using cross-reality, in which a CRP and nonspeaker can interact with the same virtual objects simultaneously, as a possible means of fostering this transition. We report a study involving 5 nonspeaking autistic subjects with diverse motor skills interacting using a virtual HoloLens 2 letterboard system we developed called HoloBoard. All subjects succeeded in pointing to letters correctly or spelling on the virtual board. We report process and design recommendations based on feedback obtained from subjects and their CRPs.
6
Christopher Frauenberger, Judith Good, Alyssa M. Alcorn et al. · International Journal of Child-Computer Interaction · 2013 · 75 citations · Full text
Arts, Design, Special Education +13
David James Savarese · Autism in Adulthood · 2019 · 34 citations · Full text
AAC Technology, Autism, and the Empathic Turn
Janna van Grunsven, Sabine Roeser · Social Epistemology · 2021 · 28 citations · Full text