2024 · 25 citations · 42 references
ComputingSpecial EducationSpeech-language PathologyAssistive TechnologyNatural Language ProcessingVocabulary DevelopmentArtificial Intelligence In Language LearningLanguage Learning ApplicationsLanguage ModelingMobile-assisted Language LearningNatural Language GenerationAac Device DesignAlternative Communication DevicesAlternative Communication InterventionCommunication BoardsLanguage GenerationLarge Language ModelsSatisfactionVocabulary Support Tools
Traditional topic-specific communication boards for Augmentative and Alternative Communication (AAC) require manual programming of relevant symbolic vocabulary, which is time-consuming and often impractical even for experienced Speech-Language Pathologists (SLPs). While recent research has demonstrated the potential to automatically generate these boards from photographs using artificial intelligence, there has been no exploration on how to design such tools to support the specific needs of AAC-based language instruction. This paper introduces QuickPic, a mobile AAC application co-designed with SLPs and special educators, aimed at enhancing language learning for non-speaking individuals, such as autistic children. Through a 17-month design process, we uncover the unique design features required to provide timely language support in therapy and special education contexts. We present emerging evidence on the overall satisfaction of SLPs using QuickPic, and on the advantages of large language model-based generation compared to the existing technique for automated vocabulary from photographs for AAC.
42
On the Dangers of Stochastic Parrots
Emily M. Bender, Timnit Gebru, Angelina McMillan-Major et al. · 2021 · 5.6K citations · Full text
Computing, Computer Science, English +12
From captions to visual concepts and back
Hao Fang, Saurabh Gupta, Forrest Iandola et al. · 2015 · 1.3K citations
What should we expect from research through design?
William Gaver · 2012 · 1.1K citations
Arts, Design, Design Theory +9