ACM Transactions on Computer-Human Interaction · 2013 · 40 citations · 65 references
EducationInstructionSpecial EducationAssistive TechnologyInclusive EducationNonverbal CommunicationAssistive Technology For Visual ImpairmentEmbodied InteractionHapticsMultimodal DiscourseMultimodal InstructionMultimodal InteractionDeictic GesturesEmbodied MeaningGesture-based InstructionHaptic Interface DesignHaptic User InterfaceLearning OpportunitiesMathematics For Blind LearnersMultimodal Communication Systems
Human discourse is an embodied activity emerging from the embodied imagery and construction of our talk. Gesture and speech are coexpressive, conveying this imagery and meaning simultaneously. Mathematics instruction and discourse typically involve two modes of communication: speech and graphical presentation. Our goal is to assist Individuals who are Blind or Severely Visually Impaired (IBSVI) to access such instruction/communication. We employ a haptic glove interface to furnish the IBSVI with awareness of the deictic gestures performed by the instructor over the graphic in conjunction with speech. We present a series of studies spanning two years where we show how our Haptic Deictic System (HDS) can support learning in inclusive classrooms where IBSVI receive instruction alongside sighted students. We discuss how the introduction of the HDS was advantageous to all parties: IBSVI, instructor, and sighted students. The HDS created more learning opportunities, increasing mutual understanding and promoting greater engagement.
65
Hand and mind: what gestures reveal about thought
Choice Reviews Online · 1993 · 5.1K citations
Premotor cortex and the recognition of motor actions
Giacomo Rizzolatti, Luciano Fadiga, Vittorio Gallese et al. · Cognitive Brain Research · 1996 · 4.8K citations
Penelope Sweetser, Peta Wyeth · Computers in entertainment · 2005 · 2.1K citations
Definite reference and mutual knowledge
Herbert H. Clark · Medical Entomology and Zoology · 1981 · 1.2K citations