Language Cognition and Neuroscience · 2024 · 11 citations · 38 references
Social SciencesCommunicationLinguisticsInterpersonal CommunicationNonverbal CommunicationPsycholinguisticsBody LanguageConversation AnalysisGesture InteractionMultimodal CommunicationMultimodal InteractionSpeech InteractionAccuracyCo-speech GestureHand GesturesHuman Multimodal InteractionIconic GesturesInteractional MultimodalityMultimodal ConversationTurn-taking
Most language use occurs in face-to-face conversation, which involves rapid turn-taking. Seeing communicative bodily signals in addition to hearing speech may facilitate such fast responding. We tested whether this holds for co-speech hand gestures by investigating whether these gestures speed up button press responses to questions. Sixty native speakers of Dutch viewed videos in which an actress asked yes/no-questions, either with or without a corresponding iconic hand gesture. Participants answered the questions as quickly and accurately as possible via button press. Gestures did not impact response accuracy, but crucially, gestures sped up responses, suggesting that response planning may be finished earlier when gestures are seen. How much gestures sped up responses was not related to their timing in the question or their timing with respect to the corresponding information in speech. Overall, these results are in line with the idea that multimodality may facilitate fast responding during face-to-face conversation.
38
Fitting Linear Mixed-Effects Models Using <b>lme4</b>
Douglas M. Bates, Martin Mächler, Benjamin M. Bolker et al. · Journal of Statistical Software · 2015 · 85.6K citations · Full text
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text
Hand and mind: what gestures reveal about thought
Choice Reviews Online · 1993 · 5.1K citations