Cerebral Cortex · 2007 · 369 citations · 73 references
Language StudiesNeurobiologyNeuroscienceNeurolinguisticsSensory NeuroscienceVisual PerceptionAuditory NeurophysiologyAuditory ProcessingSpeech PerceptionSpeech ProductionSpeech Sound ProductionVoice PerceptionMotor System NeuroanatomySpeech Production Link
Observing a speaker’s mouth profoundly influences speech perception, as illustrated by listeners perceiving an illusory “ta” when a video of a face producing /ka/ is dubbed onto audio /pa/. The study investigates how cortical areas supporting speech production mediate this illusory percept and audiovisual speech perception more generally. Cortical activity during audiovisual speech perception occurs in many of the same areas that are active during speech production. Different perceptions of the same syllable and of different syllables are associated with distinct activity patterns in frontal motor areas; the illusory “ta” percept elicits motor activity more similar to AV/ta/ than to AV/pa/ or AV/ka/, while initial auditory, somatosensory, and visual activity resembles AV/pa/ and AV/ka/ but ultimately converges to AV/ta/, suggesting that audiovisual speech elicits a motor plan for the intended phoneme and that efference copy from the motor system influences phonetic interpretation.
Observing a speaker's mouth profoundly influences speech perception. For example, listeners perceive an "illusory" "ta" when the video of a face producing /ka/ is dubbed onto an audio /pa/. Here, we show how cortical areas supporting speech production mediate this illusory percept and audiovisual (AV) speech perception more generally. Specifically, cortical activity during AV speech perception occurs in many of the same areas that are active during speech production. We find that different perceptions of the same syllable and the perception of different syllables are associated with different distributions of activity in frontal motor areas involved in speech production. Activity patterns in these frontal motor areas resulting from the illusory "ta" percept are more similar to the activity patterns evoked by AV/ta/ than they are to patterns evoked by AV/pa/ or AV/ka/. In contrast to the activity in frontal motor areas, stimulus-evoked activity for the illusory "ta" in auditory and somatosensory areas and visual areas initially resembles activity evoked by AV/pa/ and AV/ka/, respectively. Ultimately, though, activity in these regions comes to resemble activity evoked by AV/ta/. Together, these results suggest that AV speech elicits in the listener a motor plan for the production of the phoneme that the speaker might have been attempting to produce, and that feedback in the form of efference copy from the motor system ultimately influences the phonetic interpretation.
73
The assessment and analysis of handedness: The Edinburgh inventory
R. C. Oldfield · Neuropsychologia · 1971 · 36.7K citations
Cortical Surface-Based Analysis
Anders M. Dale, Bruce Fischl, Martin I. Sereno · NeuroImage · 1999 · 11.5K citations
Cortical Surface-Based Analysis
Bruce Fischl, Martin I. Sereno, Anders M. Dale · NeuroImage · 1999 · 6.4K citations
Hearing lips and seeing voices
Harry McGurk, John MacDonald · Nature · 1976 · 6.1K citations