Neuroscience 2003 Abstract
| Presentation Number: | 288.31 |
|---|---|
| Abstract Title: | Cross-modal binding with activated attentional networks during audio-visual speech integration: a functional MRI study. |
| Authors: |
Saito, D. N.*1
; Yoshimura, K.1
; Okada, T.1
; Sadato, N.1
1Cerebral Resch, Cerebral Integ, Natl. Inst. for Physiolog Sci, Okazaki, Japan |
| Primary Theme and Topics |
Sensory Systems - Multisensory |
| Session: |
288. Language I Poster |
| Presentation Time: | Sunday, November 9, 2003 3:00 PM-4:00 PM |
| Location: | Morial Convention Center - Hall F-I, Board # I27 |
| Keywords: | AUDITORY, VISUAL, SPEECH |
To evaluate the neural substrates of cross-modal binding during audio-visual speech integration, and those of the cross-modal divided attention, we performed 3 Tesla functional MRI in 17 normal volunteers. During the scan, the subjects were exposed to the phonemically congruent or incongruent auditory and visual speech. In each trial, 2 visual speeches were presented side-by-side simultaneously. Two auditory speeches were given sequentially, the first of which was synchronized to the visual speeches. Three different matching tasks were performed with event-related design: auditory-auditory (AA), visual-visual (VV), and auditory-visual (AV). Subjects were asked to discriminate if the prompted pair was congruent or not. During AV conditions, congruent trials evoked more prominent activation than incongruent ones in the left anterior superior temporal sulcus (STS) and posterior intraparietal sulcus (IPS). AV tasks compared with AA or VV revealed more prominent activation in the bilateral dorsal premotor cortex (PMd) and posterior superior parietal lobule (LPs) close to the parieto-occipital sulcus, and the left IPS. The activation of the anterior STS, which is a multisensory as well as human voice selective area, is consistent with the notion that the audible and visible evidence of speech converge at the phonetic level of speech processing. Without cross-modal binding related activation, posterior LPs and PMd may be the part of the supramodal attentional system that was activated by the cross-modal attentional workload. The left posterior IPS, known as another multisensory area, was activated by both cross-modal binding and divided attention. Thus the control of attention and the cross-modal speech identification may be intimately intertwined and mediated in the left posterior IPS.
Supported by Grants-in-Aid for Scientific Research (B, No14380370) from the Ministry of Education, Sciences and Culture, Japan.
Sample Citation:
[Authors]. [Abstract Title]. Program No. XXX.XX. 2003 Neuroscience Meeting Planner. New Orleans, LA: Society for Neuroscience, 2003. Online.
Copyright © 2003-2026 Society for Neuroscience; all rights reserved. Permission to republish any abstract or part of any abstract in any form must be obtained in writing by SfN office prior to publication.
