EXTRACTING SHAPE AND LOCATION INFORMATION CONVEYED BY VISUAL-TO-AUDITORY SENSORY SUBSTITUTION ACTIVATES THE LATERAL OCCIPITAL COMPLEX AND DORSAL VISUAL STREAM RESPECTIVELY IN BLIND AND SIGHTED INDIVIDUALS.
Single Paper Presentation
Amir Amedi
Berenson-Allen Center for Noninvasive Brain Stimulation, Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical School.
William Stern
Berenson-Allen Center for Noninvasive Brain Stimulation, Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical School. Joan A Camprodon
Berenson-Allen Center for Noninvasive Brain Stimulation, Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical School. Felix Bermpohl
Berenson-Allen Center for Noninvasive Brain Stimulation, Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical School. Lotfi Merabet
Berenson-Allen Center for Noninvasive Brain Stimulation, Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical School. Peter Meijer
NXP, formerly at Philips Research, Eindhoven, The Netherlands Alvaro Pascual-Leone
Berenson-Allen Center for Noninvasive Brain Stimulation, Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical School. Abstract ID Number: 115 Full text:
Not available Last modified:
April 16, 2007
Presentation date: 07/06/2007 11:30 AM in Quad General Lecture Theatre
(View Schedule)
Abstract
In sensory substitution, visual information captured by an artificial receptor is delivered to the brain using non-visual sensory information via a human-machine interface. Part of the Lateral-Occipital-Complex (LOtv) is activated when objects are recognized by vision or touch. We report here that both sighted and blind individuals who recognize objects by extracting shape information from soundscapes created by a visual-to-auditory sensory substitution device called "The vOICe" also activated LOtv. Recognizing objects by their typical sounds or learning to associate specific soundscapes with specific objects fail to activate this region. This suggests that LOtv rather then being driven by the sensory information modality is driven by the presence of shape information. We also studied shape versus location processing of visual geometrical shapes transformed into soundscapes. We find specific recruitment of ventral visual stream (used in sighted to perceive form) to the shape soundscapes condition while dorsal stream (used in sighted to perceive space) was recruited in the location condition. These results support the meta-modal theory of the brain, in which cortical regions are defined by the computation they apply rather than their dominant sensory modality input.
|