Vision and touch are automatically integrated for the perception of sequences of events
Single Paper Presentation

Marc O. Ernst
Max Planck Institute for Biological Cybernetics

Jean-Pierre Bresciani

Franziska Dammeier

     Abstract ID Number: 191
     Full text: Not available
     Last modified: March 20, 2006
     Presentation date: 06/18/2006 10:30 AM in Hamilton Building, McNeil Theatre
     (View Schedule)

Abstract
The purpose of the present experiment was to investigate the integration of sequences of visual and tactile events. Participants were presented with sequences of visual flashes and tactile taps simultaneously and instructed to count either the flashes (session 1) or the taps (session 2). The number of flashes could differ from the number of taps by ±1. For both sessions, the perceived number of events was significantly influenced by the number of events presented in the task-irrelevant modality. Touch had a stronger influence on vision than vision on touch. Interestingly, touch was the more reliable of the two modalities – less variable estimates when presented alone. For both sessions, the perceptual estimates were less variable when stimuli were presented in both modalities than when the task-relevant modality was presented alone. These results indicate that even when one signal is explicitly task-irrelevant, sensory information tends to be automatically integrated across modalities. They also suggest that the relative weight of each sensory channel in the integration process depends on its relative reliability. The results are described using a Bayesian probabilistic model for multimodal integration that accounts for the coupling between the sensory estimates.