The effects of stereo disparity on the behavioural and electrophysiological correlates of perception of audio-visual motion in depth

Harrison, Neil R, Witheridge, Sian, Makin, Alexis ORCID: 0000-0002-4490-7400, Wuerger, Sophie ORCID: 0000-0003-0080-5813, Pegna, Alan J and Meyer, Georg (2015) The effects of stereo disparity on the behavioural and electrophysiological correlates of perception of audio-visual motion in depth. Neuropsychologia, 78. pp. 51-62.

Text Harrison_2015.pdf - Author Accepted Manuscript Download (1MB)

Abstract

Motion is represented by low-level signals, such as size-expansion in vision or loudness changes in the auditory modality. The visual and auditory signals from the same object or event may be integrated and facilitate detection. We explored behavioural and electrophysiological correlates of congruent and incongruent audio–visual depth motion in conditions where auditory level changes, visual expansion, and visual disparity cues were manipulated. In Experiment 1 participants discriminated auditory motion direction whilst viewing looming or receding, 2D or 3D, visual stimuli. Responses were faster and more accurate for congruent than for incongruent audio–visual cues, and the congruency effect (i.e., difference between incongruent and congruent conditions) was larger for visual 3D cues compared to 2D cues. In Experiment 2, event-related potentials (ERPs) were collected during presentation of the 2D and 3D, looming and receding, audio–visual stimuli, while participants detected an infrequent deviant sound. Our main finding was that audio–visual congruity was affected by retinal disparity at an early processing stage (135–160 ms) over occipito-parietal scalp. Topographic analyses suggested that similar brain networks were activated for the 2D and 3D congruity effects, but that cortical responses were stronger in the 3D condition. Differences between congruent and incongruent conditions were observed between 140–200 ms, 220–280 ms, and 350–500 ms after stimulus onset.

Item Type:	Article
Uncontrolled Keywords:	Brain, Humans, Electroencephalography, Acoustic Stimulation, Photic Stimulation, Auditory Perception, Motion Perception, Vision Disparity, Psychophysics, Neuropsychological Tests, Evoked Potentials, Adult, Female, Male, Discrimination, Psychological
Depositing User:	Symplectic Admin
Date Deposited:	09 Aug 2016 10:09
Last Modified:	19 Jan 2023 07:32
DOI:	10.1016/j.neuropsychologia.2015.09.023
Related URLs:	Author Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3002827