Multisensory correlation computations in the human brain identified by a time-resolved encoding model.

Pesnot Lerousseau, Jacques ORCID: 0000-0003-3799-0602, Parise, Cesare V ORCID: 0009-0000-6092-561X, Ernst, Marc O and van Wassenhove, Virginie ORCID: 0000-0002-2569-5502 (2022) Multisensory correlation computations in the human brain identified by a time-resolved encoding model. Nature communications, 13 (1). 2489-.

PDF
s41467-022-29687-6 (1).pdf - Open Access published version
Download (2MB) | Preview

Official URL: http://dx.doi.org/10.1038/s41467-022-29687-6

Abstract

Neural mechanisms that arbitrate between integrating and segregating multisensory information are essential for complex scene analysis and for the resolution of the multisensory correspondence problem. However, these mechanisms and their dynamics remain largely unknown, partly because classical models of multisensory integration are static. Here, we used the Multisensory Correlation Detector, a model that provides a good explanatory power for human behavior while incorporating dynamic computations. Participants judged whether sequences of auditory and visual signals originated from the same source (causal inference) or whether one modality was leading the other (temporal order), while being recorded with magnetoencephalography. First, we confirm that the Multisensory Correlation Detector explains causal inference and temporal order behavioral judgments well. Second, we found strong fits of brain activity to the two outputs of the Multisensory Correlation Detector in temporo-parietal cortices. Finally, we report an asymmetry in the goodness of the fits, which were more reliable during the causal inference task than during the temporal order judgment task. Overall, our results suggest the existence of multisensory correlation detectors in the human brain, which explain why and how causal inference is strongly driven by the temporal correlation of multisensory signals.

Item Type:	Article
Uncontrolled Keywords:	Brain, Parietal Lobe, Humans, Magnetoencephalography, Acoustic Stimulation, Photic Stimulation, Auditory Perception, Visual Perception
Divisions:	Faculty of Health and Life Sciences Faculty of Health and Life Sciences > Institute of Population Health
Depositing User:	Symplectic Admin
Date Deposited:	03 Nov 2023 16:27
Last Modified:	18 Mar 2024 03:31
DOI:	10.1038/s41467-022-29687-6
Related URLs:	Author Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3176526