Cortical Hierarchies Perform Bayesian Causal Inference in Multisensory Perception

Summary

To form a veridical percept of the environment, the brain needs to integrate sensory signals from a common source but segregate those from independent sources. Thus, perception inherently relies on solving the “causal inference problem.” Behaviorally, humans solve this problem optimally as predicted by Bayesian Causal Inference; yet, the underlying neural mechanisms are unexplored. Combining psychophysics, Bayesian modeling, functional magnetic resonance imaging (fMRI), and multivariate decoding in an audiovisual spatial localization task, we demonstrate that Bayesian Causal Inference is performed by a hierarchy of multisensory processes in the human brain. At the bottom of the hierarchy, in auditory and visual areas, location is represented on the basis that the two signals are generated by independent sources (= segregation). At the next stage, in posterior intraparietal sulcus, location is estimated under the assumption that the two signals are from a common source (= forced fusion). Only at the top of the hierarchy, in anterior intraparietal sulcus, the uncertainty about the causal structure of the world is taken into account and sensory signals are combined as predicted by Bayesian Causal Inference. Characterizing the computational operations of signal interactions reveals the hierarchical nature of multisensory perception in human neocortex. It unravels how the brain accomplishes Bayesian Causal Inference, a statistical computation fundamental for perception and cognition. Our results demonstrate how the brain combines information in the face of uncertainty about the underlying causal structure of the world.

Related articles

• Cellular Types and Organization: Prokaryotes vs. Eukaryotes

  This lesson provides an overview of the structural differences between prokaryotic and eukaryotic cells, detailing their characteristics, functions, and roles in the classification of living organisms.

• INTRODUCTION TO CHEMISTRY

  This document introduces the fundamental concepts of chemistry, including the branches of inorganic and organic chemistry, scientific methods, measurements, and applications of chemicals in various fields such as medicine and agriculture.

• Programmable protein stabilization with language model-derived peptide guides

  This article explores the engineering of "deubiquibodies" (duAbs) that utilize computationally-designed peptide guides to stabilize proteins involved in critical cellular processes, showcasing their programmability and effectiveness in cellular environments.

• Target sequence-conditioned design of peptide binders using masked language modeling

  This article presents PepMLM, a novel approach to designing peptide binders conditioned on target sequences. By utilizing masked language modeling, the method effectively reconstructs peptide regions and demonstrates significant potential in targeting disease-related proteins without structural input.

• Lesson 2: Species Concept and Speciation

  This document outlines various species concepts and the process of speciation, discussing definitions, implications, and the history of these concepts in the field of biology. It reviews theoretical frameworks that attempt to categorize species based on reproductive, ecological, and evolutionary criteria.