The role of conditioning in perceptual inference
Human Cognitive and Systems Neuroscience
Final Report Abstract
We investigated the role of learning in perceptual inference, focusing on effects of reward and punishment conditioning on perceptual dominance durations during bistable perception. Related research questions that evolved over the course of the project concerned other forms of associative learning and the role of confidence in learning and inference. We confirmed our initial hypotheses regarding the effects of learning on perceptual inference, as indicated by changes in perceptual dominance durations during bistable perception. Effects of reward and punishment during percept conditioning were in opposite directions, with increased dominance of rewarded percepts and decreased dominance of punished percepts. This finding resembles instrumental conditioning, thus narrowing the gap between the conceptually separated domains of perception and action selection. Interestingly, and in line with our hypotheses, we found that percept conditioning and stimulus conditioning had dissociable effects: In contrast to the observed reduction in dominance durations after aversive percept conditioning, aversive stimulus conditioning yielded an increase in dominance durations, thus suggesting an enhanced salience of the conditioned stimulus. Using fMRI, we could not fully replicate the effects of percept conditioning on perceptual phase durations, but identified metacognitive awareness as an important factor modulating conditioning effects on perceptual inference. The use of a bistable plaid motion stimulus was successful in yielding highly accurate decoding (91% correct) of perceptual states. This is a substantial methodological advance in the field and makes our newly developed paradigm an ideal candidate for objective decoding of subjective perceptual phenomena. Using computational modeling and model-based fMRI, which emerged as an important asset to the project, we found that perceptual inference incorporates rapidly changing expectations from different sources in a manner consistent with Bayesian learning. Model-based fMRI showed that low-level predictions were associated with activity in early visual cortex whereas higher-level predictions correlated with activity in supramodal frontal and temporal regions. Finally, in a model-based fMRI study investigating the role of confidence in learning, we found that subjective confidence involves the mesolimbic reward system and that the neural signals associated with confidence predict its effect on perceptual inference. Taken together, the project yielded important new insights into the role of conditioning and other forms of learning on perceptual inference and the underlying neural mechanisms. Moreover, substantial methodological advances were made with regard to both the development of novel experimental paradigms and the application of advanced computational modelling approaches. The results of this project therefore pave the way for future research into the role of learning processes in perceptual inference in pathological states, such as schizophrenia or depression.
Publications
- (2018) The Neural Correlates of Hierarchical Predictions for Perceptual Decisions. The Journal of neuroscience : the official journal of the Society for Neuroscience 38 (21) 5008–5021
Weilnhammer, Veith A.; Stuke, Heiner; Sterzer, Philipp; Schmack, Katharina
(See online at https://doi.org/10.1523/JNEUROSCI.2901-17.2018) - Reinforcement of perceptual inference: reward and punishment alter conscious visual perception during binocular rivalry. Front Psychol. 2014;5:1377
Wilbertz G, van Slooten J, Sterzer P
(See online at https://doi.org/10.3389/fpsyg.2014.01377) - Mesolimbic confidence signals guide perceptual learning in the absence of external feedback. Elife. 2016;5
Guggenmos M, Wilbertz G, Hebart MN, Sterzer P
(See online at https://doi.org/10.7554/eLife.13388) - fMRI-based decoding of reward effects in binocular rivalry. Neurosci Conscious. 2017;3(1):nix013
Wilbertz G, Van Kemenade BM, Schmack K, Sterzer P
(See online at https://doi.org/10.1093/nc/nix013) - Combined fMRI- and eye movementbased decoding of bistable plaid motion perception. Neuroimage. 2018;171:190-198
Wilbertz G, Ketkar M, Guggenmos M, Sterzer P
(See online at https://doi.org/10.1016/j.neuroimage.2017.12.094) - Differentiating aversive conditioning in bistable perception: Avoidance of a percept vs. salience of a stimulus. Conscious Cogn. 2018;61:38-48
Wilbertz G, Sterzer P
(See online at https://doi.org/10.1016/j.concog.2018.03.010) - Multistable Perception and the Role of the Frontoparietal Cortex in Perceptual Inference. Annu Rev Psychol. 2018;69:77-103
Brascamp J, Sterzer P, Blake R, Knapen T
(See online at https://doi.org/10.1146/annurev-psych-010417-085944)
