English
Related papers

Related papers: Divide-and-Conquer Predictive Coding: a structured…

200 papers

Predictive coding (PC) is an influential theory of information processing in the brain, providing a biologically plausible alternative to backpropagation. It is motivated in terms of Bayesian inference, as hidden states and parameters are…

Predictive coding (PC) is an influential computational model of visual learning and inference in the brain. Classical PC was proposed as a top-down generative model, where the brain actively predicts upcoming visual inputs, and inference…

Machine Learning · Computer Science 2025-12-18 Gaspard Oliviers , Mufeng Tang , Rafal Bogacz

A large amount of recent research has the far-reaching goal of finding training methods for deep neural networks that can serve as alternatives to backpropagation (BP). A prominent example is predictive coding (PC), which is a…

Machine Learning · Computer Science 2022-11-08 Luca Pinchetti , Tommaso Salvatori , Yordan Yordanov , Beren Millidge , Yuhang Song , Thomas Lukasiewicz

Artificial intelligence (AI) is rapidly becoming one of the key technologies of this century. The majority of results in AI thus far have been achieved using deep neural networks trained with a learning algorithm called error…

Artificial Intelligence · Computer Science 2025-10-30 Tommaso Salvatori , Ankur Mali , Christopher L. Buckley , Thomas Lukasiewicz , Rajesh P. N. Rao , Karl Friston , Alexander Ororbia

This paper presents a new learning algorithm, termed Deep Bi-directional Predictive Coding (DBPC) that allows developing networks to simultaneously perform classification and reconstruction tasks using the same weights. Predictive Coding…

Machine Learning · Computer Science 2023-05-31 Senhui Qiu , Saugat Bhattacharyya , Damien Coyle , Shirin Dora

Predictive coding offers a potentially unifying account of cortical function -- postulating that the core function of the brain is to minimize prediction errors with respect to a generative model of the world. The theory is closely related…

Artificial Intelligence · Computer Science 2022-07-14 Beren Millidge , Anil Seth , Christopher L Buckley

Decision trees are commonly used predictive models due to their flexibility and interpretability. This paper is directed at quantifying the uncertainty of decision tree predictions by employing a Bayesian inference approach. This is…

Machine Learning · Computer Science 2024-03-28 Jodie A. Cochrane , Adrian Wills , Sarah J. Johnson

Predictive coding is a unifying framework for understanding perception, action and neocortical organization. In predictive coding, different areas of the neocortex implement a hierarchical generative model of the world that is learned from…

Neurons and Cognition · Quantitative Biology 2023-05-22 Linxing Preston Jiang , Rajesh P. N. Rao

Predictive coding (PC) is a brain-inspired local learning algorithm that has recently been suggested to provide advantages over backpropagation (BP) in biologically relevant scenarios. While theoretical work has mainly focused on showing…

Neural and Evolutionary Computing · Computer Science 2023-06-01 Francesco Innocenti , Ryan Singh , Christopher L. Buckley

Divide-and-conquer is a general strategy to deal with large scale problems. It is typically applied to generate ensemble instances, which potentially limits the problem size it can handle. Additionally, the data are often divided by random…

Machine Learning · Computer Science 2019-11-19 Ke Alexander Wang , Xinran Bian , Pan Liu , Donghui Yan

Recently, there has been extensive research on the capabilities of biologically plausible algorithms. In this work, we show how one of such algorithms, called predictive coding, is able to perform causal inference tasks. First, we show how…

Machine Learning · Computer Science 2024-06-04 Tommaso Salvatori , Luca Pinchetti , Amine M'Charrak , Beren Millidge , Thomas Lukasiewicz

In computer science, divide and conquer (D&C) is an algorithm design paradigm based on multi-branched recursion. A D&C algorithm works by recursively and monotonically breaking down a problem into sub problems of the same (or a related)…

Computation and Language · Computer Science 2018-09-24 Diego Gabriel Krivochen

Predictive coding is an influential theory of cortical function which posits that the principal computation the brain performs, which underlies both perception and learning, is the minimization of prediction errors. While motivated by…

Neurons and Cognition · Quantitative Biology 2020-10-13 Beren Millidge , Alexander Tschantz , Anil Seth , Christopher L Buckley

Predictive Coding (PC) is a theoretical framework in cognitive science suggesting that the human brain processes cognition through spatiotemporal prediction of the visual world. Existing studies have developed spatiotemporal prediction…

Neural and Evolutionary Computing · Computer Science 2024-05-07 Kaiyuan Chen , Xingzhuo Guo , Yu Zhang , Jianmin Wang , Mingsheng Long

Predictive coding (PC) is an influential theory in computational neuroscience, which argues that the cortex forms unsupervised world models by implementing a hierarchical process of prediction error minimization. PC networks (PCNs) are…

Neural and Evolutionary Computing · Computer Science 2022-08-05 Beren Millidge , Yuhang Song , Tommaso Salvatori , Thomas Lukasiewicz , Rafal Bogacz

Predictive coding has emerged as an influential normative model of neural computation, with numerous extensions and applications. As such, much effort has been put into mapping PC faithfully onto the cortex, but there are issues that remain…

Neurons and Cognition · Quantitative Biology 2023-03-07 Siavash Golkar , Tiberiu Tesileanu , Yanis Bahroun , Anirvan M. Sengupta , Dmitri B. Chklovskii

We develop a novel form of differentiable predictive control (DPC) with safety and robustness guarantees based on control barrier functions. DPC is an unsupervised learning-based method for obtaining approximate solutions to explicit model…

Systems and Control · Electrical Eng. & Systems 2022-08-05 Wenceslao Shaw Cortez , Jan Drgona , Aaron Tuor , Mahantesh Halappanavar , Draguna Vrabie

We propose a novel class of Sequential Monte Carlo (SMC) algorithms, appropriate for inference in probabilistic graphical models. This class of algorithms adopts a divide-and-conquer approach based upon an auxiliary tree-structured…

Backpropagation (BP) is the standard algorithm for training the deep neural networks that power modern artificial intelligence including large language models. However, BP is energy inefficient and unlikely to be implemented by the brain.…

Machine Learning · Computer Science 2025-10-30 Francesco Innocenti

In recent years, research unveiled more and more evidence for the so-called Bayesian Brain Paradigm, i.e. the human brain is interpreted as a probabilistic inference machine and Bayesian modelling approaches are hence used successfully. One…

Neural and Evolutionary Computing · Computer Science 2019-04-30 Kevin Jasberg , Sergej Sizov
‹ Prev 1 2 3 10 Next ›