English
Related papers

Related papers: Learning Long-Range Dependencies with Temporal Pre…

200 papers

Constructing states from sequences of observations is an important component of reinforcement learning agents. One solution for state construction is to use recurrent neural networks. Back-propagation through time (BPTT), and real-time…

Machine Learning · Computer Science 2023-11-23 Khurram Javed , Haseeb Shah , Rich Sutton , Martha White

Predictive coding networks (PCNs) are an influential model for information processing in the brain. They have appealing theoretical interpretations and offer a single mechanism that accounts for diverse perceptual phenomena of the brain. On…

Machine Learning · Computer Science 2021-03-08 Tommaso Salvatori , Yuhang Song , Thomas Lukasiewicz , Rafal Bogacz , Zhenghua Xu

Predictive coding (PC) is an influential theory of information processing in the brain, providing a biologically plausible alternative to backpropagation. It is motivated in terms of Bayesian inference, as hidden states and parameters are…

Predictive coding (PC) is an energy-based learning algorithm that performs iterative inference over network activities before updating weights. Recent work suggests that PC can converge in fewer learning steps than backpropagation thanks to…

Machine Learning · Computer Science 2024-11-12 Francesco Innocenti , El Mehdi Achour , Ryan Singh , Christopher L. Buckley

Neuroscience and Artificial Intelligence (AI) have progressed in tandem, each contributing to our understanding of the brain, and inspiring recent developments in biologically-plausible neural networks (NNs) and learning rules. Predictive…

Neural and Evolutionary Computing · Computer Science 2024-06-24 Ehsan Ganjidoost , Mallory Snow , Jeff Orchard

Training with backpropagation (BP) in standard deep learning consists of two main steps: a forward pass that maps a data point to its prediction, and a backward pass that propagates the error of this prediction back through the network.…

Machine Learning · Computer Science 2022-10-13 Tommaso Salvatori , Luca Pinchetti , Beren Millidge , Yuhang Song , Tianyi Bao , Rafal Bogacz , Thomas Lukasiewicz

Connectionist temporal classification (CTC) is a popular sequence prediction approach for automatic speech recognition that is typically used with models based on recurrent neural networks (RNNs). We explore whether deep convolutional…

Computation and Language · Computer Science 2018-02-16 Kalpesh Krishna , Liang Lu , Kevin Gimpel , Karen Livescu

Inspired by "predictive coding" - a theory in neuroscience, we develop a bi-directional and dynamic neural network with local recurrent processing, namely predictive coding network (PCN). Unlike feedforward-only convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Kuan Han , Haiguang Wen , Yizhen Zhang , Di Fu , Eugenio Culurciello , Zhongming Liu

Learning long-term dependencies is a key long-standing challenge of recurrent neural networks (RNNs). Hierarchical recurrent neural networks (HRNNs) have been considered a promising approach as long-term dependencies are resolved through…

Machine Learning · Computer Science 2019-10-14 Asier Mujika , Felix Weissenberger , Angelika Steger

The dichotomy between the challenging nature of obtaining annotations for activities, and the more straightforward nature of data collection from wearables, has resulted in significant interest in the development of techniques that utilize…

Machine Learning · Computer Science 2022-11-14 Harish Haresamudram , Irfan Essa , Thomas Ploetz

Anomaly detection in multi-variate time series (MVTS) data is a huge challenge as it requires simultaneous representation of long term temporal dependencies and correlations across multiple variables. More often, this is solved by breaking…

Machine Learning · Computer Science 2022-02-09 Theivendiram Pranavan , Terence Sim , Arulmurugan Ambikapathi , Savitha Ramasamy

Predictive coding networks are neuroscience-inspired models with roots in both Bayesian statistics and neuroscience. Training such models, however, is quite inefficient and unstable. In this work, we show how by simply changing the temporal…

Neural and Evolutionary Computing · Computer Science 2024-02-08 Tommaso Salvatori , Yuhang Song , Yordan Yordanov , Beren Millidge , Zhenghua Xu , Lei Sha , Cornelius Emde , Rafal Bogacz , Thomas Lukasiewicz

Predictive coding (PC) is an influential computational model of visual learning and inference in the brain. Classical PC was proposed as a top-down generative model, where the brain actively predicts upcoming visual inputs, and inference…

Machine Learning · Computer Science 2025-12-18 Gaspard Oliviers , Mufeng Tang , Rafal Bogacz

This paper introduces Relative Predictive Coding (RPC), a new contrastive representation learning objective that maintains a good balance among training stability, minibatch size sensitivity, and downstream task performance. The key to the…

Machine Learning · Computer Science 2021-04-14 Yao-Hung Hubert Tsai , Martin Q. Ma , Muqiao Yang , Han Zhao , Louis-Philippe Morency , Ruslan Salakhutdinov

Learning long-term dependencies in extended temporal sequences requires credit assignment to events far back in the past. The most common method for training recurrent neural networks, back-propagation through time (BPTT), requires credit…

Machine Learning · Computer Science 2018-09-12 Nan Rosemary Ke , Anirudh Goyal , Olexa Bilaniuk , Jonathan Binas , Michael C. Mozer , Chris Pal , Yoshua Bengio

A major drawback of backpropagation through time (BPTT) is the difficulty of learning long-term dependencies, coming from having to propagate credit information backwards through every single step of the forward computation. This makes BPTT…

Artificial Intelligence · Computer Science 2017-11-08 Nan Rosemary Ke , Anirudh Goyal , Olexa Bilaniuk , Jonathan Binas , Laurent Charlin , Chris Pal , Yoshua Bengio

Predicting and reasoning about the future lie at the heart of many time-series questions. For example, goal-conditioned reinforcement learning can be viewed as learning representations to predict which states are likely to be visited in the…

Machine Learning · Computer Science 2025-10-10 Chongyi Zheng , Ruslan Salakhutdinov , Benjamin Eysenbach

Recent years have witnessed a growing call for renewed emphasis on neuroscience-inspired approaches in artificial intelligence research, under the banner of NeuroAI. A prime example of this is predictive coding networks (PCNs), based on the…

Machine Learning · Computer Science 2026-03-09 Björn van Zwol , Ro Jefferson , Egon L. van den Broek

Despite recent advances in training recurrent neural networks (RNNs), capturing long-term dependencies in sequences remains a fundamental challenge. Most approaches use backpropagation through time (BPTT), which is difficult to scale to…

Machine Learning · Computer Science 2018-06-14 Trieu H. Trinh , Andrew M. Dai , Minh-Thang Luong , Quoc V. Le

Continual learning remains a fundamental challenge in artificial intelligence, with catastrophic forgetting posing a significant barrier to deploying neural networks in dynamic environments. Inspired by biological memory consolidation…

Machine Learning · Computer Science 2025-12-19 Goutham Nalagatla , Shreyas Grandhe