English
Related papers

Related papers: Mixing Backward- with Forward-Chaining for Metacog…

200 papers

Large language models (LLMs) are often fine-tuned for use on downstream tasks, though this can degrade capabilities learned during previous training. This phenomenon, often referred to as catastrophic forgetting, has important potential…

Computation and Language · Computer Science 2024-12-30 Megan Ung , Alicia Sun , Samuel J. Bell , Bhaktipriya Radharapu , Levent Sagun , Adina Williams

The application of deep learning to the area of communications systems has been a growing field of interest in recent years. Forward-forward (FF) learning is an efficient alternative to the backpropagation (BP) algorithm, which is the…

Information Theory · Computer Science 2026-02-17 Daniel Seifert , Onur Günlü , Rafael F. Schaefer

Temporal difference (TD) methods constitute a class of methods for learning predictions in multi-step prediction problems, parameterized by a recency factor lambda. Currently the most important application of these methods is to temporal…

Artificial Intelligence · Computer Science 2008-02-03 P. Cichosz

Deep neural networks trained with backpropagation have achieved outstanding performance in vision tasks but remain biologically implausible, computationally demanding, and difficult to interpret. The Forward-Forward (FF) algorithm offers a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jie-En Yao , Hong-En Chen , C. -C. Jay Kuo

Behavior cloning (BC) is a popular supervised imitation learning method in the societies of robotics, autonomous driving, etc., wherein complex skills can be learned by direct imitation from expert demonstrations. Despite its rapid…

Robotics · Computer Science 2024-08-21 Wensheng Liang , Jun Xie , Zhicheng Wang , Jianwei Tan , Xiaoguang Ma

Foundational Vision-Language Models (VLMs) excel across diverse tasks, but adapting them to new domains without forgetting prior knowledge remains a critical challenge. Continual Learning (CL) addresses this challenge by enabling models to…

Machine Learning · Computer Science 2026-02-03 Vaibhav Singh , Rahaf Aljundi , Eugene Belilovsky

Contrastive representation learning has emerged as a promising technique for continual learning as it can learn representations that are robust to catastrophic forgetting and generalize well to unseen future tasks. Previous work in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Rouzbeh Meshkinnejad , Jie Mei , Daniel Lizotte , Yalda Mohsenzadeh

Even in the era of large models, one of the well-known issues in continual learning (CL) is catastrophic forgetting, which is significantly challenging when the continual data stream exhibits a long-tailed distribution, termed as…

Machine Learning · Computer Science 2024-08-28 Lei Liu , Li Liu , Yawen Cui

With the advent of interconnected and sensor-equipped edge devices, Federated Learning (FL) has gained significant attention, enabling decentralized learning while maintaining data privacy. However, FL faces two challenges in real-world…

Machine Learning · Computer Science 2023-12-13 Manuel Röder , Leon Heller , Maximilian Münch , Frank-Michael Schleif

Current reinforcement learning algorithms train an agent using forward-generated trajectories, which provide little guidance so that the agent can explore as much as possible. While realizing the value of reinforcement learning results from…

Artificial Intelligence · Computer Science 2023-09-06 KyungMin Ko

When learning tasks over time, artificial neural networks suffer from a problem known as Catastrophic Forgetting (CF). This happens when the weights of a network are overwritten during the training of a new task causing forgetting of old…

Machine Learning · Computer Science 2021-12-02 Julio Hurtado , Alain Raymond-Saez , Alvaro Soto

Learning long-term dependencies in extended temporal sequences requires credit assignment to events far back in the past. The most common method for training recurrent neural networks, back-propagation through time (BPTT), requires credit…

Machine Learning · Computer Science 2018-09-12 Nan Rosemary Ke , Anirudh Goyal , Olexa Bilaniuk , Jonathan Binas , Michael C. Mozer , Chris Pal , Yoshua Bengio

Children acquire language despite being exposed to several orders of magnitude less data than large language models require. Meta-learning has been proposed as a way to integrate human-like learning biases into neural-network architectures,…

Computation and Language · Computer Science 2025-06-04 Michael Goodale , Salvador Mascarenhas , Yair Lakretz

Electroencephalography (EEG) signals are frequently used for various Brain-Computer Interface (BCI) tasks. While Deep Learning (DL) techniques have shown promising results, they are hindered by the substantial data requirements. By…

Signal Processing · Electrical Eng. & Systems 2024-05-24 Bruna Junqueira , Bruno Aristimunha , Sylvain Chevallier , Raphael Y. de Camargo

Continual learning is the problem of learning new tasks or knowledge while protecting old knowledge and ideally generalizing from old experience to learn new tasks faster. Neural networks trained by stochastic gradient descent often degrade…

Machine Learning · Computer Science 2019-11-27 David Rolnick , Arun Ahuja , Jonathan Schwarz , Timothy P. Lillicrap , Greg Wayne

Brain encoding and decoding aims to understand the relationship between external stimuli and brain activities, and is a fundamental problem in neuroscience. In this article, we study latent embedding alignment for brain encoding and…

Methodology · Statistics 2026-03-24 Shuoxun Xu , Zhanhao Yan , Lexin Li

Data privacy and silos are nontrivial and greatly challenging in many real-world applications. Federated learning is a decentralized approach to training models across multiple local clients without the exchange of raw data from client…

Machine Learning · Computer Science 2024-03-01 Xin Yang , Hao Yu , Xin Gao , Hao Wang , Junbo Zhang , Tianrui Li

Reinforcement learning (RL) agents performing complex tasks must be able to remember observations and actions across sizable time intervals. This is especially true during the initial learning stages, when exploratory behaviour can increase…

Machine Learning · Computer Science 2018-05-15 Thomas Stepleton , Razvan Pascanu , Will Dabney , Siddhant M. Jayakumar , Hubert Soyer , Remi Munos

In this paper, we propose a continual learning (CL) technique that is beneficial to sequential task learners by improving their retained accuracy and reducing catastrophic forgetting. The principal target of our approach is the automatic…

Machine Learning · Computer Science 2021-01-19 Ammar Shaker , Shujian Yu , Francesco Alesiani

To cope with real-world dynamics, an intelligent system needs to incrementally acquire, update, and exploit knowledge throughout its lifetime. This ability, known as Continual learning, provides a foundation for AI systems to develop…

Machine Learning · Computer Science 2025-12-19 Hesham G. Moussa , Aroosa Hameed , Arashmid Akhavain