English
Related papers

Related papers: A Complementary Learning Systems Approach to Tempo…

200 papers

Continual Learning (CL) considers the problem of training an agent sequentially on a set of tasks while seeking to retain performance on all previous tasks. A key challenge in CL is catastrophic forgetting, which arises when performance on…

Machine Learning · Computer Science 2022-03-16 Samuel Kessler , Jack Parker-Holder , Philip Ball , Stefan Zohren , Stephen J. Roberts

Curriculum Learning (CL) is a meta-learning paradigm that trains a model by feeding the data instances incrementally according to a schedule, which is based on difficulty progression. Defining meaningful difficulty assessment measures is…

Machine Learning · Computer Science 2026-03-26 Gaspard Abel , Eloi Campagne , Mohamed Benloughmari , Argyris Kalogeratos

Deep reinforcement learning (DRL) frameworks are increasingly used to solve high-dimensional continuous control tasks in robotics. However, due to the lack of sample efficiency, applying DRL for online learning is still practically…

Robotics · Computer Science 2024-04-30 Yu Tang Liu , Aamir Ahmad

Despite the extensive investment and impressive recent progress at reasoning by similarity, deep learning continues to struggle with more complex forms of reasoning such as non-monotonic and commonsense reasoning. Non-monotonicity is a…

Artificial Intelligence · Computer Science 2023-05-04 Sofoklis Kyriakopoulos , Artur S. d'Avila Garcez

This work proposes a novel neural network architecture, called the Dynamically Controlled Recurrent Neural Network (DCRNN), specifically designed to model dynamical systems that are governed by ordinary differential equations (ODEs). The…

Neural and Evolutionary Computing · Computer Science 2019-11-04 Yiwei Fu , Samer Saab , Asok Ray , Michael Hauser

Nowadays, modern Earth Observation systems continuously generate huge amounts of data. A notable example is represented by the Sentinel-2 mission, which provides images at high spatial resolution (up to 10m) with high temporal revisit…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Roberto Interdonato , Dino Ienco , Raffaele Gaetano , Kenji Ose

We introduce $\textbf{Hierarchical Taylor Series-based Continual Learning (HTCL)}$, a framework that couples fast local adaptation with conservative, second-order global consolidation to address the high variance introduced by random task…

Machine Learning · Computer Science 2026-02-04 Protik Nag , Krishnan Raghavan , Vignesh Narayanan

Deep convolutional neural network (DCNN) based supervised learning is a widely practiced approach for large-scale image classification. However, retraining these large networks to accommodate new, previously unseen data demands high…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Syed Shakib Sarwar , Aayush Ankit , Kaushik Roy

Wireless networked control system (WNCS) connecting sensors, controllers, and actuators via wireless communications is a key enabling technology for highly scalable and low-cost deployment of control systems in the Industry 4.0 era. Despite…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Zihuai Zhao , Wanchun Liu , Daniel E. Quevedo , Yonghui Li , Branka Vucetic

Continual learning (CL) refers to the ability of an intelligent system to sequentially acquire and retain knowledge from a stream of data with as little computational overhead as possible. To this end; regularization, replay, architecture,…

In recent years, Deep Learning has been successfully applied to multimodal learning problems, with the aim of learning useful joint representations in data fusion applications. When the available modalities consist of time series data such…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Xitong Yang , Palghat Ramesh , Radha Chitta , Sriganesh Madhvanath , Edgar A. Bernal , Jiebo Luo

Topological Deep Learning (TDL) has emerged as a paradigm to process and learn from signals defined on higher-order combinatorial topological spaces, such as simplicial or cell complexes. Although many complex systems have an asymmetric…

Machine Learning · Computer Science 2025-01-17 Manuel Lecha , Andrea Cavallo , Francesca Dominici , Elvin Isufi , Claudio Battiloro

Deep reinforcement learning (DRL) is increasingly applied in large-scale productions like Netflix and Facebook. As with most data-driven systems, DRL systems can exhibit undesirable behaviors due to environmental drifts, which often occur…

Machine Learning · Computer Science 2023-08-25 Ahmed Haj Yahmed , Rached Bouchoucha , Houssem Ben Braiek , Foutse Khomh

Neuromorphic Continual Learning (NCL) paradigm leverages Spiking Neural Networks (SNNs) to enable continual learning (CL) capabilities for AI systems to adapt to dynamically changing environments. Currently, the state-of-the-art employ a…

Neural and Evolutionary Computing · Computer Science 2025-10-30 Mishal Fatima Minhas , Rachmad Vidya Wicaksana Putra , Falah Awwad , Osman Hasan , Muhammad Shafique

Deep Reinforcement Learning (DRL) has become a powerful strategy to solve complex decision making problems based on Deep Neural Networks (DNNs). However, it is highly data demanding, so unfeasible in physical systems for most applications.…

Machine Learning · Computer Science 2018-10-02 Rodrigo Pérez-Dattari , Carlos Celemin , Javier Ruiz-del-Solar , Jens Kober

Researchers often treat data-driven and theory-driven models as two disparate or even conflicting methods in travel behavior analysis. However, the two methods are highly complementary because data-driven methods are more predictive but…

Machine Learning · Computer Science 2020-10-23 Shenhao Wang , Baichuan Mo , Jinhua Zhao

Causal discovery is a structured prediction task that aims to predict causal relations among variables based on their data samples. Supervised Causal Learning (SCL) is an emerging paradigm in this field. Existing Deep Neural Network…

Machine Learning · Computer Science 2025-02-18 Jiaru Zhang , Rui Ding , Qiang Fu , Bojun Huang , Zizhen Deng , Yang Hua , Haibing Guan , Shi Han , Dongmei Zhang

Deep neural networks (DNNs) struggle to learn in dynamic environments since they rely on fixed datasets or stationary environments. Continual learning (CL) aims to address this limitation and enable DNNs to accumulate knowledge…

Machine Learning · Computer Science 2023-05-31 Mustafa Burak Gurbuz , Jean Michael Moorman , Constantine Dovrolis

Deep learning for medical imaging suffers from temporal and privacy-related restrictions on data availability. To still obtain viable models, continual learning aims to train in sequential order, as and when data is available. The main…

Image and Video Processing · Electrical Eng. & Systems 2021-07-27 Marius Memmel , Camila Gonzalez , Anirban Mukhopadhyay

Humans and most animals inherently possess a distinctive capacity to continually acquire novel experiences and accumulate worldly knowledge over time. This ability, termed continual learning, is also critical for deep neural networks (DNNs)…

Machine Learning · Computer Science 2025-04-22 Geng Liu , Fei Zhu , Rong Feng , Zhiqiang Yi , Shiqi Wang , Gaofeng Meng , Zhaoxiang Zhang