English
Related papers

Related papers: InTAct: Interval-based Task Activation Consolidati…

200 papers

The ability to learn more and more concepts over time from incrementally arriving data is essential for the development of a life-long learning system. However, deep neural networks often suffer from forgetting previously learned concepts…

Machine Learning · Computer Science 2019-07-08 Huaiyu Li , Weiming Dong , Bao-Gang Hu

Tabular data is a fundamental form of data structure. The evolution of table analysis tools reflects humanity's continuous progress in data acquisition, management, and processing. The dynamic changes in table columns arise from…

Artificial Intelligence · Computer Science 2026-01-28 Xinda Chen , Zhen Xing , Hanyu Zhang , Weimin Tan , Bo Yan

Although deep neural networks perform extremely well in controlled environments, they fail in real-world scenarios where data isn't available all at once, and the model must adapt to a new data distribution that may or may not follow the…

Machine Learning · Computer Science 2026-03-17 Vaishnavi Nagabhushana , Kartikay Agrawal , Ayon Borthakur

Deep neural networks are susceptible to catastrophic forgetting when trained on sequential tasks. Various continual learning (CL) methods often rely on exemplar buffers or/and network expansion for balancing model stability and plasticity,…

Machine Learning · Computer Science 2024-01-18 Depeng Li , Tianqi Wang , Junwei Chen , Qining Ren , Kenji Kawaguchi , Zhigang Zeng

In continual time series analysis using neural networks, catastrophic forgetting (CF) of previously learned models when training on new data domains has always been a significant challenge. This problem is especially challenging in vehicle…

Machine Learning · Computer Science 2025-04-08 Arvin Hosseinzadeh , Ladan Khoshnevisan , Mohammad Pirani , Shojaeddin Chenouri , Amir Khajepour

Dynamic graph representation learning has become essential for analyzing evolving networks in domains such as social network analysis, recommendation systems, and traffic analysis. However, existing continuous-time methods face three key…

Machine Learning · Computer Science 2025-10-14 Soheila Farokhi , Xiaojun Qi , Hamid Karimi

Continual learning aims to create artificial neural networks capable of accumulating knowledge and skills through incremental training on a sequence of tasks. The main challenge of continual learning is catastrophic interference, wherein…

Artificial Intelligence · Computer Science 2023-11-01 Anton Lee , Yaqian Zhang , Heitor Murilo Gomes , Albert Bifet , Bernhard Pfahringer

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle…

Machine Learning · Computer Science 2023-06-07 Nader Asadi , MohammadReza Davari , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

In the scenario of class-incremental learning (CIL), deep neural networks have to adapt their model parameters to non-stationary data distributions, e.g., the emergence of new classes over time. However, CIL models are challenged by the…

Machine Learning · Computer Science 2023-06-22 Depeng Li , Zhigang Zeng

Continual Learning is considered a key step toward next-generation Artificial Intelligence. Among various methods, replay-based approaches that maintain and replay a small episodic memory of previous samples are one of the most successful…

Machine Learning · Computer Science 2022-12-27 Guangji Bai , Chen Ling , Yuyang Gao , Liang Zhao

Catastrophic forgetting is a problem of neural networks that loses the information of the first task after training the second task. Here, we propose a method, i.e. incremental moment matching (IMM), to resolve this problem. IMM…

Machine Learning · Computer Science 2018-01-31 Sang-Woo Lee , Jin-Hwa Kim , Jaehyun Jun , Jung-Woo Ha , Byoung-Tak Zhang

Time-continuous emotion prediction has become an increasingly compelling task in machine learning. Considerable efforts have been made to advance the performance of these systems. Nonetheless, the main focus has been the development of more…

Machine Learning · Computer Science 2018-10-15 Zixing Zhang , Jing Han , Eduardo Coutinho , Björn Schuller

Vision-language models (VLMs) have shown remarkable ability in aligning visual and textual representations, enabling a wide range of multimodal applications. However, their large-scale training data inevitably raises concerns about privacy,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Shen Lin , Junhao Dong , Rongjie Chen , Xiaoyu Zhang , Li Xu , Xiaofeng Chen

This paper proposes a simple but highly efficient expansion-based model for continual learning. The recent feature transformation, masking and factorization-based methods are efficient, but they grow the model only over the global or shared…

Machine Learning · Computer Science 2023-12-05 Soumya Roy , Vinay K Verma , Deepak Gupta

Accurate prediction of the need for invasive mechanical ventilation (IMV) in intensive care units (ICUs) patients is crucial for timely interventions and resource allocation. However, variability in patient populations, clinical practices,…

Machine Learning · Computer Science 2026-01-28 Xiaolei Lu , Shamim Nemati

Imitation learning enables robots to acquire complex manipulation skills from human demonstrations, but current methods rely solely on low-level sensorimotor data while ignoring the rich semantic knowledge humans naturally possess about…

Machine Learning · Computer Science 2026-01-27 Jakob Karalus , Friedhelm Schwenker

Continual learning aims to acquire tasks sequentially without catastrophic forgetting, yet standard strategies face a core tradeoff: regularization-based methods (e.g., EWC) can overconstrain updates when task optima are weakly overlapping,…

Machine Learning · Computer Science 2026-05-28 Zekun Wang , Anant Gupta , Christopher J. MacLellan

Continual learning (CL) has traditionally focused on minimizing exemplar memory, a constraint often misaligned with modern systems where GPU time, not storage, is the primary bottleneck. This paper challenges this paradigm by investigating…

Machine Learning · Computer Science 2026-02-19 Dongkyu Cho , Taesup Moon , Rumi Chunara , Kyunghyun Cho , Sungmin Cha

When a computational system continuously learns from an ever-changing environment, it rapidly forgets its past experiences. This phenomenon is called catastrophic forgetting. While a line of studies has been proposed with respect to…

Machine Learning · Statistics 2021-09-15 Haruka Asanuma , Shiro Takagi , Yoshihiro Nagano , Yuki Yoshida , Yasuhiko Igarashi , Masato Okada

Recent advances in robot learning have enabled robots to become increasingly better at mastering a predefined set of tasks. On the other hand, as humans, we have the ability to learn a growing set of tasks over our lifetime. Continual robot…

Robotics · Computer Science 2021-12-21 Muhammad Burhan Hafez , Stefan Wermter