English
Related papers

Related papers: Autoencoder-Based Hybrid Replay for Class-Incremen…

200 papers

Forgetting presents a significant challenge during incremental training, making it particularly demanding for contemporary AI systems to assimilate new knowledge in streaming data environments. To address this issue, most approaches in…

Machine Learning · Computer Science 2024-08-27 Monica Millunzi , Lorenzo Bonicelli , Angelo Porrello , Jacopo Credi , Petter N. Kolm , Simone Calderara

Class-incremental learning (CIL) aims to train a model to learn new classes from non-stationary data streams without forgetting old ones. In this paper, we propose a new kind of connectionist model by tailoring neural unit dynamics that…

Machine Learning · Computer Science 2024-06-05 Depeng Li , Tianqi Wang , Junwei Chen , Wei Dai , Zhigang Zeng

Exemplar-free class-incremental learning (EFCIL) aims to retain old knowledge acquired in the previous task while learning new classes, without storing the previous images due to storage constraints or privacy concerns. In EFCIL, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Hiroto Honda

Understanding the coordinated activity underlying brain computations requires large-scale, simultaneous recordings from distributed neuronal structures at a cellular-level resolution. One major hurdle to design high-bandwidth,…

Neural and Evolutionary Computing · Computer Science 2018-09-18 Tong Wu , Wenfeng Zhao , Edward Keefer , Zhi Yang

Entity Resolution (ER) is a critical task for data integration, yet state-of-the-art supervised deep learning models remain impractical for many real-world applications due to their need for massive, expensive-to-obtain labeled datasets.…

Databases · Computer Science 2026-01-29 Dimitrios Karapiperis , Leonidas Akritidis , Panayiotis Bozanis , Vassilios Verykios

Despite the outstanding performance in many individual tasks, deep neural networks suffer from catastrophic forgetting when learning from continuous data streams in real-world scenarios. Current Non-Exemplar Class-Incremental Learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Liang Bai , Hong Song , Yucong Lin , Tianyu Fu , Deqiang Xiao , Danni Ai , Jingfan Fan , Jian Yang

Replay-based methods in class-incremental learning (CIL) have attained remarkable success. Despite their effectiveness, the inherent memory restriction results in saving a limited number of exemplars with poor diversity. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ruxiao Duan , Jieneng Chen , Adam Kortylewski , Alan Yuille , Yaoyao Liu

Deep learning is a kind of feature learning method with strong nonliear feature transformation and becomes more and more important in many fields of artificial intelligence. Deep autoencoder is one representative method of the deep learning…

Machine Learning · Computer Science 2020-02-18 Yongming Li , Yan Lei , Pin Wang , Yuchuan Liu

Continual learning aims to acquire new knowledge while retaining past information. Class-incremental learning (CIL) presents a challenging scenario where classes are introduced sequentially. For video data, the task becomes more complex…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Tieyuan Chen , Huabin Liu , Chern Hong Lim , John See , Xing Gao , Junhui Hou , Weiyao Lin

Real-world applications require the classification model to adapt to new classes without forgetting old ones. Correspondingly, Class-Incremental Learning (CIL) aims to train a model with limited memory size to meet this requirement. Typical…

Machine Learning · Computer Science 2023-02-17 Da-Wei Zhou , Qi-Wei Wang , Han-Jia Ye , De-Chuan Zhan

Intrinsic reward shaping has emerged as a prevalent approach to solving hard-exploration and sparse-rewards environments in reinforcement learning (RL). While single intrinsic rewards, such as curiosity-driven or novelty-based methods, have…

Machine Learning · Computer Science 2025-01-23 Mingqi Yuan , Bo Li , Xin Jin , Wenjun Zeng

In reinforcement learning (RL), experience replay-based sampling techniques play a crucial role in promoting convergence by eliminating spurious correlations. However, widely used methods such as uniform experience replay (UER) and…

Machine Learning · Computer Science 2023-02-07 Ramnath Kumar , Dheeraj Nagaraj

Class Incremental Learning (CIL) poses a fundamental challenge: maintaining a balance between the plasticity required to learn new tasks and the stability needed to prevent catastrophic forgetting. While expansion-based methods effectively…

Machine Learning · Computer Science 2026-04-02 Adrian Garcia-Castañeda , Jon Irureta , Jon Imaz , Aizea Lojo

In recent years we have witnessed a renewed interest in machine learning methodologies, especially for deep representation learning, that could overcome basic i.i.d. assumptions and tackle non-stationary environments subject to various…

Machine Learning · Computer Science 2023-01-09 Vincenzo Lomonaco , Lorenzo Pellegrini , Gabriele Graffieti , Davide Maltoni

This paper presents CONTHER, a novel reinforcement learning algorithm designed to efficiently and rapidly train robotic agents for goal-oriented manipulation tasks and obstacle avoidance. The algorithm uses a modified replay buffer inspired…

Robotics · Computer Science 2025-03-21 Maria Makarova , Qian Liu , Dzmitry Tsetserukou

Deep learning systems are prone to catastrophic forgetting when learning from a sequence of tasks, as old data from previous tasks is unavailable when learning a new task. To address this, some methods propose replaying data from previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chenyang Wang , Junjun Jiang , Xingyu Hu , Xianming Liu , Xiangyang Ji

Binary classification with an imbalanced dataset is challenging. Models tend to consider all samples as belonging to the majority class. Although existing solutions such as sampling methods, cost-sensitive methods, and ensemble learning…

Machine Learning · Computer Science 2022-07-08 Hsin-Han Tsai , Ta-Wei Yang , Wai-Man Wong , Cheng-Fu Chou

This paper introduces a hybrid attention and autoencoder (AE) model for unsupervised online anomaly detection in time series. The autoencoder captures local structural patterns in short embeddings, while the attention model learns long-term…

Machine Learning · Computer Science 2024-01-09 Seyed Amirhossein Najafi , Mohammad Hassan Asemani , Peyman Setoodeh

Catastrophic forgetting remains a major challenge for continual learning (CL) in automatic speech recognition (ASR), where models must adapt to new domains without losing performance on previously learned conditions. Several CL methods have…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-14 Steven Vander Eeckt , Hugo Van hamme

We present Deep Compression Autoencoder (DC-AE), a new family of autoencoder models for accelerating high-resolution diffusion models. Existing autoencoder models have demonstrated impressive results at a moderate spatial compression ratio…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Junyu Chen , Han Cai , Junsong Chen , Enze Xie , Shang Yang , Haotian Tang , Muyang Li , Yao Lu , Song Han