English
Related papers

Related papers: Feature Expansion and enhanced Compression for Cla…

200 papers

Continual learning consists in incrementally training a model on a sequence of datasets and testing on the union of all datasets. In this paper, we examine continual learning for the problem of sound classification, in which we wish to…

Machine Learning · Computer Science 2019-06-04 Zhepei Wang , Cem Subakan , Efthymios Tzinis , Paris Smaragdis , Laurent Charlin

Deep neural networks (DNNs) have been applied in class incremental learning, which aims to solve common real-world problems of learning new classes continually. One drawback of standard DNNs is that they are prone to catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Bowen Zhao , Xi Xiao , Guojun Gan , Bin Zhang , Shutao Xia

Incremental learning remains a critical challenge in machine learning, as models often struggle with catastrophic forgetting -the tendency to lose previously acquired knowledge when learning new information. These challenges are even more…

Deep Neural Networks (DNNs) suffer from a rapid decrease in performance when trained on a sequence of tasks where only data of the most recent task is available. This phenomenon, known as catastrophic forgetting, prevents DNNs from…

Machine Learning · Computer Science 2021-04-22 Felix Wiewel , Bin Yang

Deep learning has emerged as a powerful method for extracting valuable information from large volumes of data. However, when new training data arrives continuously (i.e., is not fully available from the beginning), incremental training…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-06 Thomas Bouvier , Bogdan Nicolae , Hugo Chaugier , Alexandru Costan , Ian Foster , Gabriel Antoniu

Algorithm selection is commonly used to predict the best solver from a portfolio per per-instance. In many real scenarios, instances arrive in a stream: new instances become available over time, while the number of class labels can also…

Machine Learning · Computer Science 2025-06-03 Mate Botond Nemeth , Emma Hart , Kevin Sim , Quentin Renau

Few-shot class-incremental learning (FSCIL) aims to continually fit new classes with limited training data, while maintaining the performance of previously learned classes. The main challenges are overfitting the rare new training samples…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Mingli Zhu , Zihao Zhu , Sihong Chen , Chen Chen , Baoyuan Wu

Over the past years, semantic segmentation, as many other tasks in computer vision, benefited from the progress in deep neural networks, resulting in significantly improved performance. However, deep architectures trained with…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Guanglei Yang , Enrico Fini , Dan Xu , Paolo Rota , Mingli Ding , Hao Tang , Xavier Alameda-Pineda , Elisa Ricci

In this paper, we address the incremental classifier learning problem, which suffers from catastrophic forgetting. The main reason for catastrophic forgetting is that the past data are not available during learning. Typical approaches keep…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Yue Wu , Yinpeng Chen , Lijuan Wang , Yuancheng Ye , Zicheng Liu , Yandong Guo , Zhengyou Zhang , Yun Fu

Few-shot class-incremental learning (FSCIL), which targets at continuously expanding model's representation capacity under few supervisions, is an important yet challenging problem. On the one hand, when fitting new tasks (novel classes),…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Boyu Yang , Mingbao Lin , Binghao Liu , Mengying Fu , Chang Liu , Rongrong Ji , Qixiang Ye

We propose an algorithm for incremental learning of classifiers. The proposed method enables an ensemble of classifiers to learn incrementally by accommodating new training data. We use an effective mechanism to overcome the…

Machine Learning · Computer Science 2019-02-11 Shivang Agarwal , C. Ravindranath Chowdary , Shripriya Maheshwari

In Continual Learning, a Neural Network is trained on a stream of data whose distribution shifts over time. Under these assumptions, it is especially challenging to improve on classes appearing later in the stream while remaining accurate…

Machine Learning · Computer Science 2020-10-13 Pietro Buzzega , Matteo Boschini , Angelo Porrello , Simone Calderara

In real-world applications, learning-enabled systems often undergo iterative model development to address challenging or emerging tasks, which involve collecting new data, training a new model and validating the model. This continual model…

Machine Learning · Computer Science 2025-04-22 Gang Li , Wendi Yu , Yao Yao , Wei Tong , Yingbin Liang , Qihang Lin , Tianbao Yang

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle…

Machine Learning · Computer Science 2023-06-07 Nader Asadi , MohammadReza Davari , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

Continual learning needs to overcome catastrophic forgetting of the past. Memory replay of representative old training samples has been shown as an effective solution, and achieves the state-of-the-art (SOTA) performance. However, existing…

Machine Learning · Computer Science 2022-03-10 Liyuan Wang , Xingxing Zhang , Kuo Yang , Longhui Yu , Chongxuan Li , Lanqing Hong , Shifeng Zhang , Zhenguo Li , Yi Zhong , Jun Zhu

Continual learning requires the model to maintain the learned knowledge while learning from a non-i.i.d data stream continually. Due to the single-pass training setting, online continual learning is very challenging, but it is closer to the…

Machine Learning · Computer Science 2022-05-20 Gehui Shen , Shibo Jie , Ziheng Li , Zhi-Hong Deng

Current deep learning classifiers, carry out supervised learning and store class discriminatory information in a set of shared network weights. These weights cannot be easily altered to incrementally learn additional classes, since the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Penny Johnston , Keiller Nogueira , Kevin Swingler

We study class-incremental learning, a training setup in which new classes of data are observed over time for the model to learn from. Despite the straightforward problem formulation, the naive application of classification models to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Ahmet Iscen , Thomas Bird , Mathilde Caron , Alireza Fathi , Cordelia Schmid

This paper explores the possibility of extending the capability of pre-trained neural image compressors (e.g., adapting to new data or target bitrates) without breaking backward compatibility, the ability to decode bitstreams encoded by the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-01 Zhihao Duan , Ming Lu , Justin Yang , Jiangpeng He , Zhan Ma , Fengqing Zhu

Few-shot class-incremental learning is crucial for developing scalable and adaptive intelligent systems, as it enables models to acquire new classes with minimal annotated data while safeguarding the previously accumulated knowledge.…

Machine Learning · Computer Science 2024-09-19 Cuiwei Liu , Siang Xu , Huaijun Qiu , Jing Zhang , Zhi Liu , Liang Zhao
‹ Prev 1 4 5 6 7 8 10 Next ›