English
Related papers

Related papers: Self-Paced Imbalance Rectification for Class Incre…

200 papers

To imitate the ability of keeping learning of human, continual learning which can learn from a never-ending data stream has attracted more interests recently. In all settings, the online class incremental learning (OCIL), where incoming…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Guoqiang Liang , Zhaojie Chen , Zhaoqiang Chen , Shiyu Ji , Yanning Zhang

This study examines the impact of class-imbalanced data on deep learning models and proposes a technique for data balancing by generating synthetic data for the minority class. Unlike random-based oversampling, our method prioritizes…

Machine Learning · Computer Science 2024-02-26 Hung Nguyen , Morris Chang

The task of Long-tailed Class Incremental Learning (LT-CIL) addresses the sequential learning of new classes from datasets with imbalanced class distributions. This scenario intensifies the fundamental problem of catastrophic forgetting,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Taigo Sakai , Kazuhiro Hotta

We introduce a novel continual learning problem: how to sequentially update the weights of a personalized 2D and 3D generative face model as new batches of photos in different appearances, styles, poses, and lighting are captured regularly.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Annie N. Wang , Luchao Qi , Roni Sengupta

In this work, we introduce Adapt & Align, a method for continual learning of neural networks by aligning latent representations in generative models. Neural Networks suffer from abrupt loss in performance when retrained with additional…

Machine Learning · Computer Science 2023-12-22 Kamil Deja , Bartosz Cywiński , Jan Rybarczyk , Tomasz Trzciński

Class-imbalance refers to classification problems in which many more instances are available for certain classes than for others. Such imbalanced datasets require special attention because traditional classifiers generally favor the…

Machine Learning · Computer Science 2018-11-30 Rafael M. O. Cruz , Mariana A. Souza , Robert Sabourin , George D. C. Cavalcanti

Continual learning aims to acquire new knowledge while retaining past information. Class-incremental learning (CIL) presents a challenging scenario where classes are introduced sequentially. For video data, the task becomes more complex…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Tieyuan Chen , Huabin Liu , Chern Hong Lim , John See , Xing Gao , Junhui Hou , Weiyao Lin

Continual learning (CL) is a fundamental topic in machine learning, where the goal is to train a model with continuously incoming data and tasks. Due to the memory limit, we cannot store all the historical data, and therefore confront the…

Machine Learning · Computer Science 2024-07-31 Weichen Lin , Jiaxiang Chen , Ruomin Huang , Hu Ding

Self-supervision has emerged as a propitious method for visual representation learning after the recent paradigm shift from handcrafted pretext tasks to instance-similarity based approaches. Most state-of-the-art methods enforce similarity…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Sravanti Addepalli , Kaushal Bhogale , Priyam Dey , R. Venkatesh Babu

Imitation learning, which enables robots to learn behaviors from demonstrations by human, has emerged as a promising solution for generating robot motions in such environments. The imitation learning-based robot motion generation method,…

Robotics · Computer Science 2025-03-17 Hyeonjun Park , Daegyu Lim , Seungyeon Kim , Sumin Park

Class-Incremental Learning (CIL) aims to build classification models from data streams. At each step of the CIL process, new classes must be integrated into the model. Due to catastrophic forgetting, CIL is particularly challenging when…

Machine Learning · Computer Science 2023-09-28 Grégoire Petit , Michael Soumm , Eva Feillet , Adrian Popescu , Bertrand Delezoide , David Picard , Céline Hudelot

Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. We focus on continual text classification under the class-incremental setting. Recent CL studies have identified…

Computation and Language · Computer Science 2023-10-11 Yifan Song , Peiyi Wang , Weimin Xiong , Dawei Zhu , Tianyu Liu , Zhifang Sui , Sujian Li

Few-shot class-incremental learning (FSCIL) aims at recognizing novel classes continually with limited novel class samples. A mainstream baseline for FSCIL is first to train the whole model in the base session, then freeze the feature…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Li-Jun Zhao , Zhen-Duo Chen , Zi-Chao Zhang , Xin Luo , Xin-Shun Xu

There are many real-world classification problems wherein the issue of data imbalance (the case when a data set contains substantially more samples for one/many classes than the rest) is unavoidable. While under-sampling the problematic…

Computer Vision and Pattern Recognition · Computer Science 2018-01-09 John McKay , Isaac Gerg , Vishal Monga

Although deep learning approaches have stood out in recent years due to their state-of-the-art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall performance when training with new classes added…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Francisco M. Castro , Manuel J. Marín-Jiménez , Nicolás Guil , Cordelia Schmid , Karteek Alahari

Time-dependent data-generating distributions have proven to be difficult for gradient-based training of neural networks, as the greedy updates result in catastrophic forgetting of previously learned knowledge. Despite the progress in the…

Machine Learning · Computer Science 2023-04-03 Matthias De Lange , Gido van de Ven , Tinne Tuytelaars

We propose a novel approach for class incremental online learning in a limited data setting. This problem setting is challenging because of the following constraints: (1) Classes are given incrementally, which necessitates a class…

Machine Learning · Computer Science 2021-06-15 Mohammed Asad Karim , Vinay Kumar Verma , Pravendra Singh , Vinay Namboodiri , Piyush Rai

Deep models, e.g., CNNs and Vision Transformers, have achieved impressive achievements in many vision tasks in the closed world. However, novel classes emerge from time to time in our ever-changing world, requiring a learning system to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Da-Wei Zhou , Qi-Wei Wang , Zhi-Hong Qi , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Class incremental learning refers to a special multi-class classification task, in which the number of classes is not fixed but is increasing with the continual arrival of new data. Existing researches mainly focused on solving catastrophic…

Machine Learning · Computer Science 2019-05-21 Xu Zhang , Yang Yao , Baile Xu , Lekun Mao , Furao Shen , Jian Zhao , Qingwei Lin

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender