English
Related papers

Related papers: Effective Decision Boundary Learning for Class Inc…

200 papers

Despite extensive research spanning several decades, class imbalance is still considered a profound difficulty for both machine learning and deep learning models. While data oversampling is the foremost technique to address this issue,…

Machine Learning · Computer Science 2025-02-12 Sukumar Kishanthan , Asela Hevapathige

Class-incremental learning aims to learn new classes in an incremental fashion without forgetting the previously learned ones. Several research works have shown how additional data can be used by incremental models to help mitigate…

Machine Learning · Computer Science 2023-10-11 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

Introduction Data imbalance is one of the crucial issues in big data analysis with fewer labels. For example, in real-world healthcare data, spam detection labels, and financial fraud detection datasets. Many data balance methods were…

Machine Learning · Computer Science 2023-01-27 Chenyu Li , Xia Jiang

When dealing with real-world optimization problems, decision-makers usually face high levels of uncertainty associated with partial information, unknown parameters, or complex relationships between these and the problem decision variables.…

Optimization and Control · Mathematics 2023-05-01 Antonio Alcántara , Carlos Ruiz

Classifying pill categories from real-world images is crucial for various smart healthcare applications. Although existing approaches in image classification might achieve a good performance on fixed pill categories, they fail to handle…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Trong-Tung Nguyen , Hieu H. Pham , Phi Le Nguyen , Thanh Hung Nguyen , Minh Do

Imbalanced Data (ID) is a problem that deters Machine Learning (ML) models for achieving satisfactory results. ID is the occurrence of a situation where the quantity of the samples belonging to one class outnumbers that of the other by a…

Deep neural networks perform remarkably well in close-world scenarios. However, novel classes emerged continually in real applications, making it necessary to learn incrementally. Class-incremental learning (CIL) aims to gradually recognize…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

This paper proposes two novel knowledge transfer techniques for class-incremental learning (CIL). First, we propose data-free generative replay (DF-GR) to mitigate catastrophic forgetting in CIL by using synthetic samples from a generative…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Yoojin Choi , Mostafa El-Khamy , Jungwon Lee

The goal of imitation learning (IL) is to learn a good policy from high-quality demonstrations. However, the quality of demonstrations in reality can be diverse, since it is easier and cheaper to collect demonstrations from a mix of experts…

Machine Learning · Computer Science 2019-09-17 Voot Tangkaratt , Bo Han , Mohammad Emtiyaz Khan , Masashi Sugiyama

Multiple instance learning (MIL) was a weakly supervised learning approach that sought to assign binary class labels to collections of instances known as bags. However, due to their weak supervision nature, the MIL methods were susceptible…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Wenhui Zhu , Peijie Qiu , Xiwen Chen , Oana M. Dumitrascu , Yalin Wang

Iterative learning control (ILC) improves the performance of a repetitive system by learning from previous trials. ILC can be combined with Model Predictive Control (MPC) to mitigate non-repetitive disturbances, thus improving overall…

Systems and Control · Electrical Eng. & Systems 2025-03-26 Riccardo Zuliani , Efe C. Balta , Alisa Rupenyan , John Lygeros

Class-incremental learning (CIL) aims to adapt to continuously emerging new classes while preserving knowledge of previously learned ones. Few-shot class-incremental learning (FSCIL) presents a greater challenge that requires the model to…

Artificial Intelligence · Computer Science 2025-08-19 Shiwon Kim , Dongjun Hwang , Sungwon Woo , Rita Singh

Knowledge Distillation (KD) compresses large language models (LLMs) by transferring the teacher model's capabilities to a smaller student model, reducing inference cost and memory usage while maintaining performance. However, existing KD…

Computation and Language · Computer Science 2025-06-11 Lingyuan Liu , Mengxiang Zhang

In class-incremental learning, an agent with limited resources needs to learn a sequence of classification tasks, forming an ever growing classification problem, with the constraint of not being able to access data from previous tasks. The…

Machine Learning · Computer Science 2024-05-29 Albin Soutif--Cormerais , Marc Masana , Joost van de Weijer , Bartłomiej Twardowski

Knowledge distillation (KD) is a model compression technique that transfers knowledge from a large teacher model to a smaller student model to enhance its performance. Existing methods often assume that the student model is inherently…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Jianhua Zhang , Yi Gao , Ruyu Liu , Xu Cheng , Houxiang Zhang , Shengyong Chen

Class-incremental learning (CIL) aims to acquire new classes over time while retaining prior knowledge, yet most setups and methods assume balanced task streams. In practice, the number of classes per task often varies significantly. We…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Xiaoyan Zhang , Jiangpeng He

Continual learning (CL) remains a significant challenge for deep neural networks, as it is prone to forgetting previously acquired knowledge. Several approaches have been proposed in the literature, such as experience rehearsal,…

Machine Learning · Computer Science 2024-05-24 Prashant Bhat , Bharath Renjith , Elahe Arani , Bahram Zonooz

Whole-slide image classification represents a key challenge in computational pathology and medicine. Attention-based multiple instance learning (MIL) has emerged as an effective approach for this problem. However, the effect of attention…

Quantitative Methods · Quantitative Biology 2025-03-14 Rajiv Krishnakumar , Julien Baglio , Frederik F. Flöther , Christian Ruiz , Stefan Habringer , Nicole H. Romano

Class-incremental learning (CIL) in medical image-guided diagnosis requires retaining prior diagnostic knowledge while adapting to newly emerging disease categories, which is critical for scalable clinical deployment. This problem is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xinyao Wu , Zhe Xu , Cheng Chen , Jiawei Ma , Yefeng Zheng , Raymond Kai-yu Tong

Significant advancements have been made in single label incremental learning (SLCIL),yet the more practical and challenging multi label class incremental learning (MLCIL) remains understudied. Recently,visual language models such as CLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Haifeng Zhao , Yuguang Jin , Leilei Ma