English
Related papers

Related papers: From Isolation to Integration: Building an Adaptiv…

200 papers

In this study, we present an incremental machine learning framework called Adaptive Decision Forest (ADF), which produces a decision forest to classify new records. Based on our two novel theorems, we introduce a new splitting strategy…

Machine Learning · Computer Science 2021-01-29 Md Geaur Rahman , Md Zahidul Islam

Continual Learning enables models to learn and adapt to new tasks while retaining prior knowledge. Introducing new tasks, however, can naturally lead to feature entanglement across tasks, limiting the model's capability to distinguish…

Machine Learning · Computer Science 2025-01-14 Zhongyi Zhou , Yaxin Peng , Pin Yi , Minjie Zhu , Chaomin Shen

Model-free deep reinforcement learning (RL) has demonstrated its superiority on many complex sequential decision-making problems. However, heavy dependence on dense rewards and high sample-complexity impedes the wide adoption of these…

Machine Learning · Computer Science 2020-04-02 Zhuangdi Zhu , Kaixiang Lin , Bo Dai , Jiayu Zhou

Federated Edge Learning (FEEL) emerges as a pioneering distributed machine learning paradigm for the 6G Hyper-Connectivity, harnessing data from the Internet of Things (IoT) devices while upholding data privacy. However, current FEEL…

Machine Learning · Computer Science 2024-12-10 Gang Hu , Yinglei Teng , Nan Wang , Zhu Han

Continual learning (CL) aims to train models that can learn a sequence of tasks without forgetting previously acquired knowledge. A core challenge in CL is balancing stability -- preserving performance on old tasks -- and plasticity --…

Machine Learning · Computer Science 2025-05-14 Zhenrong Liu , Janne M. J. Huttunen , Mikko Honkala

With the advent of large-scale pre-trained models, interest in adapting and exploiting them for continual learning scenarios has grown. In this paper, we propose an approach to exploiting pre-trained vision-language models (e.g. CLIP) that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Xialei Liu , Xusheng Cao , Haori Lu , Jia-wen Xiao , Andrew D. Bagdanov , Ming-Ming Cheng

Aligning diffusion models with human preferences remains challenging, particularly when reward models are unavailable or impractical to obtain, and collecting large-scale preference datasets is prohibitively expensive. \textit{This raises a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Xiaoxuan He , Siming Fu , Wanli Li , Zhiyuan Li , Dacheng Yin , Kang Rong , Fengyun Rao , Bo Zhang

Class incremental semantic segmentation aims to preserve old knowledge while learning new tasks, however, it is impeded by catastrophic forgetting and background shift issues. Prior works indicate the pivotal importance of initializing new…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Zhengyuan Xie , Haiquan Lu , Jia-wen Xiao , Enguang Wang , Le Zhang , Xialei Liu

In robotic manipulation, acquiring samples is extremely expensive because it often requires interacting with the real world. Traditional image-level data augmentation has shown the potential to improve sample efficiency in various machine…

Robotics · Computer Science 2022-11-02 Mingxi Jia , Dian Wang , Guanang Su , David Klee , Xupeng Zhu , Robin Walters , Robert Platt

Skill Incremental Learning (SIL) is the process by which an embodied agent expands and refines its skill set over time by leveraging experience gained through interaction with its environment or by the integration of additional data. SIL…

Machine Learning · Computer Science 2026-01-15 Daehee Lee , Dongsu Lee , TaeYoon Kwack , Wonje Choi , Honguk Woo

Crop mapping based on satellite images time-series (SITS) holds substantial economic value in agricultural production settings, in which parcel segmentation is an essential step. Existing approaches have achieved notable advancements in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Juyuan Kang , Hao Zhu , Yan Zhu , Wei Zhang , Jianing Chen , Tianxiang Xiao , Yike Ma , Hao Jiang , Feng Dai

Continual learning aims to accumulate knowledge over a data stream while mitigating catastrophic forgetting. In Non-exemplar Class Incremental Learning (NECIL), forgetting arises during incremental optimization because old classes are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Haori Lu , Xusheng Cao , Linlan Huang , Enguang Wang , Fei Yang , Xialei Liu

This work explores class-incremental learning (CIL) for sound event detection (SED), advancing adaptability towards real-world scenarios. CIL's success in domains like computer vision inspired our SED-tailored method, addressing the unique…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Yang Xiao , Rohan Kumar Das

Few-Shot Class-Incremental Learning (FSCIL) faces a critical challenge: balancing the retention of prior knowledge with the acquisition of new classes. Existing methods either freeze the backbone to prevent catastrophic forgetting,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Xiaojie Li , Jianlong Wu , Yue Yu , Liqiang Nie , Min Zhang

Continual fine-tuning of large language models (LLMs) suffers from catastrophic forgetting. Rehearsal-based methods mitigate this problem by retaining a small set of old data. Nevertheless, they still suffer inevitable performance loss.…

Computation and Language · Computer Science 2025-04-10 Zhilin Wang , Yafu Li , Xiaoye Qu , Yu Cheng

In class-incremental semantic segmentation, we have no access to the labeled data of previous tasks. Therefore, when incrementally learning new classes, deep neural networks suffer from catastrophic forgetting of previously learned…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Lu Yu , Xialei Liu , Joost van de Weijer

Class-incremental fault diagnosis requires a model to adapt to new fault classes while retaining previous knowledge. However, limited research exists for imbalanced and long-tailed data. Extracting discriminative features from few-shot…

Machine Learning · Computer Science 2025-01-22 Hanrong Zhang , Yifei Yao , Zixuan Wang , Jiayuan Su , Mengxuan Li , Peng Peng , Hongwei Wang

The dynamic nature of open-world scenarios has attracted more attention to class incremental learning (CIL). However, existing CIL methods typically presume the availability of complete ground-truth labels throughout the training process,…

Machine Learning · Computer Science 2024-08-20 Jiaming Liu , Hongyuan Liu , Zhili Qin , Wei Han , Yulu Fan , Qinli Yang , Junming Shao

Federated Learning (FL) faces significant challenges in evolving environments, particularly regarding data heterogeneity and the rigidity of fixed network topologies. To address these issues, this paper proposes \textbf{SOFA-FL}…

Machine Learning · Computer Science 2025-12-10 Yi Ni , Xinkun Wang , Han Zhang

Biased gradient compression with error feedback (EF) reduces communication in federated learning (FL), but under non-IID data, the residual error can decay slowly, causing gradient mismatch and stalled progress in the early rounds. We…

Machine Learning · Computer Science 2026-05-26 Dawit Kiros Redie , Reza Arablouei , Stefan Werner