English
Related papers

Related papers: Dynamic Integration of Task-Specific Adapters for …

200 papers

Time series classification underpins critical applications such as healthcare diagnostics and gesture-driven interactive systems in multimedia scenarios. However, time series class-incremental learning (TSCIL) faces two major challenges:…

In the realm of class-incremental learning (CIL), alleviating the catastrophic forgetting problem is a pivotal challenge. This paper discovers a counter-intuitive observation: by incorporating domain shift into CIL tasks, the forgetting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Wei Chen , Yi Zhou

Exemplar-free Class Incremental Learning (EFCIL) aims to learn from a sequence of tasks without having access to previous task data. In this paper, we consider the challenging Cold Start scenario in which insufficient data is available in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Simone Magistri , Tomaso Trinci , Albin Soutif-Cormerais , Joost van de Weijer , Andrew D. Bagdanov

Classifiers trained on given databases perform poorly when tested on data acquired in different settings. This is explained in domain adaptation through a shift among distributions of the source and target domains. Attempts to align them…

Computer Vision and Pattern Recognition · Computer Science 2017-11-29 Fabio Maria Carlucci , Lorenzo Porzi , Barbara Caputo , Elisa Ricci , Samuel Rota Bulò

This work explores class-incremental learning (CIL) for sound event detection (SED), advancing adaptability towards real-world scenarios. CIL's success in domains like computer vision inspired our SED-tailored method, addressing the unique…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Yang Xiao , Rohan Kumar Das

Parameter efficient fine tuning methods like LoRA have enabled task specific adaptation of large language models, but efficiently composing multiple specialized adapters for unseen tasks remains challenging. We present a novel framework for…

Computation and Language · Computer Science 2026-02-26 Riya Adsul , Balachandra Devarangadi Sunil , Isha Nalawade , Sudharshan Govindan

Class-Incremental Learning (CIL) trains a model to continually recognize new classes from non-stationary data while retaining learned knowledge. A major challenge of CIL arises when applying to real-world data characterized by non-uniform…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jiangpeng He , Fengqing Zhu

We present DARLEI, a framework that combines evolutionary algorithms with parallelized reinforcement learning for efficiently training and evolving populations of UNIMAL agents. Our approach utilizes Proximal Policy Optimization (PPO) for…

Artificial Intelligence · Computer Science 2023-12-11 Saeejith Nair , Mohammad Javad Shafiee , Alexander Wong

Class Incremental Learning (CIL) aims to sequentially learn new classes while avoiding catastrophic forgetting of previous knowledge. We propose to use Masked Autoencoders (MAEs) as efficient learners for CIL. MAEs were originally designed…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Jiang-Tian Zhai , Xialei Liu , Andrew D. Bagdanov , Ke Li , Ming-Ming Cheng

Many deep learning applications, like keyword spotting, require the incorporation of new concepts (classes) over time, referred to as Class Incremental Learning (CIL). The major challenge in CIL is catastrophic forgetting, i.e., preserving…

Machine Learning · Computer Science 2022-04-28 Dong Ma , Chi Ian Tang , Cecilia Mascolo

Pre-trained model-based continual learning (PTMCL) has garnered growing attention, as it enables more rapid acquisition of new knowledge by leveraging the extensive foundational understanding inherent in pre-trained model (PTM). Most…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Songze Li , Tonghua Su , Xu-Yao Zhang , Qixing Xu , Zhongjie Wang

The exemplar-free class incremental learning requires classification models to learn new class knowledge incrementally without retaining any old samples. Recently, the framework based on parallel one-class classifiers (POC), which trains a…

Machine Learning · Computer Science 2025-01-28 Wenju Sun , Qingyong Li , Jing Zhang , Danyu Wang , Wen Wang , Yangli-ao Geng

This paper proposes a simple but highly efficient expansion-based model for continual learning. The recent feature transformation, masking and factorization-based methods are efficient, but they grow the model only over the global or shared…

Machine Learning · Computer Science 2023-12-05 Soumya Roy , Vinay K Verma , Deepak Gupta

Class-incremental learning (CIL) enables continuous learning of new classes while mitigating catastrophic forgetting of old ones. For the performance breakthrough of CIL, it is essential yet challenging to effectively refine past knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Yuanzhi Su , Siyuan Chen , Yuan-Gen Wang

Currently intelligent diagnosis systems lack the ability of continually learning to diagnose new diseases once deployed, under the condition of preserving old disease knowledge. In particular, updating an intelligent diagnosis system with…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Wentao Zhang , Yujun Huang , Tong Zhang , Qingsong Zou , Wei-Shi Zheng , Ruixuan Wang

In-context learning (ICL) allows transformer-based language models that are pre-trained on general text to quickly learn a specific task with a few "task demonstrations" without updating their parameters, significantly boosting their…

Computation and Language · Computer Science 2024-12-17 Zijian Zhou , Xiaoqiang Lin , Xinyi Xu , Alok Prakash , Daniela Rus , Bryan Kian Hsiang Low

Few-shot class-incremental learning (FSCIL) seeks to continuously learn new classes from very limited samples while preserving previously acquired knowledge. Traditional methods often utilize a frozen pre-trained feature extractor to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Shengqin Jiang , Xiaoran Feng , Yuankai Qi , Haokui Zhang , Renlong Hang , Qingshan Liu , Lina Yao , Quan Z. Sheng , Ming-Hsuan Yang

With the memory-resource-limited constraints, class-incremental learning (CIL) usually suffers from the "catastrophic forgetting" problem when updating the joint classification model on the arrival of newly added classes. To cope with the…

Machine Learning · Computer Science 2021-05-19 Hanbin Zhao , Hui Wang , Yongjian Fu , Fei Wu , Xi Li

In-context learning (ICL) has become a classic approach for enabling LLMs to handle various tasks based on a few input-output examples. The effectiveness of ICL heavily relies on the quality of these examples, and previous works which…

Computation and Language · Computer Science 2025-07-25 Yifu Chen , Bingchen Huang , Zhiling Wang , Yuanchao Du , Junfeng Luo , Lei Shen , Zhineng chen

Although deep neural networks enable impressive visual perception performance for autonomous driving, their robustness to varying weather conditions still requires attention. When adapting these models for changed environments, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 M. Jehanzeb Mirza , Marc Masana , Horst Possegger , Horst Bischof