English
Related papers

Related papers: CATA: Continual Machine Unlearning via Conflict-Av…

200 papers

Web service administrators must ensure the stability of multiple systems by promptly detecting anomalies in Key Performance Indicators (KPIs). Achieving the goal of "train once, infer across scenarios" remains a fundamental challenge for…

Machine Learning · Computer Science 2025-10-07 Zexin Wang , Changhua Pei , Yang Liu , Hengyue Jiang , Quan Zhou , Haotian Si , Hang Cui , Jianhui Li , Gaogang Xie , Jingjing Li , Dan Pei

Video Large Language Models (Video-LLMs) require continual learning to adapt to non-stationary real-world data. However, existing benchmarks fall short of evaluating modern foundation models: many still rely on models without large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Haiyang Guo , Yichen Shi , Fei Zhu , Wenzhuo Liu , Hongbo Zhao , Fanhu Zeng , Shijie Ma , Da-Han Wang , Xu-Yao Zhang

Instruction tuning is now a widely adopted approach to aligning large multimodal models (LMMs) to follow human intent. It unifies the data format of vision-language tasks, enabling multi-task joint training. However, vision-language tasks…

Machine Learning · Computer Science 2023-11-29 Jinghan He , Haiyun Guo , Ming Tang , Jinqiao Wang

Unlearning in large language models (LLMs) aims to remove specified data, but its efficacy is typically assessed with task-level metrics like accuracy and perplexity. We show that these metrics can be misleading, as models can appear to…

Computation and Language · Computer Science 2026-05-19 Xiaoyu Xu , Xiang Yue , Yang Liu , Qingqing Ye , Huadi Zheng , Peizhao Hu , Minxin Du , Haibo Hu

This study aims to address the problem of multi-domain task incremental learning~(MTIL), which requires that vision-language models~(VLMs) continuously acquire new knowledge while maintaining their inherent zero-shot recognition capability.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Songlin Dong , Chenhao Ding , Jiangyang Li , Jizhou Han , Qiang Wang , Yuhang He , Yihong Gong

Active automata learning algorithms cannot easily handle conflict in the observation data (different outputs observed for the same inputs). This inherent inability to recover after a conflict impairs their effective applicability in…

Formal Languages and Automata Theory · Computer Science 2023-10-03 Tiago Ferreira , Léo Henry , Raquel Fernandes da Silva , Alexandra Silva

Continual learning (CL) has emerged as a pivotal paradigm to enable large language models (LLMs) to dynamically adapt to evolving knowledge and sequential tasks while mitigating catastrophic forgetting-a critical limitation of the static…

Computation and Language · Computer Science 2026-03-16 Hongyang Chen , Zhongwu Sun , Hongfei Ye , Kunchi Li , Xuemin Lin

Vision-Language-Action (VLA) models have shown a strong capability in enabling robots to execute general instructions, yet they struggle with contact-rich manipulation tasks, where success requires precise alignment, stable contact…

Robotics · Computer Science 2026-02-16 Yike Zhang , Yaonan Wang , Xinxin Sun , Kaizhen Huang , Zhiyuan Xu , Junjie Ji , Zhengping Che , Jian Tang , Jingtao Sun

Transformer neural networks are increasingly replacing prior architectures in a wide range of applications in different data modalities. The increasing size and computational demands of fine-tuning large pre-trained transformer neural…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yuliang Cai , Mohammad Rostami

Test-time adaptation (TTA) has gained increasing popularity due to its efficacy in addressing ``distribution shift'' issue while simultaneously protecting data privacy. However, most prior methods assume that a paired source domain model…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Aiming Zhang , Tianyuan Yu , Liang Bai , Jun Tang , Yanming Guo , Yirun Ruan , Yun Zhou , Zhihe Lu

Vision Language Models (VLMs) have become essential backbones for multimodal intelligence, yet significant safety challenges limit their real-world application. While textual inputs are often effectively safeguarded, adversarial visual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yi Ding , Bolian Li , Ruqi Zhang

General-purpose learning systems should improve themselves in open-ended fashion in ever-changing environments. Conventional learning algorithms for neural networks, however, suffer from catastrophic forgetting (CF), i.e., previously…

Machine Learning · Computer Science 2025-02-18 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

Active automata learning algorithms cannot easily handle conflict in the observation data (different outputs observed for the same inputs). This inherent inability to recover after a conflict impairs their effective applicability in…

Machine Learning · Computer Science 2023-09-07 Tiago Ferreira , Léo Henry , Raquel Fernandes da Silva , Alexandra Silva

Large language models (LLMs) can acquire new capabilities through fine-tuning, but continual adaptation often leads to catastrophic forgetting. We propose CRAFT, a continual learning framework that avoids updating model weights by instead…

Machine Learning · Computer Science 2026-05-11 Md Anwar Hossen , Fatema Siddika , Juan Pablo Munoz , Tanya Roosta , Ali Jannesari

Continual learning (CL) is a fundamental topic in machine learning, where the goal is to train a model with continuously incoming data and tasks. Due to the memory limit, we cannot store all the historical data, and therefore confront the…

Machine Learning · Computer Science 2024-07-31 Weichen Lin , Jiaxiang Chen , Ruomin Huang , Hu Ding

Continual instruction tuning(CIT) during the post-training phase is crucial for adapting multimodal large language models (MLLMs) to evolving real-world demands. However, the progress is hampered by the lack of benchmarks with rigorous,…

Computation and Language · Computer Science 2026-02-16 Haiyun Guo , Zhiyan Hou , Yandu Sun , Jinghan He , Yu Chen , Yuzhe Zhou , Yuheng Jia , Jinqiao Wang , Tat-Seng Chua

Continual learning (CL) enables models to adapt to evolving data streams without catastrophic forgetting, a fundamental requirement for real-world AI systems. However, the current methods often depend on large replay buffers or heavily…

Machine Learning · Computer Science 2025-11-14 Indu Solomon , Aye Phyu Phyu Aung , Uttam Kumar , Senthilnath Jayavelu

Vision-Language-Action (VLA) models benefit from chain-of-thought (CoT) reasoning, but existing approaches incur high inference overhead and rely on discrete reasoning representations that mismatch continuous perception and control. We…

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Recent advances in large language models (LLMs) have opened new opportunities for recommender systems by enabling rich semantic understanding and reasoning about user interests and item attributes. However, as privacy regulations tighten,…

Information Retrieval · Computer Science 2026-04-08 Ziheng Chen , Jiali Cheng , Zezhong Fan , Hadi Amiri , Yunzhi Yao , Xiangguo Sun , Yang Zhang