English
Related papers

Related papers: CKAA: Cross-subspace Knowledge Alignment and Aggre…

200 papers

Machine learning models often need to adapt to new data after deployment due to structured or unstructured real-world dynamics. The Continual Learning (CL) framework enables continuous model adaptation, but most existing approaches either…

Machine Learning · Computer Science 2026-03-25 Connor Mclaughlin , Nigel Lee , Lili Su

Foundation models have revolutionized AI, but adapting them efficiently for multimodal tasks, particularly in dual-stream architectures composed of unimodal encoders, such as DINO and BERT, remains a significant challenge.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Wish Suharitdamrong , Tony Alex , Muhammad Awais , Sara Ahmed

Deep neural networks often degrade under distribution shifts. Although domain adaptation offers a solution, privacy constraints often prevent access to source data, making Test-Time Adaptation (TTA, which adapts using only unlabeled test…

Machine Learning · Computer Science 2025-06-10 Linjing You , Jiabao Lu , Xiayuan Huang

Entity Alignment (EA) aims to match equivalent entities across different Knowledge Graphs (KGs) and is an essential step of KG fusion. Current mainstream methods -- neural EA models -- rely on training with seed alignment, i.e., a set of…

Computation and Language · Computer Science 2021-10-14 Bing Liu , Harrisen Scells , Guido Zuccon , Wen Hua , Genghong Zhao

Continual learning (CL) is designed to learn new tasks while preserving existing knowledge. Replaying samples from earlier tasks has proven to be an effective method to mitigate the forgetting of previously acquired knowledge. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Ruiqi Liu , Boyu Diao , Libo Huang , Zijia An , Zhulin An , Yongjun Xu

The problem of Rehearsal-Free Continual Learning (RFCL) aims to continually learn new knowledge while preventing forgetting of the old knowledge, without storing any old samples and prototypes. The latest methods leverage large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinyuan Gao , Songlin Dong , Yuhang He , Qiang Wang , Yihong Gong

In the past, continual learning (CL) was mostly concerned with the problem of catastrophic forgetting in neural networks, that arises when incrementally learning a sequence of tasks. Current CL methods function within the confines of…

Machine Learning · Computer Science 2025-07-29 Shishir Muralidhara , Didier Stricker , René Schuster

Cognitive diagnosis is an essential research topic in intelligent education, aimed at assessing the level of mastery of different skills by students. So far, many research works have used deep learning models to explore the complex…

Machine Learning · Computer Science 2025-12-30 Jin Wu , Chanjin Zheng

Artificial intelligence systems predominantly rely on static data distributions, making them ineffective in dynamic real-world environments, such as cybersecurity, autonomous transportation, or finance, where data shifts frequently.…

Machine Learning · Computer Science 2026-03-19 Isabella Marasco , Davide Evangelista , Elena Loli Piccolomini , Michele Colajanni

The goal of continual learning is to improve the performance of recognition models in learning sequentially arrived data. Although most existing works are established on the premise of learning from scratch, growing efforts have been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Gengwei Zhang , Liyuan Wang , Guoliang Kang , Ling Chen , Yunchao Wei

Knowledge Graphs~(KGs) often suffer from unreliable knowledge, which restricts their utility. Triple Classification~(TC) aims to determine the validity of triples from KGs. Recently, text-based methods learn entity and relation…

Computation and Language · Computer Science 2026-01-21 Xu Xiaodan , Hu Xiaolin

Previous studies on continual knowledge learning (CKL) in large language models (LLMs) have predominantly focused on approaches such as regularization, architectural modifications, and rehearsal techniques to mitigate catastrophic…

Computation and Language · Computer Science 2025-02-06 Yeongbin Seo , Dongha Lee , Jinyoung Yeo

Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanghun Jung , Jungsoo Lee , Nanhee Kim , Amirreza Shaban , Byron Boots , Jaegul Choo

Continual learning (CL) aims to train models that can learn a sequence of tasks without forgetting previously acquired knowledge. A core challenge in CL is balancing stability -- preserving performance on old tasks -- and plasticity --…

Machine Learning · Computer Science 2025-05-14 Zhenrong Liu , Janne M. J. Huttunen , Mikko Honkala

Continual learning (CL) is essential for Large Language Models (LLMs) to adapt to evolving real-world demands, yet they are susceptible to catastrophic forgetting (CF). While traditional CF solutions rely on expensive data rehearsal, recent…

Machine Learning · Computer Science 2025-02-18 Huanxuan Liao , Shizhu He , Yupu Hao , Jun Zhao , Kang Liu

Reinforcement learning (RL) has demonstrated remarkable potential in robotic manipulation but faces challenges in sample inefficiency and lack of interpretability, limiting its applicability in real world scenarios. Enabling the agent to…

Robotics · Computer Science 2025-05-16 Xinrui Wang , Yan Jin

How to adapt a pre-trained model continuously for sequential tasks with different prediction class labels and domains and finally learn a generalizable model across diverse tasks is a long-lasting challenge. Continual learning (CL) has…

Machine Learning · Computer Science 2025-04-15 Xiaobing Yu , Jin Yang , Xiao Wu , Peijie Qiu , Xiaofeng Liu

Deep neural networks, despite their remarkable success, remain fundamentally limited in their ability to perform Continual Learning (CL). While most current methods aim to enhance the capabilities of a single model, Inspired by the…

Machine Learning · Computer Science 2025-08-01 Aojun Lu , Junchao Ke , Chunhui Ding , Jiahao Fan , Jiancheng Lv , Yanan Sun

Using task-specific components within a neural network in continual learning (CL) is a compelling strategy to address the stability-plasticity dilemma in fixed-capacity models without access to past data. Current methods focus only on…

Machine Learning · Computer Science 2022-07-07 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Knowledge amalgamation (KA) aims to learn a compact student model to handle the joint objective from multiple teacher models that are are specialized for their own tasks respectively. Current methods focus on coarsely aligning teachers and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Shangde Gao , Yichao Fu , Ke Liu , Yuqiang Han