English
Related papers

Related papers: Memory-Integrated Reconfigurable Adapters: A Unifi…

200 papers

We introduce a lifelong imitation learning framework that enables continual policy refinement across sequential tasks under realistic memory and data constraints. Our approach departs from conventional experience replay by operating…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Fanqi Yu , Matteo Tiezzi , Tommaso Apicella , Cigdem Beyan , Vittorio Murino

Adapter tuning, which updates only a few parameters, has become a mainstream method for fine-tuning pretrained language models to downstream tasks. However, it often yields subpar results in few-shot learning. AdapterFusion, which assembles…

Computation and Language · Computer Science 2023-08-31 Shwai He , Run-Ze Fan , Liang Ding , Li Shen , Tianyi Zhou , Dacheng Tao

Memory systems are critical for LLMs, mitigating context window limitations and supporting long-horizon user-LLM interactions. Such systems typically comprise multiple agents responsible for memory construction and retrieval. Existing…

Multiagent Systems · Computer Science 2026-04-28 Wenyu Mao , Haoyang Liu , Haosong Tan , Yaorui Shi , Jiancan Wu , An Zhang , Xiang Wang

Humans and animals have the ability to continuously learn new information over their lifetime without losing previously acquired knowledge. However, artificial neural networks struggle with this due to new information conflicting with old…

Machine Learning · Computer Science 2023-08-08 Mamatha Thota , Dewei Yi , Georgios Leontidis

Deep learning has emerged as a leading approach for Automatic Modulation Classification (AMC), demonstrating superior performance over traditional methods. However, vulnerability to adversarial attacks and susceptibility to data…

Machine Learning · Computer Science 2025-11-04 Ali Owfi , Amirmohammad Bamdad , Tolunay Seyfi , Fatemeh Afghah

Adaptive networks today rely on overparameterized fixed topologies that cannot break through the statistical conflicts they encounter in the data they are exposed to, and are prone to "catastrophic forgetting" as the network attempts to…

Machine Learning · Computer Science 2024-12-06 Zeki Doruk Erden , Boi Faltings

In this paper, we present PCoTTA, an innovative, pioneering framework for Continual Test-Time Adaptation (CoTTA) in multi-task point cloud understanding, enhancing the model's transferability towards the continually changing target domain.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Jincen Jiang , Qianyu Zhou , Yuhang Li , Xinkui Zhao , Meili Wang , Lizhuang Ma , Jian Chang , Jian Jun Zhang , Xuequan Lu

Large language models (LLMs) with billions of parameters demonstrate impressive performance. However, the widely used Multi-Head Attention (MHA) in LLMs incurs substantial computational and memory costs during inference. While some efforts…

Machine Learning · Computer Science 2024-12-10 Yilong Chen , Linhao Zhang , Junyuan Shang , Zhenyu Zhang , Tingwen Liu , Shuohuan Wang , Yu Sun

Retrieval-augmented generation (RAG) has become the default strategy for providing large language model (LLM) agents with contextual knowledge. Yet RAG treats memory as a stateless lookup table: information persists indefinitely, retrieval…

Artificial Intelligence · Computer Science 2026-01-16 Joe Logan

Matching animal-like flexibility in recognition and the ability to quickly incorporate new information remains difficult. Limits are yet to be adequately addressed in neural models and recognition algorithms. This work proposes a…

Computer Vision and Pattern Recognition · Computer Science 2012-06-26 Tsvi Achler

The stability-plasticity dilemma is a major challenge in continual learning, as it involves balancing the conflicting objectives of maintaining performance on previous tasks while learning new tasks. In this paper, we propose the…

Machine Learning · Computer Science 2024-03-06 Haneol Kang , Dong-Wan Choi

As artificial intelligence advances toward artificial general intelligence (AGI), the need for robust and human-like memory systems has become increasingly evident. Current memory architectures often suffer from limited adaptability,…

Artificial Intelligence · Computer Science 2025-09-17 Linyue Cai , Yuyang Cheng , Xiaoding Shao , Huiming Wang , Yong Zhao , Wei Zhang , Kang Li

Lifelong learning in artificial intelligence (AI) aims to mimic the biological brain's ability to continuously learn and retain knowledge, yet it faces challenges such as catastrophic forgetting. Recent neuroscience research suggests that…

Artificial Intelligence · Computer Science 2024-09-24 Jin Du , Xinhe Zhang , Hao Shen , Xun Xian , Ganghua Wang , Jiawei Zhang , Yuhong Yang , Na Li , Jia Liu , Jie Ding

Adaptive behavior requires the brain to transition between distinct contexts while maintaining representations of prior experience. The ability to reconfigure neural representations without erasing previously acquired knowledge is central…

Neurons and Cognition · Quantitative Biology 2026-05-12 Qianqian Shi , Yue Che , Faqiang Liu , Hongyi Li , Mingkun Xu , Sandra Reinert , Pieter M. Goltstein , Rong Zhao , Luping Shi

Continual learning (CL) with large pre-trained models aims to incrementally acquire knowledge without catastrophic forgetting. Existing LoRA-based Mixture-of-Experts (MoE) methods expand capacity by adding isolated new experts while…

Machine Learning · Computer Science 2026-05-22 Haodong Lu , Chongyang Zhao , Minhui Xue , Lina Yao , Kristen Moore , Dong Gong

In this paper, we propose a novel control architecture, inspired from neuroscience, for adaptive control of continuous-time systems. The proposed architecture, in the setting of standard Neural Network (NN) based adaptive control, augments…

Systems and Control · Computer Science 2021-10-11 Deepan Muthirayan , Pramod P. Khargonekar

Multi-turn intent classification is notably challenging due to the complexity and evolving nature of conversational contexts. This paper introduces LARA, a Linguistic-Adaptive Retrieval-Augmentation framework to enhance accuracy in…

Computation and Language · Computer Science 2024-10-15 Junhua Liu , Yong Keat Tan , Bin Fu , Kwan Hui Lim

Metaheuristic algorithms are widely used for solving complex optimization problems, yet their effectiveness is often constrained by fixed structures and the need for extensive tuning. The Polymorphic Metaheuristic Framework (PMF) addresses…

Neural and Evolutionary Computing · Computer Science 2025-05-21 Faramarz Safi Esfahani , Ghassan Beydoun , Morteza Saberi , Brad McCusker , Biswajeet Pradhan

Reward models are pivotal for aligning Large Language Models (LLMs) with human preferences. Existing approaches face two key limitations: Discriminative reward models require large-scale annotated data, as they cannot exploit the preference…

Computation and Language · Computer Science 2026-02-03 Yongfu Xue

Large reasoning models (LRMs) already possess a latent capacity for long chain-of-thought reasoning. Prior work has shown that outcome-based reinforcement learning (RL) can incidentally elicit advanced reasoning behaviors such as…

Computation and Language · Computer Science 2025-05-28 Zhiyuan Hu , Yibo Wang , Hanze Dong , Yuhui Xu , Amrita Saha , Caiming Xiong , Bryan Hooi , Junnan Li