English
Related papers

Related papers: MemAdapter: Fast Alignment across Agent Memory Par…

200 papers

We consider a setting involving $N$ agents, where each agent interacts with an environment modeled as a Markov Decision Process (MDP). The agents' MDPs differ in their reward functions, capturing heterogeneous objectives/tasks. The…

Machine Learning · Computer Science 2024-09-10 Feng Zhu , Robert W. Heath , Aritra Mitra

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access external knowledge sources, but the effectiveness of RAG relies on the coordination between the retriever and the generator. Since these components are…

Computation and Language · Computer Science 2025-09-24 Junlin Wang , Zehao Wu , Shaowei Lu , Yanlan Li , Xinghao Huang

Multimodal Large Language Models (MLLMs) demonstrate exceptional semantic reasoning but struggle with 3D spatial perception when restricted to pure RGB inputs. Despite leveraging implicit geometric priors from 3D reconstruction models,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jiaxin Zhang , Junjun Jiang , Haijie Li , Youyu Chen , Kui Jiang , Dave Zhenyu Chen

Advancements in the capabilities of Large Language Models (LLMs) have created a promising foundation for developing autonomous agents. With the right tools, these agents could learn to solve tasks in new environments by accumulating and…

Artificial Intelligence · Computer Science 2025-05-16 Petr Anokhin , Nikita Semenov , Artyom Sorokin , Dmitry Evseev , Andrey Kravchenko , Mikhail Burtsev , Evgeny Burnaev

Retrieval-Augmented Generation remains the dominant pattern for giving LLMs persistent memory, but a visible cluster of personal wiki-style memory architectures emerged in April 2026 -- design proposals from Karpathy, MemPalace, and LLM…

Artificial Intelligence · Computer Science 2026-04-15 Stefan Miteski

LLM-powered embodied agents have shown success on conventional object-rearrangement tasks, but providing personalized assistance that leverages user-specific knowledge from past interactions presents new challenges. We investigate these…

Computation and Language · Computer Science 2026-02-16 Taeyoon Kwon , Dongwook Choi , Hyojun Kim , Sunghwan Kim , Seungjun Moon , Beong-woo Kwak , Kuan-Hao Huang , Jinyoung Yeo

In this paper, we propose a novel factored agent architecture designed to overcome the limitations of traditional single-agent systems in agentic AI. Our approach decomposes the agent into two specialized components: (1) a large language…

Artificial Intelligence · Computer Science 2025-04-03 Nicholas Roth , Christopher Hidey , Lucas Spangher , William F. Arnold , Chang Ye , Nick Masiewicki , Jinoo Baek , Peter Grabowski , Eugene Ie

Training and fine-tuning large language models (LLMs) come with challenges related to memory and computational requirements due to the increasing size of the model weights and the optimizer states. Various techniques have been developed to…

Machine Learning · Computer Science 2025-12-09 Yehonathan Refael , Jonathan Svirsky , Boris Shustin , Wasim Huleihel , Ofir Lindenbaum

Foundation models have reshaped AI by unifying fragmented architectures into scalable backbones with multimodal reasoning and contextual adaptation. In parallel, the long-standing notion of AI agents, defined by the sensing-decision-action…

Machine Learning · Computer Science 2025-10-02 Sicong Liu , Weiye Wu , Xiangrui Xu , Teng Li , Bowen Pang , Bin Guo , Zhiwen Yu

Large Language Models (LLMs) have made extraordinary progress in the field of Artificial Intelligence and have demonstrated remarkable capabilities across a large variety of tasks and domains. However, as we venture closer to creating…

Artificial Intelligence · Computer Science 2023-10-04 Brandon Kynoch , Hugo Latapie , Dwane van der Sluis

Large Language Models (LLMs) have demonstrated significant potential as autonomous software engineering (SWE) agents. Recent work has further explored augmenting these agents with memory mechanisms to support long-horizon reasoning.…

Software Engineering · Computer Science 2026-02-26 Kangning Shen , Jingyuan Zhang , Chenxi Sun , Wencong Zeng , Yang Yue

The recent advancements in generative language models have demonstrated their ability to memorize knowledge from documents and recall knowledge to respond to user queries effectively. Building upon this capability, we propose to enable…

Multimedia · Computer Science 2024-02-19 Yongqi Li , Wenjie Wang , Leigang Qu , Liqiang Nie , Wenjie Li , Tat-Seng Chua

Large language model-based agents operating in long-horizon interactions require memory systems that support temporal consistency, multi-hop reasoning, and evidence-grounded reuse across sessions. Existing approaches largely rely on…

Computation and Language · Computer Science 2026-01-27 Juexiang Ye , Xue Li , Xinyu Yang , Chengkai Huang , Lanshun Nie , Lina Yao , Dechen Zhan

Memory emerges as the core module in the large language model (LLM)-based agents for long-horizon complex tasks (e.g., multi-turn dialogue, game playing, scientific discovery), where memory can enable knowledge accumulation, iterative…

Computation and Language · Computer Science 2026-05-04 Yanchen Wu , Tenghui Lin , Yingli Zhou , Fangyuan Zhang , Qintian Guo , Xun Zhou , Sibo Wang , Xilin Liu , Yuchi Ma , Yixiang Fang

Memory-augmented LLM agents maintain external memory banks to support long-horizon interaction, yet most existing systems treat construction, retrieval, and utilization as isolated subroutines. This creates two coupled challenges: strategic…

Artificial Intelligence · Computer Science 2026-03-20 Minhua Lin , Zhiwei Zhang , Hanqing Lu , Hui Liu , Xianfeng Tang , Qi He , Xiang Zhang , Suhang Wang

We present a continual learning approach for generative adversarial networks (GANs), by designing and leveraging parameter-efficient feature map transformations. Our approach is based on learning a set of global and task-specific…

Machine Learning · Computer Science 2021-08-02 Sakshi Varshney , Vinay Kumar Verma , Srijith P K , Lawrence Carin , Piyush Rai

Large language models (LLMs) increasingly serve as the central control unit of AI agents, yet current approaches remain limited in their ability to deliver personalized interactions. While Retrieval Augmented Generation enhances LLM…

Artificial Intelligence · Computer Science 2025-10-10 Rebecca Westhäußer , Wolfgang Minker , Sebatian Zepf

Hyper-parameter optimization is one of the most tedious yet crucial steps in training machine learning models. There are numerous methods for this vital model-building stage, ranging from domain-specific manual tuning guidelines suggested…

Machine Learning · Computer Science 2023-03-08 Ahmad Esmaeili , Zahra Ghorrati , Eric T. Matson

Meta reinforcement learning (Meta RL) has been amply explored to quickly learn an unseen task by transferring previously learned knowledge from similar tasks. However, most state-of-the-art algorithms require the meta-training tasks to have…

Machine Learning · Computer Science 2023-11-14 Lu Wen , Songan Zhang , H. Eric Tseng , Huei Peng

Multi-agent systems powered by large language models have emerged as a promising paradigm for solving complex reasoning tasks through collaborative intelligence. However, efficiently deploying these systems on serverless GPU platforms…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-05 Guilin Zhang , Wulan Guo , Ziqi Tan