English
Related papers

Related papers: PEAM: Parametric Embodied Agent Memory through Con…

200 papers

Large language model (LLM)-powered multi-agent systems (MAS) demonstrate remarkable collective intelligence, wherein multi-agent memory serves as a pivotal mechanism for continual adaptation. However, existing multi-agent memory designs…

Computation and Language · Computer Science 2026-03-10 Muxin Fu , Xiangyuan Xue , Yafu Li , Zefeng He , Siyuan Huang , Xiaoye Qu , Yu Cheng , Yang Yang

Experience replay is an essential component in deep reinforcement learning (DRL), which stores the experiences and generates experiences for the agent to learn in real time. Recently, prioritized experience replay (PER) has been proven to…

Hardware Architecture · Computer Science 2024-03-06 Mengyuan Li , Arman Kazemi , Ann Franchesca Laguna , X. Sharon Hu

Long-horizon multimodal agents depend on external memory; however, similarity-based retrieval often surfaces stale, low-credibility, or conflicting items, which can trigger overconfident errors. We propose Multimodal Memory Agent (MMA),…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Yihao Lu , Wanru Cheng , Zeyu Zhang , Hao Tang

Large Language Models (LLMs) have emerged as a new paradigm for recommendation by converting interacted item history into language modeling. However, constrained by the limited context length of LLMs, existing approaches have to truncate…

Information Retrieval · Computer Science 2025-05-20 Jiayi Liao , Ruobing Xie , Sihang Li , Xiang Wang , Xingwu Sun , Zhanhui Kang , Xiangnan He

Multimodal Large Language Models (MLLMs) have achieved remarkable performance by aligning pretrained visual representations with the linguistic knowledge embedded in Large Language Models (LLMs). However, existing approaches typically rely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Ying Liu , Yudong Han , Kean Shi , Liyuan Pan

Large language model (LLM) agents face fundamental limitations in long-horizon reasoning due to finite context windows, making effective memory management critical. Existing methods typically handle long-term memory (LTM) and short-term…

Computation and Language · Computer Science 2026-05-01 Yi Yu , Liuyi Yao , Yuexiang Xie , Qingquan Tan , Jiaqi Feng , Yaliang Li , Libing Wu

We present APT, an advanced Large Language Model (LLM)-driven framework that enables autonomous agents to construct complex and creative structures within the Minecraft environment. Unlike previous approaches that primarily concentrate on…

Machine Learning · Computer Science 2024-12-03 Jun Yu Chen , Tao Gao

As multimodal agents evolve from passive observers to long-horizon decision-makers, they require memory systems that provide not just information availability but logical verifiability. A fundamental limitation of current architectures is…

Artificial Intelligence · Computer Science 2026-02-03 Zhisheng Chen , Tingyu Wu , Zijie Zhou , Zhengwei Xie , Ziyan Weng , Yingwei Zhang

Multimodal large language model (MLLM)-based embodied agents have shown strong potential for solving complex tasks in physical environments. However, personalized assistance requires more than following generic instruction or recognizing…

Artificial Intelligence · Computer Science 2026-05-27 Jeongeun Lee , Chanyoung Park , Dongha Lee

Memory is critical for enabling large language model (LLM) based agents to maintain coherent behavior over long-horizon interactions. However, existing agent memory systems suffer from two key gaps: they rely on a one-size-fits-all memory…

Artificial Intelligence · Computer Science 2026-02-17 Mingfei Lu , Mengjia Wu , Feng Liu , Jiawei Xu , Weikai Li , Haoyang Wang , Zhengdong Hu , Ying Ding , Yizhou Sun , Jie Lu , Yi Zhang

Memory mechanism is a core component of LLM-based agents, enabling reasoning and knowledge discovery over long-horizon contexts. Existing agent memory systems are typically designed within isolated paradigms (e.g., explicit, parametric, or…

Artificial Intelligence · Computer Science 2026-02-10 Xin Zhang , Kailai Yang , Chenyue Li , Hao Li , Qiyu Wei , Jun'ichi Tsujii , Sophia Ananiadou

Agentic systems powered by Large Language Models (LLMs) have shown strong potential in recommender systems but remain hindered by several challenges. Fine-tuning LLMs is parameter-inefficient, and prompt-based agentic reasoning is limited…

Information Retrieval · Computer Science 2026-02-10 Minh-Duc Nguyen , Hai-Dang Kieu , Dung D. Le

Memory-augmented LLM agents offer an appealing shortcut to continual learning: rather than updating model parameters, they accumulate experience in external memory, seemingly sidestepping the stability-plasticity dilemma of parametric…

Machine Learning · Computer Science 2026-05-01 Qisheng Hu , Quanyu Long , Wenya Wang

The success of large language models has garnered widespread attention for model merging techniques, especially training-free methods which combine model capabilities within the parameter space. However, two challenges remain: (1) uniform…

Artificial Intelligence · Computer Science 2025-03-28 Jiaqi Han , Jingwen Ye , Shunyu Liu , Haofei Zhang , Jie Song , Zunlei Feng , Mingli Song

Episodic memory-based methods can rapidly latch onto past successful strategies by a non-parametric memory and improve sample efficiency of traditional reinforcement learning. However, little effort is put into the continuous domain, where…

Machine Learning · Computer Science 2021-06-14 Hao Hu , Jianing Ye , Guangxiang Zhu , Zhizhou Ren , Chongjie Zhang

Autoregressive video diffusion models have proved effective for world modeling and interactive scene generation, with Minecraft gameplay as a representative application. To faithfully simulate play, a model must generate natural content…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Junchao Huang , Xinting Hu , Boyao Han , Shaoshuai Shi , Zhuotao Tian , Tianyu He , Li Jiang

Current AI agents excel in familiar settings, but fail sharply when faced with novel tasks with unseen vocabularies -- a core limitation of procedural memory systems. We present the first benchmark that isolates procedural memory retrieval…

Computation and Language · Computer Science 2025-12-01 Ishant Kohar , Aswanth Krishnan

Continuously estimating an agent's state space and a representation of its surroundings has proven vital towards full autonomy. A shared common ground among systems which successfully achieve this feat is the integration of previously…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Gil Avraham , Yan Zuo , Thanuja Dharmasiri , Tom Drummond

AI agents that interact with users across multiple sessions require persistent long-term memory to maintain coherent, personalized behavior. Current approaches either rely on flat retrieval-augmented generation (RAG), which loses structural…

Artificial Intelligence · Computer Science 2026-05-14 Swarna Kamal Paul , Shubhendu Sharma , Nitin Sareen

Modern video games pose significant challenges for traditional automated testing algorithms, yet intensive testing is crucial to ensure game quality. To address these challenges, researchers designed gaming agents using Reinforcement…

Software Engineering · Computer Science 2026-02-23 Yifei Chen , Sarra Habchi , Lili Wei