English
Related papers

Related papers: Mem-$\pi$: Adaptive Memory through Learning When a…

200 papers

Large language models (LLMs) have advanced the field of artificial intelligence (AI) and are a powerful enabler for interactive systems. However, they still face challenges in long-term interactions that require adaptation towards the user…

Artificial Intelligence · Computer Science 2025-05-20 Rebecca Westhäußer , Frederik Berenz , Wolfgang Minker , Sebastian Zepf

Agents utilizing tools powered by large language models (LLMs) or vision-language models (VLMs) have demonstrated remarkable progress in diverse tasks across text and visual modalities. Unlike traditional tools such as calculators, which…

Computation and Language · Computer Science 2025-10-09 Yunzhong Xiao , Yangmin Li , Hewei Wang , Yunlong Tang , Zora Zhiruo Wang

In this paper, we demonstrate how Large Language Models (LLMs) can effectively learn to use an off-the-shelf information retrieval (IR) system specifically when additional context is required to answer a given question. Given the…

Computation and Language · Computer Science 2024-05-08 Tiziano Labruna , Jon Ander Campos , Gorka Azkune

Large language model agents heavily rely on external memory to support knowledge reuse and complex reasoning tasks. Yet most memory systems store experiences in a single global retrieval pool which can gradually dilute or corrupt stored…

Computation and Language · Computer Science 2026-04-21 Taeyun Roh , Wonjune Jang , Junha Jung , Jaewoo Kang

Large Language Model (LLM) agents have demonstrated remarkable proficiency in learned tasks, yet they often struggle to adapt to non-stationary environments with feedback. While In-Context Learning and external memory offer some…

Artificial Intelligence · Computer Science 2026-03-05 Lu Yang , Zelai Xu , Minyang Xie , Jiaxuan Gao , Zhao Shok , Yu Wang , Yi Wu

Memory-augmented LLM agents maintain external memory banks to support long-horizon interaction, yet most existing systems treat construction, retrieval, and utilization as isolated subroutines. This creates two coupled challenges: strategic…

Artificial Intelligence · Computer Science 2026-03-20 Minhua Lin , Zhiwei Zhang , Hanqing Lu , Hui Liu , Xianfeng Tang , Qi He , Xiang Zhang , Suhang Wang

Constructivist epistemology argues that knowledge is actively constructed rather than passively copied. Despite the generative nature of Large Language Models (LLMs), most existing agent memory systems are still based on dense retrieval.…

Computation and Language · Computer Science 2026-04-23 Lei Zheng , Weinan Song , Daili Li , Yanming Yang

Generative point-of-interest (POI) recommendation models based on large language models (LLMs) have shown promising results by formulating next POI prediction as a sequence generation task. However, the knowledge encoded in these models…

Artificial Intelligence · Computer Science 2026-05-13 Qiuyu Ding , Heng-Da Xu , Wei Zhang , Dongyi Lv , Changda Xia , Feng Xiong , Mu Xu

Modern language agents must operate over long-horizon, multi-turn histories, yet deploying such agents with Small Language Models (SLMs) remains fundamentally difficult. Full-context prompting causes context overflow, flat retrieval exposes…

Multiagent Systems · Computer Science 2026-05-06 Jiayi Chen , Yingcong Li , Guiling Wang

The emergence of large language model (LLM)-based agents has significantly advanced the development of autonomous machine learning (ML) engineering. However, the dominant prompt-based paradigm exhibits limitations: smaller models lack the…

Computation and Language · Computer Science 2026-05-04 Zexi Liu , Jingyi Chai , Xinyu Zhu , Shuo Tang , Rui Ye , Bo Zhang , Lei Bai , Siheng Chen

Large Language Models (LLMs) excel in data synthesis but can be inaccurate in domain-specific tasks, which retrieval-augmented generation (RAG) systems address by leveraging user-provided data. However, RAGs require optimization in both…

Computation and Language · Computer Science 2024-11-05 Kazi Ahmed Asif Fuad , Lizhong Chen

The pursuit of human-level artificial intelligence (AI) has significantly advanced the development of autonomous agents and Large Language Models (LLMs). LLMs are now widely utilized as decision-making agents for their ability to interpret…

Memory systems for LLM agents struggle to determine what information deserves retention. Existing approaches rely on predefined heuristics such as importance scores, emotional tags, or factual templates, encoding designer intuition rather…

Artificial Intelligence · Computer Science 2026-04-17 Wenquan Ma , Jiayan Nan , Wenlong Wu , Yize Chen

As large language models (LLMs) are applied across diverse domains, the ability to selectively unlearn specific information is becoming increasingly essential. For instance, LLMs are expected to selectively provide confidential information…

Computation and Language · Computer Science 2025-06-04 Shota Takashiro , Takeshi Kojima , Andrew Gambardella , Qi Cao , Yusuke Iwasawa , Yutaka Matsuo

Large Language Model (LLM) agents are increasingly deployed to automate complex workflows in mobile and desktop environments. However, current model-centric agent architectures struggle to self-evolve post-deployment: improving…

Artificial Intelligence · Computer Science 2025-12-19 Zibin Liu , Cheng Zhang , Xi Zhao , Yunfei Feng , Bingyu Bai , Dahu Feng , Erhu Feng , Yubin Xia , Haibo Chen

Empathy is a critical factor in fostering positive user experiences in conversational AI. While models can display empathy, it is often generic rather than tailored to specific tasks and contexts. In this work, we introduce a novel…

Human-Computer Interaction · Computer Science 2025-11-06 Erfan Shayegani , Jina Suh , Andy Wilson , Nagu Rangan , Javier Hernandez

Large Language Model (LLM)-based agent simulation has emerged as a promising approach to meet the increasing demand for real-time and rigorous evaluation in modern recommender systems. A typical LLM-driven simulation framework comprises…

Information Retrieval · Computer Science 2026-05-14 Xinye Wanyan , Chenglong Ma , Danula Hettiachchi , Ziqi Xu , Jeffrey Chan

Large Language Models (LLMs) have demonstrated strong capabilities in memorizing vast amounts of knowledge across diverse domains. However, the ability to selectively forget specific knowledge is critical for ensuring the safety and…

Computation and Language · Computer Science 2025-05-20 Zhijie Deng , Chris Yuhao Liu , Zirui Pang , Xinlei He , Lei Feng , Qi Xuan , Zhaowei Zhu , Jiaheng Wei

Although LLM agents can leverage tools for complex tasks, they still need memory to maintain cross-turn consistency and accumulate reusable information in long-horizon interactions. However, retrieval-based external memory systems incur low…

Artificial Intelligence · Computer Science 2026-04-23 Jiaquan Zhang , Chaoning Zhang , Shuxu Chen , Zhenzhen Huang , Pengcheng Zheng , Zhicheng Wang , Ping Guo , Fan Mo , Sung-Ho Bae , Jie Zou , Jiwei Wei , Yang Yang

Graphical User Interface (GUI) agents, driven by Multi-modal Large Language Models (MLLMs), have emerged as a promising paradigm for enabling intelligent interaction with digital systems. This paper provides a structured survey of recent…

Artificial Intelligence · Computer Science 2025-05-14 Jiahao Li , Kaer Huang