English
Related papers

Related papers: Memory as a Service (MaaS): Rethinking Contextual …

200 papers

Large language models (LLMs) have demonstrated significant potential in solving recommendation tasks. With proven capabilities in understanding user preferences, LLM personalization has emerged as a critical area for providing tailored…

Information Retrieval · Computer Science 2025-11-04 Jiarui Chen

Sustaining coherent, role-aware communication across multi-agent systems remains a foundational challenge in AI. Current frameworks often lack explicit mechanisms for speaker responsibility, leading to context drift, alignment instability,…

Artificial Intelligence · Computer Science 2025-06-03 Khe-Han Toh , Hong-Kuan Teo

Memory-Augmented Generation (MAG) extends Large Language Models with external memory to support long-context reasoning, but existing approaches largely rely on semantic similarity over monolithic memory stores, entangling temporal, causal,…

Artificial Intelligence · Computer Science 2026-04-17 Dongming Jiang , Yi Li , Guanpeng Li , Bingzhe Li

The recent advent of large language models (LLM) has resulted in high-performing conversational agents such as chatGPT. These agents must remember key information from an ongoing conversation to provide responses that are contextually…

Human-Computer Interaction · Computer Science 2023-08-04 Ziheng Huang , Sebastian Gutierrez , Hemanth Kamana , Stephen MacNeil

Intelligent systems must maintain and manipulate task-relevant information online to adapt to dynamic environments and changing goals. This capacity, known as working memory, is fundamental to human reasoning and intelligence. Despite…

Machine Learning · Computer Science 2026-04-14 Hua-Dong Xiong , Li Ji-An , Jiaqi Huang , Robert C. Wilson , Kwonjoon Lee , Xue-Xin Wei

Memory-augmented LLM agents maintain external memory banks to support long-horizon interaction, yet most existing systems treat construction, retrieval, and utilization as isolated subroutines. This creates two coupled challenges: strategic…

Artificial Intelligence · Computer Science 2026-03-20 Minhua Lin , Zhiwei Zhang , Hanqing Lu , Hui Liu , Xianfeng Tang , Qi He , Xiang Zhang , Suhang Wang

This paper formalises the literature on emerging design patterns and paradigms for Large Language Model (LLM)-enabled multi-agent systems (MAS), evaluating their practical utility across various domains. We define key architectural…

Multiagent Systems · Computer Science 2026-01-08 Harri Renney , Maxim N Nethercott , Nathan Renney , Peter Hayes

As the field of AI continues to evolve, a significant dimension of this progression is the development of Large Language Models and their potential to enhance multi-agent artificial intelligence systems. This paper explores the cooperative…

Artificial Intelligence · Computer Science 2024-06-21 Manuel Mosquera , Juan Sebastian Pinzon , Manuel Rios , Yesid Fonseca , Luis Felipe Giraldo , Nicanor Quijano , Ruben Manrique

The advent of CPU-attached persistent memory technology, such as Intel's Optane Persistent Memory Modules (PMM), has brought with it new opportunities for storage. In 2018, IBM Research Almaden began investigating and developing a new…

Hardware Architecture · Computer Science 2021-05-25 Daniel Waddington , Clem Dickey , Moshik Hershcovitch , Sangeetha Seshadri

The traditional RAG paradigm, which typically engages in the comprehension of relevant text chunks in response to received queries, inherently restricts both the depth of knowledge internalization and reasoning capabilities. To address this…

Computation and Language · Computer Science 2025-10-17 Jihao Zhao , Zhiyuan Ji , Simin Niu , Hanyu Wang , Feiyu Xiong , Zhiyu Li

To enable embodied agents to operate effectively over extended timeframes, it is crucial to develop models that form and access memories to stay contextualized in their environment. In the current paradigm of training transformer-based…

Artificial Intelligence · Computer Science 2025-12-01 Gunshi Gupta , Karmesh Yadav , Zsolt Kira , Yarin Gal , Rahaf Aljundi

Most Large Language Model (LLM) agent memory systems rely on a small set of static, hand-designed operations for extracting memory. These fixed procedures hard-code human priors about what to store and how to revise memory, making them…

Computation and Language · Computer Science 2026-05-26 Haozhen Zhang , Quanyu Long , Jianzhu Bao , Tao Feng , Weizhi Zhang , Haodong Yue , Wenya Wang

Research interest in autonomous agents is on the rise as an emerging topic. The notable achievements of Large Language Models (LLMs) have demonstrated the considerable potential to attain human-like intelligence in autonomous agents.…

Multiagent Systems · Computer Science 2025-01-30 Hung Du , Srikanth Thudumu , Rajesh Vasa , Kon Mouzakis

The rise of multi-agent systems powered by large language models (LLMs) and specialized reasoning agents exposes fundamental limitations in today's data management architectures. Traditional databases and data fabrics were designed for…

Multiagent Systems · Computer Science 2025-12-11 Ioana Giurgiu , Michael E. Nidd

In the era of (multi-modal) large language models, most operational processes can be reformulated and reproduced using LLM agents. The LLM agents can perceive, control, and get feedback from the environment so as to accomplish the given…

Artificial Intelligence · Computer Science 2024-12-31 Yingxuan Yang , Qiuying Peng , Jun Wang , Ying Wen , Weinan Zhang

As future tasks in networked systems are increasingly relying on collaborative execution among distributed devices, trust has become an essential tool for securing both reliable collaborators and task-specific resources. However, the…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Botao Zhu , Xianbin Wang

This survey investigates foundational technologies essential for developing effective Large Language Model (LLM)-based multi-agent systems. Aiming to answer how best to optimize these systems for collaborative, dynamic environments, we…

Multiagent Systems · Computer Science 2025-04-04 R. M. Aratchige , W. M. K. S. Ilmini

Dialogue management (DM) decides the next action of a dialogue system according to the current dialogue state, and thus plays a central role in task-oriented dialogue systems. Since dialogue management requires to have access to not only…

Computation and Language · Computer Science 2018-05-14 Zheng Zhang , Minlie Huang , Zhongzhou Zhao , Feng Ji , Haiqing Chen , Xiaoyan Zhu

Memory is fundamental to intelligence, enabling learning, reasoning, and adaptability across biological and artificial systems. While Transformer architectures excel at sequence modeling, they face critical limitations in long-range context…

Machine Learning · Computer Science 2025-08-19 Parsa Omidi , Xingshuai Huang , Axel Laborieux , Bahareh Nikpour , Tianyu Shi , Armaghan Eshaghi

Multi-agent large language model (LLM) systems have shown strong potential in complex reasoning and collaborative decision-making tasks. However, most existing coordination schemes rely on static or full-context routing strategies, which…

Computation and Language · Computer Science 2025-08-13 Jun Liu , Zhenglun Kong , Changdi Yang , Fan Yang , Tianqi Li , Peiyan Dong , Joannah Nanjekye , Hao Tang , Geng Yuan , Wei Niu , Wenbin Zhang , Pu Zhao , Xue Lin , Dong Huang , Yanzhi Wang