English
Related papers

Related papers: Storage Is Not Memory: A Retrieval-Centered Archit…

200 papers

Recent advances in persona-centric memory have revealed the powerful capability of multi-agent systems in managing persona memory, especially in conversational scenarios. However, these complex frameworks often suffer from information loss…

Computation and Language · Computer Science 2026-04-03 Qi Zhang , Shen Huang , Chu Liu , Shouqing Yang , Junbo Zhao , Haobo Wang , Pengjun Xie

Transformers have become central to natural language processing and large language models, but their deployment at scale faces three major challenges. First, the attention mechanism requires massive matrix multiplications and frequent…

Hardware Architecture · Computer Science 2026-01-22 Xiaoxuan Yang , Peilin Chen , Tergel Molom-Ochir , Yiran Chen

In-Memory Computing (IMC) introduces a new paradigm of computation that offers high efficiency in terms of latency and power consumption for AI accelerators. However, the non-idealities and defects of emerging technologies used in advanced…

We present PRISM, a comprehensive empirical study of mid-training design choices for large language models. Through controlled experiments across seven base models spanning four families (Granite, LLaMA, Mistral, Nemotron-H), two…

Machine Learning · Computer Science 2026-03-25 Bharat Runwal , Ashish Agrawal , Anurag Roy , Rameswar Panda

Existing evaluations of agents with memory typically assess memorization and action in isolation. One class of benchmarks evaluates memorization by testing recall of past conversations or text but fails to capture how memory is used to…

Computation and Language · Computer Science 2026-02-19 Zexue He , Yu Wang , Churan Zhi , Yuanzhe Hu , Tzu-Ping Chen , Lang Yin , Ze Chen , Tong Arthur Wu , Siru Ouyang , Zihan Wang , Jiaxin Pei , Julian McAuley , Yejin Choi , Alex Pentland

Standard factuality evaluations of LLMs treat all errors alike, obscuring whether failures arise from missing knowledge (empty shelves) or from limited access to encoded facts (lost keys). We propose a behavioral framework that profiles…

Computation and Language · Computer Science 2026-02-17 Nitay Calderon , Eyal Ben-David , Zorik Gekhman , Eran Ofek , Gal Yona

We present Portable Agent Memory, an open protocol and reference implementation for transferring persistent memory state across heterogeneous AI agents. Modern AI agents accumulate rich context -- episodic events,semantic knowledge,…

Cryptography and Security · Computer Science 2026-05-13 Santhosh Kumar Ravindran

While linear attention architectures offer efficient inference, compressing unbounded history into a fixed-size memory inherently limits expressivity and causes information loss. To address this limitation, we introduce Random Access Memory…

Machine Learning · Computer Science 2026-02-13 Kaicheng Xiao , Haotian Li , Liran Dong , Guoliang Xing

Inspired by the dual-process theory of human cognition from \textit{Thinking, Fast and Slow}, we introduce \textbf{PRIME} (Planning and Retrieval-Integrated Memory for Enhanced Reasoning), a multi-agent reasoning framework that dynamically…

Artificial Intelligence · Computer Science 2025-11-12 Hieu Tran , Zonghai Yao , Nguyen Luong Tran , Zhichao Yang , Feiyun Ouyang , Shuo Han , Razieh Rahimi , Hong Yu

Large Language Model (LLM)-based agents are increasingly deployed for complex, tool-based tasks where long-term memory is critical to driving actions. Existing benchmarks, however, primarily test a angent's ability to passively retrieve…

Computation and Language · Computer Science 2026-01-29 Yiting Shen , Kun Li , Wei Zhou , Songlin Hu

This paper introduces a novel framework for proactive cross-domain resource orchestration in 6G RAN-Edge networks, featuring large language model (LLM)-augmented agents. The system comprises specialized RAN (energy efficiency) and Edge…

Networking and Internet Architecture · Computer Science 2025-10-01 Hatim Chergui , Miguel Catalan Cid , Pouria Sayyad Khodashenas , Daniel Camps Mur , Christos Verikoukis

We demonstrate how collective memory emerges in decentralized multi-agent systems through the interplay between individual agent memory and environmental trace communication. Our agents maintain internal memory states while depositing…

Multiagent Systems · Computer Science 2025-12-12 Khushiyant

Retrieval-augmented generation (RAG) has become the default strategy for providing large language model (LLM) agents with contextual knowledge. Yet RAG treats memory as a stateless lookup table: information persists indefinitely, retrieval…

Artificial Intelligence · Computer Science 2026-01-16 Joe Logan

Memory is increasingly central to Large Language Model (LLM) agents operating beyond a single context window, yet most existing systems rely on offline, query-agnostic memory construction that can be inefficient and may discard…

Computation and Language · Computer Science 2026-05-28 Haozhen Zhang , Haodong Yue , Tao Feng , Quanyu Long , Jianzhu Bao , Bowen Jin , Weizhi Zhang , Xiao Li , Jiaxuan You , Chengwei Qin , Wenya Wang

Recurrent sequence generators conditioned on input data through an attention mechanism have recently shown very good performance on a range of tasks in- cluding machine translation, handwriting synthesis and image caption gen- eration. We…

Computation and Language · Computer Science 2015-06-25 Jan Chorowski , Dzmitry Bahdanau , Dmitriy Serdyuk , Kyunghyun Cho , Yoshua Bengio

Model checking of strategic abilities for agents with memory is a notoriously hard problem, and very few attempts have been made to tackle it. In this paper, we present two important steps towards this goal. First, we take the partial-order…

Multiagent Systems · Computer Science 2025-10-21 Dilian Gurov , Filip Jamroga , Wojciech Jamroga , Mateusz Kamiński , Damian Kurpiewski , Wojciech Penczek , Teofil Sidoruk

Memory is a critical component of robotic intelligence, as robots must rely on past observations and actions to accomplish long-horizon tasks in partially observable environments. However, existing robotic memory benchmarks still lack…

Long-term conversational large language model (LLM) agents require memory systems that can recover relevant evidence from historical interactions without overwhelming the answer stage with irrelevant context. However, existing memory…

Computation and Language · Computer Science 2026-04-23 Shuqi Cao , Jingyi He , Fei Tan

Magneto-Electric FET (MEFET) is a recently developed post-CMOS FET, which offers intriguing characteristics for high speed and low-power design in both logic and memory applications. In this paper, for the first time, we propose a…

Emerging Technologies · Computer Science 2020-09-15 Shaahin Angizi , Navid Khoshavi , Andrew Marshall , Peter Dowben , Deliang Fan

Although Transformers with fully connected self-attentions are powerful to model long-term dependencies, they are struggling to scale to long texts with thousands of words in language modeling. One of the solutions is to equip the model…

Computation and Language · Computer Science 2022-04-27 Haozhe Ji , Rongsheng Zhang , Zhenyu Yang , Zhipeng Hu , Minlie Huang