English
Related papers

Related papers: SuperLocalMemory V3.3: The Living Brain -- Biologi…

200 papers

Recent conversational memory systems invest heavily in LLM-based structuring at ingestion time and learned retrieval policies at query time. We show that neither is necessary. SmartSearch retrieves from raw, unstructured conversation…

Machine Learning · Computer Science 2026-03-17 Jesper Derehag , Carlos Calva , Timmy Ghiurau

Personalized large language models (LLMs) rely on memory retrieval to incorporate user-specific histories, preferences, and contexts. Existing approaches either overload the LLM by feeding all the user's past memory into the prompt, which…

Information Retrieval · Computer Science 2026-03-11 Yingyi Zhang , Junyi Li , Wenlin Zhang , Penyue Jia , Xianneng Li , Yichao Wang , Derong Xu , Yi Wen , Huifeng Guo , Yong Liu , Xiangyu Zhao

We depend on our own memory to encode, store, and retrieve our experiences. However, memory lapses can occur. One promising avenue for achieving memory augmentation is through the use of augmented reality head-mounted displays to capture…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Junxiao Shen , John Dudley , Per Ola Kristensson

Several variants of the Long Short-Term Memory (LSTM) architecture for recurrent neural networks have been proposed since its inception in 1995. In recent years, these networks have become the state-of-the-art models for a variety of…

Neural and Evolutionary Computing · Computer Science 2017-10-05 Klaus Greff , Rupesh Kumar Srivastava , Jan Koutník , Bas R. Steunebrink , Jürgen Schmidhuber

Large language models deployed as autonomous agents face critical memory limitations, lacking selective forgetting mechanisms that lead to either catastrophic forgetting at context boundaries or information overload within them. While human…

Artificial Intelligence · Computer Science 2026-02-09 Lei Wei , Xiao Peng , Xu Dong , Niantao Xie , Bin Wang

Large language models (LLMs) have revolutionized natural language processing tasks. However, their practical deployment is hindered by their immense memory and computation requirements. Although recent post-training quantization (PTQ)…

Machine Learning · Computer Science 2024-03-19 Wenqi Shao , Mengzhao Chen , Zhaoyang Zhang , Peng Xu , Lirui Zhao , Zhiqian Li , Kaipeng Zhang , Peng Gao , Yu Qiao , Ping Luo

Memory-augmented Large Language Models (LLMs) have demonstrated remarkable capability for complex and long-horizon embodied planning. By keeping track of past experiences and environmental states, memory enables LLMs to maintain a global…

Robotics · Computer Science 2026-03-18 Zebin Yang , Tong Xie , Baotong Lu , Shaoshan Liu , Bo Yu , Meng Li

As large language models engage in extended reasoning tasks, they accumulate significant state -- architectural mappings, trade-off decisions, codebase conventions -- within the context window. This understanding is lost when sessions reach…

Software Engineering · Computer Science 2026-02-27 Cosmo Santoni

Memory serves as the pivotal nexus bridging past and future, providing both humans and AI systems with invaluable concepts and experience to navigate complex tasks. Recent research on autonomous agents has increasingly focused on designing…

Computation and Language · Computer Science 2025-12-30 Jiafeng Liang , Hao Li , Chang Li , Jiaqi Zhou , Shixin Jiang , Zekun Wang , Changkai Ji , Zhihao Zhu , Runxuan Liu , Tao Ren , Jinlan Fu , See-Kiong Ng , Xia Liang , Ming Liu , Bing Qin

Long-term memory is a critical challenge for Large Language Model agents, as fixed context windows cannot preserve coherence across extended interactions. Existing memory systems represent conversation history as unstructured embedding…

Computation and Language · Computer Science 2026-04-21 Jinchang Zhu , Jindong Li , Cheng Zhang , Jiahong Liu , Menglin Yang

Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance across diverse applications. However, their computational overhead during deployment remains a critical bottleneck. While Key-Value (KV) caching effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Insu Han , Zeliang Zhang , Zhiyuan Wang , Yifan Zhu , Susan Liang , Jiani Liu , Haiting Lin , Mingjie Zhao , Chenliang Xu , Kun Wan , Wentian Zhao

LLM-based autonomous agents lack persistent procedural memory: they re-derive solutions from scratch even when structurally identical tasks have been solved before. We present APEX-EM, a non-parametric online learning framework that…

Computation and Language · Computer Science 2026-04-06 Pratyay Banerjee , Masud Moshtaghi , Ankit Chadha

Modern retrieval-augmented generation (RAG) systems treat vector embeddings as static, context-free artifacts: an embedding has no notion of when it was created, how trustworthy its source is, or which other embeddings depend on it. This…

Information Retrieval · Computer Science 2026-04-23 Naizhong Xu

Embodied task planning requires agents to execute long-horizon, goal-directed actions in complex 3D environments, where success depends on both immediate perception and accumulated experience across tasks. However, most existing LLM-based…

Robotics · Computer Science 2026-04-21 Xiaoyu Ma , Lianyu Hu , Wenbing Tang , Zixuan Hu , Zeqin Liao , Zhizhen Wu , Yang Liu

Recent memory agents improve LLMs by extracting experiences and conversation history into an external storage. This enables low-overhead context assembly and online memory update without expensive LLM training. However, existing solutions…

Artificial Intelligence · Computer Science 2026-02-27 Xinle Wu , Rui Zhang , Mustafa Anis Hussain , Yao Lu

Large Language Models (LLMs) have emerged as foundational infrastructure in the pursuit of Artificial General Intelligence (AGI). Despite their remarkable capabilities in language perception and generation, current LLMs fundamentally lack a…

Despite the rapid evolution of training paradigms, the decoder backbone of large vision--language models (LVLMs) remains fundamentally rooted in the residual-connection Transformer architecture. Therefore, deciphering the distinct roles of…

Artificial Intelligence · Computer Science 2026-05-08 Gongli Xi , Ye Tian , Mengyu Yang , Huahui Yi , Liang Lin , Xiaoshuai Hao , Kun Wang , Wendong Wang

In large-scale recommender systems, ultra-long user behavior sequences encode rich signals of evolving interests. Extending sequence length generally improves accuracy, but directly modeling such sequences in production is infeasible due to…

Information Retrieval · Computer Science 2025-08-26 Kaiyuan Li , Yongxiang Tang , Yanhua Cheng , Yong Bai , Yanxiang Zeng , Chao Wang , Xialong Liu , Peng Jiang

Small Language Models (SLMs) provide computational advantages in resource-constrained environments, yet memory limitations remain a critical bottleneck for edge device deployment. A substantial portion of SLMs' memory footprint stems from…

Computation and Language · Computer Science 2026-04-21 Hanling Zhang , Yayu Zhou , Tongcheng Fang , Zhihang Yuan , Guohao Dai , Wanli Ouyang , Yu Wang

Training-free Vision-Language Navigation (VLN) agents powered by foundation models can follow instructions and explore 3D environments. However, existing approaches rely on greedy frontier selection and passive spatial memory, leading to…

Robotics · Computer Science 2026-04-03 Xueying Li , Feng Lyu , Hao Wu , Mingliu Liu , Jia-Nan Liu , Guozi Liu