中文
相关论文

相关论文: What Deserves Memory: Adaptive Memory Distillation…

200 篇论文

Humans excel at remembering concrete experiences along spatiotemporal contexts and performing reasoning across those events, i.e., the capacity for episodic memory. In contrast, memory in language agents remains mainly semantic, and current…

Efficient and accurate updating of knowledge stored in Large Language Models (LLMs) is one of the most pressing research challenges today. This paper presents Larimar - a novel, brain-inspired architecture for enhancing LLMs with a…

We propose an algorithm that compresses the critical information of a large dataset into compact addressable memories. These memories can then be recalled to quickly re-train a neural network and recover the performance (instead of storing…

机器学习 · 计算机科学 2022-11-22 Zhiwei Deng , Olga Russakovsky

Memory is critical for LLM-based agents to preserve past observations for future decision-making, where factual memory serves as its foundational part. However, existing approaches to constructing factual memory face several limitations.…

人工智能 · 计算机科学 2026-03-18 Zeyu Zhang , Rui Li , Xiaoyan Zhao , Yang Zhang , Wenjie Wang , Xu Chen , Tat-Seng Chua

Leveraging knowledge from multiple tasks through introducing a small number of task specific parameters into each transformer layer, also known as adapters, receives much attention recently. However, adding an extra fusion layer to…

机器学习 · 计算机科学 2023-12-29 Junjie Wang , Yicheng Chen , Wangshu Zhang , Sen Hu , Teng Xu , Jing Zheng

The recent surge in Multimodal Large Language Models (MLLMs) has showcased their remarkable potential for achieving generalized intelligence by integrating visual understanding into Large Language Models.Nevertheless, the sheer model size…

计算与语言 · 计算机科学 2024-07-30 Shilin Xu , Xiangtai Li , Haobo Yuan , Lu Qi , Yunhai Tong , Ming-Hsuan Yang

Large language models (LLMs) have demonstrated the world with the sparks of artificial general intelligence (AGI). One opinion, especially from some startups working on LLMs, argues that an LLM with nearly unlimited context length can…

计算与语言 · 计算机科学 2024-08-29 Jingbo Shang , Zai Zheng , Jiale Wei , Xiang Ying , Felix Tao , Mindverse Team

A critical challenge remains unresolved as generative AI systems are quickly implemented in various organizational settings. Despite significant advances in memory components such as RAG, vector stores, and LLM agents, these systems still…

人工智能 · 计算机科学 2025-06-09 Kristy Wedel

The statistical study of human memory requires large-scale experiments, involving many stimuli conditions and test subjects. While this approach has proven to be quite fruitful for meaningless material such as random lists of words,…

计算与语言 · 计算机科学 2024-11-26 Antonios Georgiou , Tankut Can , Mikhail Katkov , Misha Tsodyks

Modern recommender systems struggle to effectively utilize the rich, yet high-dimensional and noisy, multi-modal features generated by Large Language Models (LLMs). Treating these features as static inputs decouples them from the core…

信息检索 · 计算机科学 2025-12-02 Jiahao Tian , Zhenkai Wang

Recent works have highlighted the significance of memory mechanisms in LLM-based agents, which enable them to store observed information and adapt to dynamic environments. However, evaluating their memory capabilities still remains…

计算与语言 · 计算机科学 2025-06-30 Haoran Tan , Zeyu Zhang , Chen Ma , Xu Chen , Quanyu Dai , Zhenhua Dong

Large language models (LLMs) have demonstrated exceptional performance in understanding and generating semantic patterns, making them promising candidates for sequential recommendation tasks. However, when combined with conventional…

信息检索 · 计算机科学 2025-05-26 Jiongran Wu , Jiahao Liu , Dongsheng Li , Guangping Zhang , Mingzhe Han , Hansu Gu , Peng Zhang , Li Shang , Tun Lu , Ning Gu

Large Language Models (LLMs) have emerged as foundational infrastructure in the pursuit of Artificial General Intelligence (AGI). Despite their remarkable capabilities in language perception and generation, current LLMs fundamentally lack a…

Deep research agents (DRAs) integrate LLM reasoning with external tools. Memory systems enable DRAs to leverage historical experiences, which are essential for efficient reasoning and autonomous evolution. Existing methods rely on…

人工智能 · 计算机科学 2026-04-21 Jingyang Qiao , Weicheng Meng , Yu Cheng , Zhihang Lin , Zhizhong Zhang , Xin Tan , Jingyu Gong , Kun Shao , Yuan Xie

Statefulness is essential for large language model (LLM) agents to perform long-term planning and problem-solving. This makes memory a critical component, yet its management and evolution remain largely underexplored. Existing evaluations…

Agent memory shapes how Large Language Model (LLM)-powered agents, akin to the human brain, progressively refine themselves through environment interactions. Existing paradigms remain constrained: parametric memory forcibly adjusts model…

计算与语言 · 计算机科学 2025-10-14 Guibin Zhang , Muxin Fu , Shuicheng Yan

Advances in large language models are making personalized AI agents a new research focus. While current agent systems primarily rely on personalized external memory databases to deliver customized experiences, they face challenges such as…

计算与语言 · 计算机科学 2025-11-03 Junfeng Lu , Yueyan Li

A critical component to enabling intelligent reasoning in partially observable environments is memory. Despite this importance, Deep Reinforcement Learning (DRL) agents have so far used relatively simple memory architectures, with the main…

机器学习 · 计算机科学 2017-02-28 Emilio Parisotto , Ruslan Salakhutdinov

Diffusion Language Models (DLMs) offer attractive advantages over Auto-Regressive (AR) models, such as full-attention parallel decoding and flexible generation. However, standard DLM training uses a static, single-step masked prediction…

计算与语言 · 计算机科学 2026-04-14 Zehua Pei , Hui-Ling Zhen , Weizhe Lin , Sinno Jialin Pan , Yunhe Wang , Mingxuan Yuan , Bei Yu

Retrieval-Augmented Generation remains the dominant pattern for giving LLMs persistent memory, but a visible cluster of personal wiki-style memory architectures emerged in April 2026 -- design proposals from Karpathy, MemPalace, and LLM…

人工智能 · 计算机科学 2026-04-15 Stefan Miteski