中文
相关论文

相关论文: From Single to Multi-Granularity: Toward Long-Term…

200 篇论文

Large Language Models (LLMs) have quickly become an invaluable assistant for a variety of tasks. However, their effectiveness is constrained by their ability to tailor responses to human preferences and behaviors via personalization. Prior…

计算与语言 · 计算机科学 2024-11-21 Lucie Charlotte Magister , Katherine Metcalf , Yizhe Zhang , Maartje ter Hoeve

Memory is a central capability for LLM agents operating across long-horizon tasks. Existing memory benchmarks predominantly evaluate retention of personalized information in multi-turn chat scenarios, overlooking the dynamic memory…

Large language models (LLMs) exhibit enhanced capabilities in language understanding and generation. By utilizing their embedded knowledge, LLMs are increasingly used as conversational recommender systems (CRS), achieving improved…

信息检索 · 计算机科学 2026-04-14 Zhenrui Yue , Honglei Zhuang , Zhen Qin , Zhankui He , Huimin Zeng , Julian McAuley , Dong Wang

Large Language Models (LLMs) struggle to handle long input sequences due to high memory and runtime costs. Memory-augmented models have emerged as a promising solution to this problem, but current methods are hindered by limited memory…

计算与语言 · 计算机科学 2024-02-22 Zexue He , Leonid Karlinsky , Donghyun Kim , Julian McAuley , Dmitry Krotov , Rogerio Feris

Transformers have a quadratic scaling of computational complexity with input size, which limits the input context window size of large language models (LLMs) in both training and inference. Meanwhile, retrieval-augmented generation (RAG)…

计算与语言 · 计算机科学 2024-10-18 Yimin Tang , Yurong Xu , Ning Yan , Masood Mortazavi

Retrieval-augmented generation (RAG) is a promising method for addressing some of the memory-related challenges associated with Large Language Models (LLMs). Two separate systems form the RAG pipeline, the retriever and the reader, and the…

计算与语言 · 计算机科学 2024-11-13 Alexandria Leto , Cecilia Aguerrebere , Ishwar Bhati , Ted Willke , Mariano Tepper , Vy Ai Vo

LLM agents lack persistent memory, causing conversations to reset each session and preventing personalization over time. We present Lyzr Cognis, a unified memory architecture for conversational AI agents that addresses this limitation…

计算与语言 · 计算机科学 2026-04-23 Parshva Daftari , Khush Patel , Shreyas Kapale , Jithin George , Siva Surendira

Large language models (LLMs) have made significant advances in the field of natural language processing, but they still face challenges such as continuous decision-making, lack of long-term memory, and limited context windows in dynamic…

Large Language Models (LLMs) have exhibited remarkable proficiency in comprehending and generating natural language. On the other hand, personalized LLM response generation holds the potential to offer substantial benefits for individuals…

计算与语言 · 计算机科学 2025-01-15 Kai Zhang , Yejin Kim , Xiaozhong Liu

Nowadays, Large Language Models (LLMs) have been trained using extended context lengths to foster more creative applications. However, long context training poses great challenges considering the constraint of GPU memory. It not only leads…

Large Language Model (LLM) agents require persistent memory to maintain personalization, factual continuity, and long-horizon reasoning, yet standard context-window and retrieval-augmented generation (RAG) pipelines degrade over…

人工智能 · 计算机科学 2026-04-07 Shu Wang , Edwin Yu , Oscar Love , Tom Zhang , Tom Wong , Steve Scargall , Charles Fan

In the current field of agent memory, extensive explorations have been conducted in the area of memory retrieval, yet few studies have focused on exploring the memory content. Most research simply stores summarized versions of historical…

人工智能 · 计算机科学 2026-05-11 Gaoke Zhang , Bo Wang , Yunlong Ma , Dongming Zhao , Zifei Yu

Self-evolving memory serves as the trainable parameters for Large Language Models (LLMs)-based agents, where extraction (distilling insights from experience) and management (updating the memory bank) must be tightly coordinated. Existing…

计算与语言 · 计算机科学 2026-02-12 Yongshi Ye , Hui Jiang , Feihu Jiang , Tian Lan , Yichao Du , Biao Fu , Xiaodong Shi , Qianghuai Jia , Longyue Wang , Weihua Luo

Large Language Models (LLMs) based agents excel at diverse tasks, yet they suffer from brittle procedural memory that is manually engineered or entangled in static parameters. In this work, we investigate strategies to endow agents with a…

计算与语言 · 计算机科学 2026-04-16 Runnan Fang , Yuan Liang , Xiaobin Wang , Jialong Wu , Shuofei Qiao , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang

There has recently been growing interest in conversational agents with long-term memory which has led to the rapid development of language models that use retrieval-augmented generation (RAG). Until recently, most work on RAG has focused on…

计算与语言 · 计算机科学 2024-06-06 Nick Alonso , Tomás Figliolia , Anthony Ndirango , Beren Millidge

Memory is essential for large vision-language models (LVLMs) to handle long, multimodal interactions, with two method directions providing this capability: long-context LVLMs and memory-augmented agents. However, no existing benchmark…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Xiyu Ren , Zhaowei Wang , Yiming Du , Zhongwei Xie , Chi Liu , Xinlin Yang , Haoyue Feng , Wenjun Pan , Tianshi Zheng , Baixuan Xu , Zhengnan Li , Yangqiu Song , Ginny Wong , Simon See

Since individuals may struggle to recall all life details and often confuse events, establishing a system to assist users in recalling forgotten experiences is essential. While numerous studies have proposed memory recall systems, these…

计算与语言 · 计算机科学 2026-02-26 Chia Cheng Chang , An-Zi Yen , Hen-Hsen Huang , Hsin-Hsi Chen

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by incorporating external, domain-specific data into the generative process. While LLMs are highly capable, they often rely on static, pre-trained datasets, limiting…

人工智能 · 计算机科学 2024-12-10 Aniruddha Salve , Saba Attar , Mahesh Deshmukh , Sayali Shivpuje , Arnab Mitra Utsab

Large Language Models (LLMs) often experience performance degradation during long-running interactions due to increasing context length, memory saturation, and computational overhead. This paper presents an adaptive context compression…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Payal Fofadiya , Sunil Tiwari

Open-domain dialogue systems have seen remarkable advancements with the development of large language models (LLMs). Nonetheless, most existing dialogue systems predominantly focus on brief single-session interactions, neglecting the…

计算与语言 · 计算机科学 2025-02-14 Hao Li , Chenghao Yang , An Zhang , Yang Deng , Xiang Wang , Tat-Seng Chua