中文
相关论文

相关论文: Learning to Remember: End-to-End Training of Memor…

200 篇论文

Providing timely, consistent, and high-quality feedback in large-scale higher education courses remains a persistent challenge, often constrained by instructor workload and resource limitations. This study presents an LLM-powered, agentic…

计算机与社会 · 计算机科学 2026-01-13 Reza Vatankhah Barenji , Nazila Salimi , Sina Khoshgoftar

Evaluating the abilities of large language models (LLMs) for tasks that require long-term memory and thus long-context reasoning, for example in conversational settings, is hampered by the existing benchmarks, which often lack narrative…

计算与语言 · 计算机科学 2026-02-24 Mohammad Tavakoli , Alireza Salemi , Carrie Ye , Mohamed Abdalla , Hamed Zamani , J Ross Mitchell

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Lifelong learning is essential for intelligent agents operating in dynamic environments. Current large language model (LLM)-based agents, however, remain stateless and unable to accumulate or transfer knowledge over time. Existing…

人工智能 · 计算机科学 2025-06-02 Junhao Zheng , Xidi Cai , Qiuke Li , Duzhen Zhang , ZhongZhi Li , Yingying Zhang , Le Song , Qianli Ma

Large language models (LLMs) have recently demonstrated impressive capabilities in reasoning tasks. Currently, mainstream LLM reasoning frameworks predominantly focus on scaling up inference-time sampling to enhance performance. In…

计算与语言 · 计算机科学 2026-03-24 Hongduan Tian , Xiao Feng , Ziyuan Zhao , Xiangyu Zhu , Rolan Yan , Bo Han

Large Language Models (LLMs) exhibit high reasoning capacity in medical question-answering, but their tendency to produce hallucinations and outdated knowledge poses critical risks in healthcare fields. While Retrieval-Augmented Generation…

计算与语言 · 计算机科学 2026-03-25 Wenhao Wu , Zhentao Tang , Yafu Li , Shixiong Kai , Mingxuan Yuan , Chunlin Chen , Zhi Wang

Large Language Models (LLMs) exhibit remarkable capabilities but are prone to generating inaccurate or hallucinatory responses. This limitation stems from their reliance on vast pretraining datasets, making them susceptible to errors in…

计算与语言 · 计算机科学 2024-04-02 Chi-Min Chan , Chunpu Xu , Ruibin Yuan , Hongyin Luo , Wei Xue , Yike Guo , Jie Fu

Memory-augmented Large Language Models (LLMs) are essential for developing capable, long-term AI agents. Recently, applying Reinforcement Learning (RL) to optimize memory operations, such as extraction, updating, and retrieval, has emerged…

计算与语言 · 计算机科学 2026-04-08 Ziliang Guo , Ziheng Li , Bo Tang , Feiyu Xiong , Zhiyu Li

Retrieval-Augmented Generation (RAG) has emerged as a prominent method for incorporating domain knowledge into Large Language Models (LLMs). While RAG enhances response relevance by incorporating retrieved domain knowledge in the context,…

计算与语言 · 计算机科学 2025-03-28 Kushagra Bhushan , Yatin Nandwani , Dinesh Khandelwal , Sonam Gupta , Gaurav Pandey , Dinesh Raghu , Sachindra Joshi

The statelessness of foundation models bottlenecks agentic systems' ability to continually learn, a core capability for long-horizon reasoning and adaptation. To address this limitation, agentic systems commonly incorporate memory modules…

人工智能 · 计算机科学 2026-02-10 Yiming Xiong , Shengran Hu , Jeff Clune

Current approaches to memory in Large Language Models (LLMs) predominantly rely on static Retrieval-Augmented Generation (RAG), which often results in scattered retrieval and fails to capture the structural dependencies required for complex…

计算与语言 · 计算机科学 2026-02-11 Zhengxuan Lu , Dongfang Li , Yukun Shi , Beilun Wang , Longyue Wang , Baotian Hu

Long-term memory is a critical capability for multimodal large language model (MLLM) agents, particularly in conversational settings where information accumulates and evolves over time. However, existing benchmarks either evaluate…

计算与语言 · 计算机科学 2026-01-08 Yuanchen Bei , Tianxin Wei , Xuying Ning , Yanjun Zhao , Zhining Liu , Xiao Lin , Yada Zhu , Hendrik Hamann , Jingrui He , Hanghang Tong

Large language models (LLMs) excel in question-answering (QA) tasks, and retrieval-augmented generation (RAG) enhances their precision by incorporating external evidence from diverse sources like web pages, databases, and knowledge graphs.…

信息检索 · 计算机科学 2025-04-10 Yikuan Xia , Jiazun Chen , Yirui Zhan , Suifeng Zhao , Weipeng Jiang , Chaorui Zhang , Wei Han , Bo Bai , Jun Gao

Retrieval-augmented generation (RAG) is a promising approach to address the limitations of fixed knowledge in large language models (LLMs). However, current benchmarks for evaluating RAG systems suffer from two key deficiencies: (1) they…

计算与语言 · 计算机科学 2025-01-28 Zehan Qi , Rongwu Xu , Zhijiang Guo , Cunxiang Wang , Hao Zhang , Wei Xu

Retrieval Augmented Generation (RAG) has emerged as a crucial technique for enhancing the accuracy of Large Language Models (LLMs) by incorporating external information. With the advent of LLMs that support increasingly longer context…

机器学习 · 计算机科学 2024-11-07 Quinn Leng , Jacob Portes , Sam Havens , Matei Zaharia , Michael Carbin

To tackle long-context reasoning tasks without the quadratic complexity of standard attention mechanisms, approaches based on agent memory have emerged, which typically maintain a dynamically updated memory when linearly processing document…

计算与语言 · 计算机科学 2026-05-12 Baibei Ji , Xiaoyang Weng , Juntao Li , Zecheng Tang , Yihang Lou , Min Zhang

Single-step retrieval-augmented generation (RAG) provides an efficient way to incorporate external information for simple question answering tasks but struggles with complex questions. Agentic RAG extends this paradigm by replacing…

计算与语言 · 计算机科学 2026-05-08 Yijia Zheng , Marcel Worring

Existing works on long-term open-domain dialogues focus on evaluating model responses within contexts spanning no more than five chat sessions. Despite advancements in long-context large language models (LLMs) and retrieval augmented…

计算与语言 · 计算机科学 2024-02-28 Adyasha Maharana , Dong-Ho Lee , Sergey Tulyakov , Mohit Bansal , Francesco Barbieri , Yuwei Fang

Traditional enterprises face significant challenges in processing business documents, where tasks like extracting transport references from invoices remain largely manual despite their crucial role in logistics operations. While Large…

计算与语言 · 计算机科学 2024-12-23 Jiale Liu , Yifan Zeng , Malte Højmark-Bertelsen , Marie Normann Gadeberg , Huazheng Wang , Qingyun Wu

Large Language Models (LLMs) have recently been widely adopted in conversational agents. However, the increasingly long interactions between users and agents accumulate extensive dialogue records, making it difficult for LLMs with limited…

计算与语言 · 计算机科学 2025-09-30 Derong Xu , Yi Wen , Pengyue Jia , Yingyi Zhang , wenlin zhang , Yichao Wang , Huifeng Guo , Ruiming Tang , Xiangyu Zhao , Enhong Chen , Tong Xu