English
Related papers

Related papers: Diagnosing Retrieval vs. Utilization Bottlenecks i…

200 papers

Neural retrievers are effective but brittle: underspecified or ambiguous queries can misdirect ranking even when relevant documents exist. Existing approaches address this brittleness only partially: LLMs rewrite queries without retriever…

Information Retrieval · Computer Science 2026-02-13 Moncef Garouani , Josiane Mothe

Effective decision-making in the real world depends on memory that is both stable and adaptive: environments change over time, and agents must retain relevant information over long horizons while also updating or overwriting outdated…

Machine Learning · Computer Science 2026-01-22 Oleg Shchendrigin , Egor Cherepanov , Alexey K. Kovalev , Aleksandr I. Panov

Large Language Model (LLM)-based agents have fundamentally reshaped artificial intelligence by integrating external tools and planning capabilities. While memory mechanisms have emerged as the architectural cornerstone of these systems,…

Artificial Intelligence · Computer Science 2026-05-11 Jinghao Luo , Yuchen Tian , Chuxue Cao , Ziyang Luo , Hongzhan Lin , Kaixin Li , Chuyi Kong , Ruichao Yang , Jing Ma

Large language models (LLMs) deployed in user-facing applications require long-horizon consistency: the ability to remember prior interactions, respect user preferences, and ground reasoning in past events. However, contemporary memory…

Multiagent Systems · Computer Science 2026-02-04 Daivik Patel , Shrenik Patel

Traditional enterprises face significant challenges in processing business documents, where tasks like extracting transport references from invoices remain largely manual despite their crucial role in logistics operations. While Large…

Computation and Language · Computer Science 2024-12-23 Jiale Liu , Yifan Zeng , Malte Højmark-Bertelsen , Marie Normann Gadeberg , Huazheng Wang , Qingyun Wu

We present the first large-scale, cross-domain evaluation of document chunking strategies for dense retrieval, addressing a critical but underexplored aspect of retrieval-augmented systems. In our study, 36 segmentation methods spanning…

Computation and Language · Computer Science 2026-03-10 Muhammad Arslan Shaukat , Muntasir Adnan , Carlos C. N. Kuhn

Automating data extraction from full-text randomised controlled trials (RCTs) for meta-analysis remains a significant challenge. This study evaluates the practical performance of three LLMs (Gemini-2.0-flash, Grok-3, GPT-4o-mini) across…

Computation and Language · Computer Science 2025-07-22 Lingbo Li , Anuradha Mathrani , Teo Susnjak

Memory is fundamental to large language model (LLM)-based agents, but existing surveys emphasize application-level use (e.g., personalized dialogue), while overlooking the atomic operations governing memory dynamics. This work categorizes…

Computation and Language · Computer Science 2025-12-25 Yiming Du , Wenyu Huang , Danna Zheng , Zhaowei Wang , Sebastien Montella , Mirella Lapata , Kam-Fai Wong , Jeff Z. Pan

Large Language Models (LLMs) have demonstrated significant potential as autonomous software engineering (SWE) agents. Recent work has further explored augmenting these agents with memory mechanisms to support long-horizon reasoning.…

Software Engineering · Computer Science 2026-02-26 Kangning Shen , Jingyuan Zhang , Chenxi Sun , Wencong Zeng , Yang Yue

Deep search has recently emerged as a promising paradigm for enabling agents to retrieve fine-grained historical information without heavy memory pre-managed. However, existing deep search agents for memory system repeat past error…

Computation and Language · Computer Science 2026-05-14 Xinyuan Wang , Wenyu Mao , Junkang Wu , Xiang Wang , Xiangnan He

One of the key factors influencing the reasoning capabilities of LLM-based agents is their ability to leverage long-term memory. Integrating long-term memory mechanisms allows agents to make informed decisions grounded in historical…

Computation and Language · Computer Science 2025-10-14 Haoran Sun , Zekun Zhang , Shaoning Zeng

As LLM agents scale to long-horizon, multi-session deployments, efficiently managing accumulated experience becomes a critical bottleneck. Agent memory systems and agent skill discovery both address this challenge -- extracting reusable…

Artificial Intelligence · Computer Science 2026-04-20 Xing Zhang , Guanghui Wang , Yanwei Cui , Wei Qiu , Ziyuan Li , Bing Zhu , Peiyang He

We envision a continuous collaborative learning system where groups of LLM agents work together to solve reasoning problems, drawing on memory they collectively build to improve performance as they gain experience. This work establishes the…

Artificial Intelligence · Computer Science 2025-03-11 Julie Michelman , Nasrin Baratalipour , Matthew Abueg

Large Language Model (LLM) agents are increasingly expected to maintain coherent, long-term personalized memory, yet current benchmarks primarily measure static fact retrieval, overlooking the ability to revise stored beliefs when new…

Computation and Language · Computer Science 2026-05-08 Hanxiang Chao , Yihan Bai , Rui Sheng , Tianle Li , Yushi Sun

Large language model agents are becoming increasingly capable at web-centric tasks such as information retrieval, complex reasoning. These emerging capabilities have given rise to surge research interests in developing LLM agent for…

Computation and Language · Computer Science 2026-04-02 Yu Li , Lehui Li , Lin Chen , Qingmin Liao , Fengli Xu , Yong Li

Retrieval-Augmented Generation (RAG) is often used with Large Language Models (LLMs) to infuse domain knowledge or user-specific information. In RAG, given a user query, a retriever extracts chunks of relevant text from a knowledge base.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-25 Shubham Agarwal , Sai Sundaresan , Subrata Mitra , Debabrata Mahapatra , Archit Gupta , Rounak Sharma , Nirmal Joshua Kapu , Tong Yu , Shiv Saini

Sample efficiency is a fundamental challenge in de novo molecular design. Ideally, molecular generative models should learn to satisfy a desired objective under minimal oracle evaluations (computational prediction or wet-lab experiment).…

Biomolecules · Quantitative Biology 2023-05-26 Jeff Guo , Philippe Schwaller

Memory, additional information beyond the training of large language models (LLMs), is crucial to various real-world applications, such as personal assistant. The two mainstream solutions to incorporate memory into the generation process…

Computation and Language · Computer Science 2025-03-21 Jiale Wei , Shuchi Wu , Ruochen Liu , Xiang Ying , Jingbo Shang , Fangbo Tao

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by retrieving relevant memories from an external database. However, existing RAG methods typically organize all memories in a whole database, potentially limiting…

Computation and Language · Computer Science 2024-05-28 Zheng Wang , Shu Xian Teo , Jieer Ouyang , Yongjun Xu , Wei Shi

Autonomous LLM agents increasingly operate in long-horizon, interactive settings where success depends on reusing experience accumulated over extended histories. However, existing agent memory systems are fundamentally constrained by…

Computation and Language · Computer Science 2026-04-30 Jinze Li , Yang Zhang , Xin Yang , Jiayi Qu , Jinfeng Xu , Shuo Yang , Junhua Ding , Edith Cheuk-Han Ngai