English
Related papers

Related papers: To Retrieve or To Think? An Agentic Approach for C…

200 papers

Query rewriting is pivotal for enhancing dense retrieval, yet current methods demand large-scale supervised data or suffer from inefficient reinforcement learning (RL) exploration. In this work, we first establish that guiding Large…

Artificial Intelligence · Computer Science 2025-07-29 Teng Wang , Hailei Gong , Changwang Zhang , Jun Wang

Current LLM agents typically lack instance-level context, which comprises concrete facts such as environment structure, system configurations, and local mechanics. Consequently, existing methods are forced to intertwine exploration with…

Computation and Language · Computer Science 2026-01-14 Kuntai Cai , Juncheng Liu , Xianglin Yang , Zhaojie Niu , Xiaokui Xiao , Xing Chen

Sequence generation models for dialogue are known to have several problems: they tend to produce short, generic sentences that are uninformative and unengaging. Retrieval models on the other hand can surface interesting responses, but are…

Computation and Language · Computer Science 2018-09-07 Jason Weston , Emily Dinan , Alexander H. Miller

Humans understand long and complex texts by relying on a holistic semantic representation of the content. This global view helps organize prior knowledge, interpret new information, and integrate evidence dispersed across a document, as…

Computation and Language · Computer Science 2026-05-29 Yuqing Li , Jiangnan Li , Zheng Lin , Ziyan Zhou , Junjie Wu , Weiping Wang , Jie Zhou , Mo Yu

The conventional Retrieval-Augmented Generation (RAG) paradigm of injecting raw retrieved texts into the Large Language Model (LLM)'s context often results in suboptimal integration of retrieved information. This paper proposes to bridge…

Computation and Language · Computer Science 2026-05-05 Sangkwon Park , Donghun Kang , Jisoo Mok , Sungroh Yoon

The advent of large language models (LLMs) has transformed information access and reasoning through open-ended natural language interaction. However, LLMs remain limited by static knowledge, factual hallucinations, and the inability to…

Artificial Intelligence · Computer Science 2025-10-29 Minhua Lin , Zongyu Wu , Zhichao Xu , Hui Liu , Xianfeng Tang , Qi He , Charu Aggarwal , Hui Liu , Xiang Zhang , Suhang Wang

Reasoning-intensive retrieval aims to surface evidence that supports downstream reasoning rather than merely matching topical similarity. This capability is increasingly important for agentic search systems, where retrievers must provide…

Computation and Language · Computer Science 2026-05-06 Yilun Zhao , Jinbiao Wei , Tingyu Song , Siyue Zhang , Chen Zhao , Arman Cohan

Standard language models generate text by selecting tokens from a fixed, finite, and standalone vocabulary. We introduce a novel method that selects context-aware phrases from a collection of supporting documents. One of the most…

Computation and Language · Computer Science 2024-03-19 Bowen Cao , Deng Cai , Leyang Cui , Xuxin Cheng , Wei Bi , Yuexian Zou , Shuming Shi

Retrieval-Augmented Generation (RAG) systems have emerged as a pivotal methodology for enhancing Large Language Models (LLMs) through the dynamic integration of external knowledge. To further improve RAG's flexibility, Agentic RAG…

Information Retrieval · Computer Science 2026-05-19 Hao Sun , Zile Qiao , Bo Wang , Guoxin Chen , Yingyan Hou , Yong Jiang , Pengjun Xie , Fei Huang , Yan Zhang

Generative AI (GenAI) has reshaped software system design by introducing foundation models as pre-trained subsystems that redefine architectures and operations. The emerging challenge is no longer model fine-tuning but context…

Software Engineering · Computer Science 2025-12-08 Xiwei Xu , Robert Mao , Quan Bai , Xuewu Gu , Yechao Li , Liming Zhu

Entity Set Expansion (ESE) is a critical task aiming at expanding entities of the target semantic class described by seed entities. Most existing ESE methods are retrieval-based frameworks that need to extract contextual features of…

Computation and Language · Computer Science 2024-08-06 Shulin Huang , Shirong Ma , Yangning Li , Yinghui Li , Hai-Tao Zheng

Frontier language models have demonstrated strong reasoning and long-horizon tool-use capabilities. However, existing RAG systems fail to leverage these capabilities. They still rely on two paradigms: (1) designing an algorithm that…

Computation and Language · Computer Science 2026-02-04 Mingxuan Du , Benfeng Xu , Chiwei Zhu , Shaohan Wang , Pengyu Wang , Xiaorui Wang , Zhendong Mao

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by conditioning generation on retrieved external documents, but the effect of retrieved context is often non-trivial. In realistic retrieval settings, the retrieved…

Computation and Language · Computer Science 2026-04-17 Samuel Yeh , Sharon Li

New systems employ Machine Learning to sift through large knowledge sources, creating flexible Large Language Models. These models discern context and predict sequential information in various communication forms. Generative AI, leveraging…

Artificial Intelligence · Computer Science 2023-07-19 Ted Selker

The dominant paradigm for improving mathematical reasoning in language models relies on Reinforcement Learning with verifiable rewards. Yet existing methods treat each problem instance in isolation without leveraging the reusable strategies…

Artificial Intelligence · Computer Science 2026-03-20 Yu Li , Rui Miao , Zhengling Qi , Tian Lan

Ensuring truthfulness in large language models (LLMs) remains a critical challenge for reliable text generation. While supervised fine-tuning and reinforcement learning with human feedback have shown promise, they require a substantial…

Machine Learning · Computer Science 2026-03-17 Manh Nguyen , Sunil Gupta , Hung Le

Agentic Retrieval-Augmented Generation (RAG) empowers large language models to autonomously plan and retrieve information for complex problem-solving. However, the development of robust agents is hindered by the scarcity of high-quality…

Computation and Language · Computer Science 2026-01-14 Zhengwei Tao , Bo Li , Jialong Wu , Guochen Yan , Huanyao Zhang , Jiahao Xu , Haitao Mi , Wentao Zhang

Large Language Models (LLMs) showcase remarkable abilities, yet they struggle with limitations such as hallucinations, outdated knowledge, opacity, and inexplicable reasoning. To address these challenges, Retrieval-Augmented Generation…

Computation and Language · Computer Science 2024-10-03 Sourav Verma

Long-horizon tasks that require sustained reasoning and multiple tool interactions remain challenging for LLM agents: small errors compound across steps, and even state-of-the-art models often hallucinate or lose coherence. We identify…

Artificial Intelligence · Computer Science 2025-10-13 Guangya Wan , Mingyang Ling , Xiaoqi Ren , Rujun Han , Sheng Li , Zizhao Zhang

Agentic search -- the task of training agents that iteratively reason, issue queries, and synthesize retrieved information to answer complex questions -- has achieved remarkable progress through reinforcement learning (RL). However,…

Artificial Intelligence · Computer Science 2026-04-23 Hansi Zeng , Liam Collins , Bhuvesh Kumar , Neil Shah , Hamed Zamani