English
Related papers

Related papers: Evaluate-as-Action: Self-Evaluated Process Rewards…

200 papers

Large language model agents have exhibited exceptional performance across a range of complex interactive tasks. Recent approaches have utilized tuning with expert trajectories to enhance agent performance, yet they primarily concentrate on…

Computation and Language · Computer Science 2024-09-26 Weimin Xiong , Yifan Song , Xiutian Zhao , Wenhao Wu , Xun Wang , Ke Wang , Cheng Li , Wei Peng , Sujian Li

Retrieval-augmented generation (RAG) has proven to be effective in mitigating hallucinations in large language models, yet its effectiveness remains limited in complex, multi-step reasoning scenarios. Recent efforts have incorporated…

Computation and Language · Computer Science 2025-12-29 Wenda Wei , Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Lixin Su , Shuaiqiang Wang , Dawei Yin , Maarten de Rijke , Xueqi Cheng

Proactive task-oriented agents must autonomously anticipate user needs, identify actionable opportunities, and trigger software actions at appropriate moments - fundamentally shifting from reactive systems that await explicit instructions.…

Artificial Intelligence · Computer Science 2026-05-26 Lei Ding , Bin He , Chenguang Wang , Yang Liu

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by incorporating external knowledge, yet traditional single-round retrieval struggles with complex multi-step reasoning. Agentic RAG addresses this by enabling LLMs…

Computation and Language · Computer Science 2026-02-27 Tianle Xia , Ming Xu , Lingxiang Hu , Yiding Sun , Wenwei Li , Linfang Shang , Liqun Liu , Peng Shu , Huan Yu , Jie Jiang

Retrieval-Augmented Generation (RAG) systems rely on retrieving relevant evidence from a corpus to support downstream generation. The common practice of splitting a long document into multiple shorter passages enables finer-grained and…

Computation and Language · Computer Science 2026-02-26 Ye Yuan , Mohammad Amin Shabani , Siqi Liu

Large language model alignment via reinforcement learning depends critically on reward function quality. However, static, domain-specific reward models are often costly to train and exhibit poor generalization in out-of-distribution…

Computation and Language · Computer Science 2026-03-03 Andrew Zhuoer Feng , Cunxiang Wang , Bosi Wen , Yidong Wang , Yu Luo , Hongning Wang , Minlie Huang

Long-term engagement is preferred over immediate engagement in sequential recommendation as it directly affects product operational metrics such as daily active users (DAUs) and dwell time. Meanwhile, reinforcement learning (RL) is widely…

Information Retrieval · Computer Science 2023-06-19 Wanqi Xue , Qingpeng Cai , Ruohan Zhan , Dong Zheng , Peng Jiang , Kun Gai , Bo An

We propose a new method to measure the task-specific accuracy of Retrieval-Augmented Large Language Models (RAG). Evaluation is performed by scoring the RAG on an automatically-generated synthetic exam composed of multiple choice questions…

Computation and Language · Computer Science 2024-05-24 Gauthier Guinet , Behrooz Omidvar-Tehrani , Anoop Deoras , Laurent Callot

Agentic search enables language models to solve knowledge-intensive tasks by adaptively acquiring external evidence over multiple steps. Reinforcement learning with verifiable rewards (RLVR) has emerged as a widely adopted training paradigm…

Artificial Intelligence · Computer Science 2026-05-26 Erhan Zhang , Yiqun Chen , Zechun Niu , Wei Yang , Xiaochi Wei , Yan Gao , Yi Wu , Yao Hu , Jiaxin Mao

Reinforcement Learning with Verifiable Rewards (RLVR) has become a central post-training paradigm for improving the reasoning capabilities of large language models. Yet existing methods share a common blind spot: they optimize policies…

Machine Learning · Computer Science 2026-04-29 Huaiyang Wang , Xiaojie Li , Deqing Wang , Haoyi Zhou , Zixuan Huang , Yaodong Yang , Jianxin Li , Yikun Ban

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for complex reasoning tasks with clear correctness signals such as math and coding. However, extending it to real-world reasoning tasks is challenging, as evaluation…

Machine Learning · Computer Science 2025-10-06 Anisha Gunjal , Anthony Wang , Elaine Lau , Vaskar Nath , Yunzhong He , Bing Liu , Sean Hendryx

While Reinforcement Learning with Verifiable Rewards (RLVR) enhances complex reasoning in LLMs, current methods struggle to balance exploration and exploitation. This leads to critical issues like inaccurate credit assignment for…

Machine Learning · Computer Science 2025-10-13 Junxi Yin , Haisen Luo , Zhenyu Li , Yihua Liu , Dan Liu , Zequn Li , Xiaohang Xu

To achieve general-purpose utility, we argue that robots must evolve from passive executors into active Information Retrieval users. In strictly zero-shot settings where no prior demonstrations exist, robots face a critical information gap,…

Artificial Intelligence · Computer Science 2026-03-04 Izat Temiraliev , Diji Yang , Yi Zhang

Long-context Large Language Models, despite their expanded capacity, require careful working memory management to mitigate attention dilution during long-horizon tasks. Yet existing approaches rely on external mechanisms that lack awareness…

Artificial Intelligence · Computer Science 2026-05-08 Yuxiang Zhang , Jiangming Shu , Ye Ma , Xueyuan Lin , Shangxi Wu , Jitao Sang

Retrieval-augmented generation (RAG) grounds large language models (LLMs) in up-to-date external evidence, yet existing multi-hop RAG pipelines still issue redundant subqueries, explore too shallowly, or wander through overly long search…

Computation and Language · Computer Science 2025-05-26 Yuelyu Ji , Rui Meng , Zhuochun Li , Daqing He

Language agents have become a promising solution to complex interactive tasks. One of the key ingredients to the success of language agents is the reward model on the trajectory of the agentic workflow, which provides valuable guidance…

Machine Learning · Computer Science 2025-02-05 Zongyu Lin , Yao Tang , Xingcheng Yao , Da Yin , Ziniu Hu , Yizhou Sun , Kai-Wei Chang

Evaluating retrieval-augmented generation (RAG) presents challenges, particularly for retrieval models within these systems. Traditional end-to-end evaluation methods are computationally expensive. Furthermore, evaluation of the retrieval…

Computation and Language · Computer Science 2024-04-23 Alireza Salemi , Hamed Zamani

Reinforcement learning (RL) in long horizon and sparse reward tasks is notoriously difficult and requires a lot of training steps. A standard solution to speed up the process is to leverage additional reward signals, shaping it to better…

Computation and Language · Computer Science 2022-10-14 Thomas Carta , Pierre-Yves Oudeyer , Olivier Sigaud , Sylvain Lamprier

Reinforcement learning (RL) has become a promising paradigm for optimizing Retrieval-Augmented Generation (RAG) in complex reasoning tasks. However, traditional outcome-based RL approaches often suffer from reward sparsity and inefficient…

Artificial Intelligence · Computer Science 2026-01-30 Zhao Wang , Ziliang Zhao , Zhicheng Dou

ReAct-style agents for search-intensive, multi-step reasoning tasks rely largely on their own internal judgment to decide what evidence to seek, which reasoning or action step to take next, and when to stop, often producing shallow,…

Artificial Intelligence · Computer Science 2026-05-25 Jiazheng Kang , Bowen Zhang , Zixin Song , Jiangwang Chen , Xiao Yang , Da Zhu , Guanjun Jiang