English
Related papers

Related papers: Evaluate-as-Action: Self-Evaluated Process Rewards…

200 papers

We introduce Recursive Agent Optimization (RAO), a reinforcement learning approach for training recursive agents: agents that can spawn and delegate sub-tasks to new instantiations of themselves recursively. Recursive agents implement an…

Machine Learning · Computer Science 2026-05-08 Apurva Gandhi , Satyaki Chakraborty , Xiangjun Wang , Aviral Kumar , Graham Neubig

In Retrieval-Augmented Generation (RAG), retrieval is not always helpful and applying it to every instruction is sub-optimal. Therefore, determining whether to retrieve is crucial for RAG, which is usually referred to as Active Retrieval.…

Computation and Language · Computer Science 2024-10-04 Qinyuan Cheng , Xiaonan Li , Shimin Li , Qin Zhu , Zhangyue Yin , Yunfan Shao , Linyang Li , Tianxiang Sun , Hang Yan , Xipeng Qiu

In this paper, we propose an enhanced approach for Rapid Exploration and eXploitation for AI Agents called REX. Existing AutoGPT-style techniques have inherent limitations, such as a heavy reliance on precise descriptions for…

Aligning multimodal generative models with human preferences demands reward signals that respect the compositional, multi-dimensional structure of human judgment. Prevailing RLHF approaches reduce this structure to scalar or pairwise…

Artificial Intelligence · Computer Science 2026-05-12 Juanxi Tian , Fengyuan Liu , Jiaming Han , Yilei Jiang , Yongliang Wu , Yesheng Liu , Haodong Li , Furong Xu , Wanhua Li

Reinforcement Learning with Verifiable Rewards (RLVR) has improved the reasoning abilities of Large Language Models (LLMs) by using rule-based binary feedback. However, current RLVR methods typically assign the same reward to every token.…

Machine Learning · Computer Science 2025-10-21 Guofu Xie , Yunsheng Shi , Hongtao Tian , Ting Yao , Xiao Zhang

Large language models (LLMs) are increasingly developed as autonomous agents using reinforcement learning (agentic RL) that reason and act in interactive environments. However, sparse and sometimes unverifiable rewards make it extremely…

Computation and Language · Computer Science 2025-09-30 Xiaoqian Liu , Ke Wang , Yuchuan Wu , Fei Huang , Yongbin Li , Junge Zhang , Jianbin Jiao

Search systems often employ a re-ranking pipeline, wherein documents (or passages) from an initial pool of candidates are assigned new ranking scores. The process enables the use of highly-effective but expensive scoring functions that are…

Information Retrieval · Computer Science 2022-08-19 Sean MacAvaney , Nicola Tonellotto , Craig Macdonald

Active learning strategies respond to the costly labelling task in a supervised classification by selecting the most useful unlabelled examples in training a predictive model. Many conventional active learning algorithms focus on refining…

Machine Learning · Computer Science 2014-08-12 Djallel Bouneffouf

Agentic search -- the task of training agents that iteratively reason, issue queries, and synthesize retrieved information to answer complex questions -- has achieved remarkable progress through reinforcement learning (RL). However,…

Artificial Intelligence · Computer Science 2026-04-23 Hansi Zeng , Liam Collins , Bhuvesh Kumar , Neil Shah , Hamed Zamani

Experience replay enables reinforcement learning agents to memorize and reuse past experiences, just as humans replay memories for the situation at hand. Contemporary off-policy algorithms either replay past experiences uniformly or utilize…

Machine Learning · Computer Science 2019-06-21 Daochen Zha , Kwei-Herng Lai , Kaixiong Zhou , Xia Hu

Reinforcement Learning with Verifiable Rewards has recently advanced the capabilities of Large Language Models in complex reasoning tasks by providing explicit rule-based supervision. Among RLVR methods, GRPO and its variants have achieved…

Machine Learning · Computer Science 2026-03-11 Zepeng Zhai , Meilin Chen , Jiaxuan Zhao , Junlang Qian , Lei Shen , Yuan Lu

Retrieval augmented generation (RAG) reduces hallucinations and factual errors in large language models (LLMs) by conditioning generation on retrieved external knowledge. Recent search agents further cast RAG as an autonomous, multi-turn…

Computation and Language · Computer Science 2026-03-05 Jian Li , Yizhang Jin , Dongqi Liu , Hang Ding , Jiafu Wu , Dongsheng Chen , Yunhang Shen , Yulei Qin , Ying Tai , Chengjie Wang , Xiaotong Yuan , Yabiao Wang

Reinforcement learning algorithms often suffer from slow convergence due to sparse reward signals, particularly in complex environments where feedback is delayed or infrequent. This paper introduces the Psychological Regret Model (PRM), a…

Machine Learning · Computer Science 2026-02-04 Zhe Xu

Agentic retrieval-augmented generation (RAG) formulates question answering as a multi-step interaction between reasoning and information retrieval, and has recently been advanced by reinforcement learning (RL) with outcome-based…

Computation and Language · Computer Science 2026-01-13 Tianhua Zhang , Kun Li , Junan Li , Yunxiang Li , Hongyin Luo , Xixin Wu , James Glass , Helen Meng

Exploration in environments with sparse feedback remains a challenging research problem in reinforcement learning (RL). When the RL agent explores the environment randomly, it results in low exploration efficiency, especially in robotic…

Robotics · Computer Science 2020-11-19 Boyao Li , Tao Lu , Jiayi Li , Ning Lu , Yinghao Cai , Shuo Wang

Reinforcement Learning (RL) has emerged as a powerful paradigm for advancing Large Language Models (LLMs), achieving remarkable performance in complex reasoning domains such as mathematics and code generation. However, current RL methods…

Machine Learning · Computer Science 2025-12-10 Jingyu Xing , Chenwei Tang , Xinyu Liu , Deng Xiong , Shudong Huang , Wei Ju , Jiancheng Lv , Ziyue Qiao

Retrieval-augmented generation (RAG) has been extensively employed to mitigate hallucinations in large language models (LLMs). However, existing methods for multi-hop reasoning tasks often lack global planning, increasing the risk of…

Computation and Language · Computer Science 2025-11-14 Yijie Zhu , Haojie Zhou , Wanting Hong , Tailin Liu , Ning Wang

Multi-hop question answering (QA) requires systems to iteratively retrieve evidence and reason across multiple hops. While recent RAG and agentic methods report strong results, the underlying retrieval--reasoning \emph{process} is often…

Computation and Language · Computer Science 2026-01-05 Yuelyu Ji , Zhuochun Li , Rui Meng , Daqing He

Reinforcement Learning with Verifiable Rewards (RLVR) is widely used to improve reasoning in large language models, but rewards only final-answer correctness with no supervision over intermediate steps. Rubric-based methods such as Rubrics…

Many continuous control tasks have easily formulated objectives, yet using them directly as a reward in reinforcement learning (RL) leads to suboptimal policies. Therefore, many classical control tasks guide RL training using complex…

Machine Learning · Computer Science 2019-05-21 Aleksandra Faust , Anthony Francis , Dar Mehta