English
Related papers

Related papers: Beyond Trajectory Rewards: Step-level Credit Assig…

200 papers

Traditional model-based reinforcement learning approaches learn a model of the environment dynamics without explicitly considering how it will be used by the agent. In the presence of misspecified model classes, this can lead to poor…

Machine Learning · Computer Science 2020-10-20 Pierluca D'Oro , Alberto Maria Metelli , Andrea Tirinzoni , Matteo Papini , Marcello Restelli

While Reinforcement Learning with Verifiable Rewards (RLVR) enhances complex reasoning in LLMs, current methods struggle to balance exploration and exploitation. This leads to critical issues like inaccurate credit assignment for…

Machine Learning · Computer Science 2025-10-13 Junxi Yin , Haisen Luo , Zhenyu Li , Yihua Liu , Dan Liu , Zequn Li , Xiaohang Xu

Learning to solve complex goal-oriented tasks with sparse terminal-only rewards often requires an enormous number of samples. In such cases, using a set of expert trajectories could help to learn faster. However, Imitation Learning (IL) via…

Machine Learning · Computer Science 2019-11-19 Sujoy Paul , Jeroen van Baar , Amit K. Roy-Chowdhury

For effective real-world deployment, robots should adapt to human preferences, such as balancing distance, time, and safety in delivery routing. Active preference learning (APL) learns human reward functions by presenting trajectories for…

Robotics · Computer Science 2025-07-09 Yi-Shiuan Tung , Bradley Hayes , Alessandro Roncone

Agentic reinforcement learning (Agentic RL) has achieved strong progress in tasks with clear success signals. However, many real-world agent applications require user-conditioned behavior: the same query may call for different planning…

Computation and Language · Computer Science 2026-05-25 Ranxu zhang , zeyang li , Jiacheng Huang , Rui Zhang , Xiaozhou Xu , sun zhe , Yanyong Zhang , Chao Wang

Reinforcement Learning (RL) serves as a potent paradigm for enhancing reasoning capabilities in Large Language Models (LLMs), yet standard outcome-based approaches often suffer from reward sparsity and inefficient credit assignment. In this…

Artificial Intelligence · Computer Science 2026-02-03 Xiangwei Wang , Wei Wang , Ken Chen , Nanduni Nimalsiri , Saman Halgamuge

Cooperative trajectory planning methods for automated vehicles can solve traffic scenarios that require a high degree of cooperation between traffic participants. However, for cooperative systems to integrate into human-centered traffic,…

Machine Learning · Computer Science 2022-11-15 Karl Kurzer , Matthias Bitzer , J. Marius Zöllner

Reinforcement Learning (RL) has the potential to enable robots to learn from their own actions in the real world. Unfortunately, RL can be prohibitively expensive, in terms of on-robot runtime, due to inefficient exploration when learning…

Agentic search enables language models to solve knowledge-intensive tasks by adaptively acquiring external evidence over multiple steps. Reinforcement learning with verifiable rewards (RLVR) has emerged as a widely adopted training paradigm…

Artificial Intelligence · Computer Science 2026-05-26 Erhan Zhang , Yiqun Chen , Zechun Niu , Wei Yang , Xiaochi Wei , Yan Gao , Yi Wu , Yao Hu , Jiaxin Mao

In graph-structured multi-agent reinforcement learning (MARL) adversarial tasks such as pursuit and confrontation, agents must coordinate under highly dynamic interactions, where sparse rewards hinder efficient policy learning. We propose…

Machine Learning · Computer Science 2025-11-12 Ruochuan Shi , Runyu Lu , Yuanheng Zhu , Dongbin Zhao

Graph Retrieval-Augmented Generation (GraphRAG) enhances factual reasoning in LLMs by structurally modeling knowledge through graph-based representations. However, existing GraphRAG approaches face two core limitations: shallow retrieval…

Computation and Language · Computer Science 2025-10-01 Cehao Yang , Xiaojun Wu , Xueyuan Lin , Chengjin Xu , Xuhui Jiang , Yuanliang Sun , Jia Li , Hui Xiong , Jian Guo

Language agents have become a promising solution to complex interactive tasks. One of the key ingredients to the success of language agents is the reward model on the trajectory of the agentic workflow, which provides valuable guidance…

Machine Learning · Computer Science 2025-02-05 Zongyu Lin , Yao Tang , Xingcheng Yao , Da Yin , Ziniu Hu , Yizhou Sun , Kai-Wei Chang

General agents have given rise to phenomenal applications such as OpenClaw and Claude Code. As these agent systems (a.k.a. Harnesses) strive for bolder goals, they demand increasingly stronger agentic capabilities from foundation Large…

Computation and Language · Computer Science 2026-04-21 Daoyu Wang , Qingchuan Li , Mingyue Cheng , Jie Ouyang , Shuo Yu , Qi Liu , Enhong Chen

We present PROGRESSOR, a novel framework that learns a task-agnostic reward function from videos, enabling policy training through goal-conditioned reinforcement learning (RL) without manual supervision. Underlying this reward is an…

Robotics · Computer Science 2024-11-28 Tewodros Ayalew , Xiao Zhang , Kevin Yuanbo Wu , Tianchong Jiang , Michael Maire , Matthew R. Walter

Reinforcement learning (RL) shows great potential for optimizing multi-vehicle cooperative driving strategies through the state-action-reward feedback loop, but it still faces challenges such as low sample efficiency. This paper proposes a…

Artificial Intelligence · Computer Science 2025-08-12 Ye Han , Lijun Zhang , Dejian Meng , Zhuang Zhang

Consider an agent exploring an unknown graph in search of some goal state. As it walks around the graph, it learns the nodes and their neighbors. The agent only knows where the goal state is when it reaches it. How do we reach this goal…

Data Structures and Algorithms · Computer Science 2023-01-02 Siddhartha Banerjee , Vincent Cohen-Addad , Anupam Gupta , Zhouzi Li

Search agents extend Large Language Models (LLMs) beyond static parametric knowledge by enabling access to up-to-date and long-tail information unavailable during pretraining. While reinforcement learning has been widely adopted for…

Machine Learning · Computer Science 2026-04-21 Junzhe Wang , Zhiheng Xi , Yajie Yang , Hao Luo , Shihan Dou , Tao Gui , Qi Zhang

Monte Carlo Tree Search (MCTS) methods have proven powerful in planning for sequential decision-making problems such as Go and video games, but their performance can be poor when the planning depth and sampling trajectories are limited or…

Artificial Intelligence · Computer Science 2016-04-26 Xiaoxiao Guo , Satinder Singh , Richard Lewis , Honglak Lee

Reinforcement Learning with Verifiable Rewards (RLVR), particularly with algorithms like Group Relative Policy Optimization (GRPO), has proven highly effective in enhancing the reasoning capabilities of large language models. However, a…

Computation and Language · Computer Science 2026-03-03 Shangyu Xing , Siyuan Wang , Chenyuan Yang , Xinyu Dai , Xiang Ren

Recent advancements adopt online reinforcement learning (RL) from LLMs to text-to-image rectified flow diffusion models for reward alignment. The use of group-level rewards successfully aligns the model with the targeted reward. However, it…

Machine Learning · Computer Science 2026-01-06 Yiyang Wang , Xi Chen , Xiaogang Xu , Yu Liu , Hengshuang Zhao
‹ Prev 1 3 4 5 6 7 10 Next ›