English
Related papers

Related papers: Beyond Trajectory Rewards: Step-level Credit Assig…

200 papers

The aim of this paper is to study the reward based policy exploration problem in a supervised learning approach and enable robots to form complex movement trajectories in challenging reward settings and search spaces. For this, the…

Robotics · Computer Science 2020-11-10 M. Tuluhan Akbulut , Utku Bozdogan , Ahmet Tekden , Emre Ugur

We present a novel method for learning hierarchical abstractions that prioritize competing objectives, leading to improved global expected rewards. Our approach employs a secondary rewarding agent with multiple scalar outputs, each…

Machine Learning · Computer Science 2024-12-03 Tofara Moyo

Credit assignment is a core challenge in multi-agent reinforcement learning (MARL), especially in large-scale systems with structured, local interactions. Graph-based Markov decision processes (GMDPs) capture such settings via an influence…

Machine Learning · Computer Science 2026-01-19 Ahmed Rashwan , Keith Briggs , Chris Budd , Lisa Kreusser

As Reinforcement Learning (RL) agents are increasingly deployed in real-world applications, ensuring their behavior is transparent and trustworthy is paramount. A key component of trust is explainability, yet much of the work in Explainable…

Machine Learning · Computer Science 2025-12-09 Clifford F , Devika Jay , Abhishek Sarkar , Satheesh K Perepu , Santhosh G S , Kaushik Dey , Balaraman Ravindran

We present an approach for safe trajectory planning, where a strategic task related to autonomous racing is learned sample-efficient within a simulation environment. A high-level policy, represented as a neural network, outputs a reward…

Robotics · Computer Science 2022-12-06 Rudolf Reiter , Jasper Hoffmann , Joschka Boedecker , Moritz Diehl

Reinforcement learning (RL) often struggles to accomplish a sparse-reward long-horizon task in a complex environment. Goal-conditioned reinforcement learning (GCRL) has been employed to tackle this difficult problem via a curriculum of…

Machine Learning · Computer Science 2023-12-20 Lisheng Wu , Ke Chen

Preference-based reinforcement learning (PbRL) bypasses complex reward engineering by learning rewards directly from human preferences, enabling better alignment with human intentions. However, its effectiveness in multi-stage tasks, where…

Machine Learning · Computer Science 2025-09-30 Yao Luan , Ni Mu , Yiqin Yang , Bo Xu , Qing-Shan Jia

Recent advances in text-to-image (T2I) diffusion model fine-tuning leverage reinforcement learning (RL) to align generated images with learnable reward functions. The existing approaches reformulate denoising as a Markov decision process…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Xinyao Liao , Wei Wei , Xiaoye Qu , Yu Cheng

In many real-world scenarios, an autonomous agent often encounters various tasks within a single complex environment. We propose to build a graph abstraction over the environment structure to accelerate the learning of these tasks. Here,…

Machine Learning · Computer Science 2019-07-02 Wenling Shang , Alex Trott , Stephan Zheng , Caiming Xiong , Richard Socher

Deep Reinforcement Learning (DRL) suffers from uncertainties and inaccuracies in the observation signal in realworld applications. Adversarial attack is an effective method for evaluating the robustness of DRL agents. However, existing…

Machine Learning · Computer Science 2025-01-09 Tianyang Duan , Zongyuan Zhang , Zheng Lin , Yue Gao , Ling Xiong , Yong Cui , Hongbin Liang , Xianhao Chen , Heming Cui , Dong Huang

The ability to plan actions on multiple levels of abstraction enables intelligent agents to solve complex tasks effectively. However, learning the models for both low and high-level planning from demonstrations has proven challenging,…

Artificial Intelligence · Computer Science 2023-05-30 Kalle Kujanpää , Joni Pajarinen , Alexander Ilin

Many score-based active learning methods have been successfully applied to graph-structured data, aiming to reduce the number of labels and achieve better performance of graph neural networks based on predefined score functions. However,…

Machine Learning · Computer Science 2023-04-25 Yinchuan Li , Zhigang Li , Wenqian Li , Yunfeng Shao , Yan Zheng , Jianye Hao

Recent studies on event detection (ED) haveshown that the syntactic dependency graph canbe employed in graph convolution neural net-works (GCN) to achieve state-of-the-art per-formance. However, the computation of thehidden vectors in such…

Computation and Language · Computer Science 2020-10-28 Viet Dac Lai , Tuan Ngo Nguyen , Thien Huu Nguyen

In goal-conditioned reinforcement learning (GCRL), sparse rewards present significant challenges, often obstructing efficient learning. Although multi-step GCRL can boost this efficiency, it can also lead to off-policy biases in target…

Machine Learning · Computer Science 2023-11-30 Lisheng Wu , Ke Chen

Graph Retrieval-Augmented Generation (GraphRAG) has shown great effectiveness in enhancing the reasoning abilities of LLMs by leveraging graph structures for knowledge representation and modeling complex real-world relationships. However,…

Machine Learning · Computer Science 2026-01-28 Chuanyue Yu , Kuo Zhao , Yuhan Li , Heng Chang , Mingjian Feng , Xiangzhe Jiang , Yufei Sun , Jia Li , Yuzhi Zhang , Jianxin Li , Ziwei Zhang

Since the advent of autonomous driving technology, it has experienced remarkable progress over the last decade. However, most existing research still struggles to address the challenges posed by environments where multiple vehicles have to…

Multiagent Systems · Computer Science 2025-08-01 Jing Wang , Yan Jin , Fei Ding , Chongfeng Wei

LLM-based agents have demonstrated strong capabilities in solving complex tasks through multi-step reasoning and tool use. However, existing evaluation protocols primarily focus on task success, overlooking a critical aspect of agent…

Artificial Intelligence · Computer Science 2026-05-29 Minyang Hu , Bo Yang , Zhinuo Zhou , Jiachen Liang , Guo Jiahao , Yiyang Yin , Xiongwei Han

We introduce Agent Process Reward Models (AgentPRM), a simple and scalable framework for training LLM agents to continually improve through interactions. AgentPRM follows a lightweight actor-critic paradigm, using Monte Carlo rollouts to…

Machine Learning · Computer Science 2025-02-17 Sanjiban Choudhury

Existing LLM-based agents have achieved strong performance on held-in tasks, but their generalizability to unseen tasks remains poor. Hence, some recent work focus on fine-tuning the policy model with more diverse tasks to improve the…

Computation and Language · Computer Science 2025-02-26 Yu Xia , Jingru Fan , Weize Chen , Siyu Yan , Xin Cong , Zhong Zhang , Yaxi Lu , Yankai Lin , Zhiyuan Liu , Maosong Sun

Discrete diffusion models have demonstrated great promise in modeling various sequence data, ranging from human language to biological sequences. Inspired by the success of RL in language models, there is growing interest in further…

Machine Learning · Computer Science 2026-02-03 Jiaqi Han , Austin Wang , Minkai Xu , Wenda Chu , Meihua Dang , Haotian Ye , Huayu Chen , Yisong Yue , Stefano Ermon