中文
相关论文

相关论文: Beyond Scalar Rewards: Distributional Reinforcemen…

200 篇论文

This paper addresses the problem of learning control policies for mobile robots, modeled as unknown Markov Decision Processes (MDPs), that are tasked with temporal logic missions, such as sequencing, coverage, or surveillance. The MDP…

机器人学 · 计算机科学 2022-07-13 Yiannis Kantaros

Automated driving at unsignalized intersections is challenging due to complex multi-vehicle interactions and the need to balance safety and efficiency. Model Predictive Control (MPC) offers structured constraint handling through…

机器人学 · 计算机科学 2026-04-16 Saeed Rahmani , Gözde Körpe , Zhenlin , Xu , Bruno Brito , Simeon Craig Calvert , Bart van Arem

We study model-based reinforcement learning (RL) for episodic Markov decision processes (MDP) whose transition probability is parametrized by an unknown transition core with features of state and action. Despite much recent progress in…

机器学习 · 统计学 2024-11-19 Taehyun Hwang , Min-hwan Oh

Inference-time scaling methods rely on Process Reward Models (PRMs), which are often poorly calibrated and overestimate success probabilities. We propose, to our knowledge, the first use of conditional optimal transport for calibrating…

机器学习 · 计算机科学 2026-05-13 Rachel Ma , Dylan Hadfield-Menell , Kristjan Greenewald

We propose a distributional framework for offline Inverse Reinforcement Learning (IRL) that jointly models uncertainty over reward functions and full distributions of returns. Unlike conventional IRL approaches that recover a deterministic…

机器学习 · 计算机科学 2026-05-29 Feiyang Wu , Ye Zhao , Anqi Wu

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

机器人学 · 计算机科学 2024-10-17 Yiannis Kantaros , Jun Wang

In this paper, we propose a Q-learning based decision-making framework to improve the safety and efficiency of Autonomous Vehicles when they encounter other maliciously behaving vehicles while passing through unsignalized intersections. In…

机器人学 · 计算机科学 2024-09-27 Qing Li , Jinxing Hua , Qiuxia Sun

While many real-world problems that might benefit from reinforcement learning, these problems rarely fit into the MDP mold: interacting with the environment is often expensive and specifying reward functions is challenging. Motivated by…

Model-based Reinforcement Learning (RL) is a popular learning paradigm due to its potential sample efficiency compared to model-free RL. However, existing empirical model-based RL approaches lack the ability to explore. This work studies a…

机器学习 · 计算机科学 2021-07-16 Yuda Song , Wen Sun

We consider un-discounted reinforcement learning (RL) in Markov decision processes (MDPs) under temporal drifts, ie, both the reward and state transition distributions are allowed to evolve over time, as long as their respective total…

机器学习 · 计算机科学 2020-05-19 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

Robotic systems operating in dynamic and uncertain environments increasingly require planners that satisfy complex task sequences while adhering to strict temporal constraints. Metric Interval Temporal Logic (MITL) offers a formal and…

机器人学 · 计算机科学 2026-01-05 Zhaoan Wang , Junchao Li , Mahdi Mohammad , Shaoping Xiao

We consider primal-dual-based reinforcement learning (RL) in episodic constrained Markov decision processes (CMDPs) with non-stationary objectives and constraints, which plays a central role in ensuring the safety of RL in time-varying…

机器学习 · 计算机科学 2022-11-22 Yuhao Ding , Javad Lavaei

Learning a predictive model of the mean return, or value function, plays a critical role in many reinforcement learning algorithms. Distributional reinforcement learning (DRL) has been shown to improve performance by modeling the value…

机器学习 · 计算机科学 2025-07-08 Ju-Seung Byun , Andrew Perrault

Safe Reinforcement Learning (Safe RL) aims to train an RL agent to maximize its performance in real-world environments while adhering to safety constraints, as exceeding safety violation limits can result in severe consequences. In this…

机器学习 · 计算机科学 2025-04-07 Hanping Zhang , Yuhong Guo

Optimized control of quantum networks is essential for enabling distributed quantum applications with strict performance requirements. In near-term architectures with constrained hardware, effective control may determine the feasibility of…

It is essential for an automated vehicle in the field to perform discretionary lane changes with appropriate roadmanship - driving safely and efficiently without annoying or endangering other road users - under a wide range of traffic…

机器学习 · 计算机科学 2021-04-20 Songan Zhang , Lu Wen , Huei Peng , H. Eric Tseng

Offline Reinforcement Learning (RL) aims to learn a near-optimal policy from a fixed dataset of transitions collected by another policy. This problem has attracted a lot of attention recently, but most existing methods with strong…

机器学习 · 计算机科学 2023-05-23 Germano Gabbianelli , Gergely Neu , Nneka Okolo , Matteo Papini

We study the estimation of risk-sensitive policies in reinforcement learning problems defined by a Markov Decision Process (MDPs) whose state and action spaces are countably finite. Prior efforts are predominately afflicted by computational…

机器学习 · 统计学 2020-03-02 Junyu Zhang , Amrit Singh Bedi , Mengdi Wang , Alec Koppel

This paper introduces a new scalable multi-objective deep reinforcement learning (MODRL) framework based on deep Q-networks. We develop a high-performance MODRL framework that supports both single-policy and multi-policy strategies, as well…

机器学习 · 计算机科学 2020-09-09 Thanh Thi Nguyen , Ngoc Duy Nguyen , Peter Vamplew , Saeid Nahavandi , Richard Dazeley , Chee Peng Lim

Model predictive control (MPC) is widely used for motion planning, particularly in autonomous driving. Real-time capability of the planner requires utilizing convex approximation of optimal control problems (OCPs) for the planner. However,…

机器人学 · 计算机科学 2025-12-04 Johannes Fischer , Marlon Steiner , Ömer Sahin Tas , Christoph Stiller