中文
相关论文

相关论文: Constraint-Conditioned Policy Optimization for Ver…

200 篇论文

We provide a framework for incorporating robustness -- to perturbations in the transition dynamics which we refer to as model misspecification -- into continuous control Reinforcement Learning (RL) algorithms. We specifically focus on…

Reinforcement learning (RL)-based driver assistance systems seek to improve fuel consumption via continual improvement of powertrain control actions considering experiential data from the field. However, the need to explore diverse…

机器人学 · 计算机科学 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

Reinforcement learning (RL) in continuous state-action spaces remains challenging in scientific computing due to poor sample efficiency and lack of pathwise physical consistency. We introduce Differential Reinforcement Learning…

机器学习 · 计算机科学 2026-02-06 Minh Nguyen , Chandrajit Bajaj

Reinforcement learning (RL) has emerged as a promising paradigm in complex and continuous robotic tasks, however, safe exploration has been one of the main challenges, especially in contact-rich manipulation tasks in unstructured…

机器人学 · 计算机科学 2024-06-21 Heng Zhang , Gokhan Solak , Gustavo J. G. Lahr , Arash Ajoudani

In safe Reinforcement Learning (RL), safety cost is typically defined as a function dependent on the immediate state and actions. In practice, safety constraints can often be non-Markovian due to the insufficient fidelity of state…

机器学习 · 计算机科学 2024-05-07 Siow Meng Low , Akshat Kumar

Determining the optimal cost function parameters of Model Predictive Control (MPC) to optimize multiple control objectives is a challenging and time-consuming task. Multiobjective Bayesian Optimization (BO) techniques solve this problem by…

机器人学 · 计算机科学 2024-02-06 Baha Zarrouki , Marios Spanakakis , Johannes Betz

Dynamic real-time optimization (DRTO) is a challenging task due to the fact that optimal operating conditions must be computed in real time. The main bottleneck in the industrial application of DRTO is the presence of uncertainty. Many…

Single-task RL agents are typically trained under a fixed reward function, which limits their robustness to reward misspecification and their ability to adapt to changing preferences. We introduce Reward-Conditioned Reinforcement Learning…

机器学习 · 计算机科学 2026-05-20 Michal Nauman , Marek Cygan , Pieter Abbeel

Constrained optimization provides a common framework for dealing with conflicting objectives in reinforcement learning (RL). In most of these settings, the objectives (and constraints) are expressed though the expected accumulated reward.…

机器学习 · 计算机科学 2025-12-03 Jane H. Lee , Baturay Saglam , Spyridon Pougkakiotis , Amin Karbasi , Dionysis Kalogerias

We develop a reinforcement learning (RL) framework for insurance loss reserving that formulates reserve setting as a finite-horizon sequential decision problem under claim development uncertainty, macroeconomic stress, and solvency…

机器学习 · 计算机科学 2026-03-24 Stella C. Dong

Proximal Policy Optimization (PPO) has become the predominant algorithm for on-policy reinforcement learning due to its scalability and empirical robustness across domains. However, there is a significant disconnect between the underlying…

Among the great successes of Reinforcement Learning (RL), self-play algorithms play an essential role in solving competitive games. Current self-play algorithms optimize the agent to maximize expected win-rates against its current or…

机器学习 · 计算机科学 2023-12-18 Yuhua Jiang , Qihan Liu , Xiaoteng Ma , Chenghao Li , Yiqin Yang , Jun Yang , Bin Liang , Qianchuan Zhao

Classical reinforcement learning (RL) aims to optimize the expected cumulative rewards. In this work, we consider the RL setting where the goal is to optimize the quantile of the cumulative rewards. We parameterize the policy controlling…

机器学习 · 计算机科学 2022-02-17 Jinyang Jiang , Jiaqiao Hu , Yijie Peng

Legged locomotion in unstructured environments demands not only high-performance control policies but also formal guarantees to ensure robustness under perturbations. Control methods often require carefully designed reference trajectories,…

机器人学 · 计算机科学 2026-03-23 Vrushabh Zinage , Narek Harutyunyan , Eric Verheyden , Fred Y. Hadaegh , Soon-Jo Chung

Constrained Reinforcement Learning has been employed to enforce safety constraints on policy through the use of expected cost constraints. The key challenge is in handling expected cost accumulated using the policy and not just in a single…

机器学习 · 计算机科学 2024-01-17 Hao Jiang , Tien Mai , Pradeep Varakantham , Minh Huy Hoang

In many real-world applications, safety constraints for reinforcement learning (RL) algorithms are either unknown or not explicitly defined. We propose a framework that concurrently learns safety constraints and optimal RL policies in such…

系统与控制 · 电气工程与系统科学 2023-05-02 Lunet Yifru , Ali Baheri

Offline safe reinforcement learning (OSRL) involves learning a decision-making policy to maximize rewards from a fixed batch of training data to satisfy pre-defined safety constraints. However, adapting to varying safety constraints during…

机器学习 · 计算机科学 2025-05-29 Yassine Chemingui , Aryan Deshwal , Honghao Wei , Alan Fern , Janardhan Rao Doppa

In this paper, we consider the problem of learning safe policies for probabilistic-constrained reinforcement learning (RL). Specifically, a safe policy or controller is one that, with high probability, maintains the trajectory of the agent…

机器学习 · 计算机科学 2024-03-14 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain

Reinforcement learning with verifiable reward has recently emerged as a central paradigm for post-training large language models (LLMs); however, prevailing mean-based methods, such as Group Relative Policy Optimization (GRPO), suffer from…

Traditional portfolio management methods can incorporate specific investor preferences but rely on accurate forecasts of asset returns and covariances. Reinforcement learning (RL) methods do not rely on these explicit forecasts and are…

投资组合管理 · 定量金融 2022-03-23 Ruan Pretorius , Terence van Zyl