中文
相关论文

相关论文: Controlling Underestimation Bias in Constrained Re…

200 篇论文

We present a novel algorithm that efficiently computes near-optimal deterministic policies for constrained reinforcement learning (CRL) problems. Our approach combines three key ideas: (1) value-demand augmentation, (2) action-space…

机器学习 · 计算机科学 2024-11-01 Jeremy McMahan

In this paper, we study a novel episodic risk-sensitive Reinforcement Learning (RL) problem, named Iterated CVaR RL, which aims to maximize the tail of the reward-to-go at each step, and focuses on tightly controlling the risk of getting…

机器学习 · 计算机科学 2023-05-12 Yihan Du , Siwei Wang , Longbo Huang

Primal-dual safe RL methods commonly perform iterations between the primal update of the policy and the dual update of the Lagrange Multiplier. Such a training paradigm is highly susceptible to the error in cumulative cost estimation since…

机器学习 · 计算机科学 2024-04-16 Zifan Wu , Bo Tang , Qian Lin , Chao Yu , Shangqin Mao , Qianlong Xie , Xingxing Wang , Dong Wang

Extrinsic calibration is essential for multi-sensor fusion, existing methods rely on structured targets or fully-excited data, limiting real-world applicability. Online calibration further suffers from weak excitation, leading to unreliable…

机器人学 · 计算机科学 2025-08-11 Baorun Li , Chengrui Zhu , Siyi Du , Bingran Chen , Jie Ren , Wenfei Wang , Yong Liu , Jiajun Lv

We study the problem of learning optimal behavior from sub-optimal datasets for goal-conditioned offline reinforcement learning under sparse rewards, invertible actions and deterministic transitions. To mitigate the effects of…

机器学习 · 计算机科学 2026-02-12 Alfredo Reichlin , Miguel Vasco , Hang Yin , Danica Kragic

Learned representations in deep reinforcement learning (DRL) have to extract task-relevant information from complex observations, balancing between robustness to distraction and informativeness to the policy. Such stable and rich…

机器学习 · 计算机科学 2021-10-28 Mete Kemertas , Tristan Aumentado-Armstrong

Meta reinforcement learning (RL) allows agents to leverage experience across a distribution of tasks on which the agent can train at will, enabling faster learning of optimal policies on new test tasks. Despite its success in improving…

机器学习 · 计算机科学 2026-05-27 Tingting Ni , Maryam Kamgarpour

Safe Reinforcement Learning (RL) often faces significant issues such as constraint violations and instability, necessitating the use of constrained policy optimization, which seeks optimal policies while ensuring adherence to specific…

机器学习 · 计算机科学 2025-08-07 Ning Yang , Pengyu Wang , Guoqing Liu , Haifeng Zhang , Pin Lv , Jun Wang

This paper investigates whether a single, unified cost function can explain and predict human reaching movements, in contrast with existing approaches that rely on subject- or posture-specific optimization criteria. Using the Minimal…

机器人学 · 计算机科学 2026-03-10 Sarmad Mehrdad , Maxime Sabbah , Vincent Bonnet , Ludovic Righetti

Inverse reinforcement learning (IRL) for linear systems seeks a cost function whose optimal controller reproduces an expert policy from data. Existing data-driven methods for discrete-time linear systems are largely built on iterative…

系统与控制 · 电气工程与系统科学 2026-05-12 Duc Cuong Nguyen , Phuong Nam Dao

Class Incremental Learning (CIL) poses a fundamental challenge: maintaining a balance between the plasticity required to learn new tasks and the stability needed to prevent catastrophic forgetting. While expansion-based methods effectively…

机器学习 · 计算机科学 2026-04-02 Adrian Garcia-Castañeda , Jon Irureta , Jon Imaz , Aizea Lojo

Reinforcement Learning has emerged as a strong alternative to solve optimization tasks efficiently. The use of these algorithms highly depends on the feedback signals provided by the environment in charge of informing about how good (or…

机器学习 · 计算机科学 2022-12-01 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser

Optimistic value estimates provide one mechanism for directed exploration in reinforcement learning (RL). The agent acts greedily with respect to an estimate of the value plus what can be seen as a value bonus. The value bonus can be…

机器学习 · 计算机科学 2026-02-16 Abdul Wahab , Raksha Kumaraswamy , Martha White

This paper develops a model-based reinforcement learning (MBRL) framework for learning online the value function of an infinite-horizon optimal control problem while obeying safety constraints expressed as control barrier functions (CBFs).…

机器学习 · 计算机科学 2022-11-10 Max H. Cohen , Calin Belta

One typical assumption in inverse reinforcement learning (IRL) is that human experts act to optimize the expected utility of a stochastic cost with a fixed distribution. This assumption deviates from actual human behaviors under ambiguity.…

机器学习 · 计算机科学 2019-09-25 Rui Chen , Wenshuo Wang , Zirui Zhao , Ding Zhao

Dynamic discrete choice (DDC) models have found widespread application in marketing. However, estimating these becomes challenging in "big data" settings with high-dimensional state-action spaces. To address this challenge, this paper…

计量经济学 · 经济学 2026-01-06 Ahmed Khwaja , Sonal Srivastava

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

机器学习 · 统计学 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

In safe offline reinforcement learning (RL), the objective is to develop a policy that maximizes cumulative rewards while strictly adhering to safety constraints, utilizing only offline data. Traditional methods often face difficulties in…

机器学习 · 计算机科学 2026-02-11 Prajwal Koirala , Zhanhong Jiang , Soumik Sarkar , Cody Fleming

Reinforcement learning (RL) is an area of significant research interest, and safe RL in particular is attracting attention due to its ability to handle safety-driven constraints that are crucial for real-world applications of RL algorithms.…

系统与控制 · 电气工程与系统科学 2023-04-13 Song Bo , Xunyuan Yin , Jinfeng Liu

This paper concerns the problem of learning control policies for an unknown linear dynamical system to minimize a quadratic cost function. We present a method, based on convex optimization, that accomplishes this task robustly: i.e., we…

最优化与控制 · 数学 2019-06-05 Jack Umenberger , Mina Ferizbegovic , Thomas B. Schön , Håkan Hjalmarsson