中文
相关论文

相关论文: Safety-Constrained Policy Transfer with Successor …

200 篇论文

We consider the reinforcement learning problem for the constrained Markov decision process (CMDP), which plays a central role in satisfying safety or resource constraints in sequential learning and decision-making. In this problem, we are…

机器学习 · 计算机科学 2025-11-19 Jiashuo Jiang , Yinyu Ye

As one of the core parts of flexible manufacturing systems, material handling involves storage and transportation of materials between workstations with automated vehicles. The improvement in material handling can impulse the overall…

机器学习 · 计算机科学 2023-05-24 Chengpeng Hu , Ziming Wang , Jialin Liu , Junyi Wen , Bifei Mao , Xin Yao

We study online learning in episodic constrained Markov decision processes (CMDPs), where the learner aims at collecting as much reward as possible over the episodes, while satisfying some long-term constraints during the learning process.…

A constrained Markov decision process (CMDP) approach is developed for response-adaptive procedures in clinical trials with binary outcomes. The resulting CMDP class of Bayesian response -- adaptive procedures can be used to target a…

统计方法学 · 统计学 2024-01-31 Stef Baas , Aleida Braaksma , Richard J. Boucherie

Delayed Markov decision processes (DMDPs) fulfill the Markov property by augmenting the state space of agents with a finite time window of recently committed actions. In reliance on these state augmentations, delay-resolved reinforcement…

机器人学 · 计算机科学 2025-11-17 Mohammadhossein Malmir , Josip Josifovski , Noah Klarmann , Alois Knoll

The Markov decision process (MDP) formulation used to model many real-world sequential decision making problems does not efficiently capture the setting where the set of available decisions (actions) at each time step is stochastic.…

机器学习 · 计算机科学 2020-01-22 Yash Chandak , Georgios Theocharous , Blossom Metevier , Philip S. Thomas

A Budgeted Markov Decision Process (BMDP) is an extension of a Markov Decision Process to critical applications requiring safety constraints. It relies on a notion of risk implemented in the shape of a cost signal constrained to lie below…

This paper considers the problem of learning safe policies in the context of reinforcement learning (RL). In particular, we consider the notion of probabilistic safety. This is, we aim to design policies that maintain the state of the…

机器学习 · 计算机科学 2023-04-20 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain

This paper proposes a reinforcement learning method for controller synthesis of autonomous systems in unknown and partially-observable environments with subjective time-dependent safety constraints. Mathematically, we model the system…

机器人学 · 计算机科学 2021-04-06 Yu Wang , Alper Kamil Bozkurt , Miroslav Pajic

The naive application of Reinforcement Learning algorithms to continuous control problems -- such as locomotion and manipulation -- often results in policies which rely on high-amplitude, high-frequency control signals, known colloquially…

机器人学 · 计算机科学 2019-02-14 Steven Bohez , Abbas Abdolmaleki , Michael Neunert , Jonas Buchli , Nicolas Heess , Raia Hadsell

For many applications of reinforcement learning it can be more convenient to specify both a reward function and constraints, rather than trying to design behavior through the reward function. For example, systems that physically interact…

机器学习 · 计算机科学 2017-05-31 Joshua Achiam , David Held , Aviv Tamar , Pieter Abbeel

The deployment of humanoid robots in unstructured, human-centric environments requires navigation capabilities that extend beyond simple locomotion to include robust perception, provable safety, and socially aware behavior. Current…

机器人学 · 计算机科学 2025-08-12 Zifan Wang , Xun Yang , Jianzhuang Zhao , Jiaming Zhou , Teli Ma , Ziyao Gao , Arash Ajoudani , Junwei Liang

Many problems in sequential decision making and stochastic control often have natural multiscale structure: sub-tasks are assembled together to accomplish complex goals. Systematically inferring and leveraging hierarchical structure,…

人工智能 · 计算机科学 2012-12-06 Jake Bouvrie , Mauro Maggioni

The wide popularity of short videos on social media poses new opportunities and challenges to optimize recommender systems on the video-sharing platforms. Users provide complex and multi-faceted responses towards recommendations, including…

机器学习 · 计算机科学 2022-05-27 Qingpeng Cai , Ruohan Zhan , Chi Zhang , Jie Zheng , Guangwei Ding , Pinghua Gong , Dong Zheng , Peng Jiang

Transfer in reinforcement learning refers to the notion that generalization should occur not only within a task but also across tasks. We propose a transfer framework for the scenario where the reward function changes between tasks but the…

人工智能 · 计算机科学 2018-04-13 André Barreto , Will Dabney , Rémi Munos , Jonathan J. Hunt , Tom Schaul , Hado van Hasselt , David Silver

Existing imitation learning methods mainly focus on making an agent effectively mimic a demonstrated behavior, but do not address the potential contradiction between the behavior style and the objective of a task. There is a general lack of…

机器学习 · 计算机科学 2022-09-28 Mingxi Tan , Andong Tian , Ludovic Denoyer

We consider the problem of reinforcement learning under safety requirements, in which an agent is trained to complete a given task, typically formalized as the maximization of a reward signal over time, while concurrently avoiding…

Developing reinforcement learning algorithms that satisfy safety constraints is becoming increasingly important in real-world applications. In multi-agent reinforcement learning (MARL) settings, policy optimisation with safety awareness is…

Real-world reinforcement learning (RL) problems often demand that agents behave safely by obeying a set of designed constraints. We address the challenge of safe RL by coupling a safety guide based on model predictive control (MPC) with a…

机器学习 · 计算机科学 2022-03-30 Samuel Pfrommer , Tanmay Gautam , Alec Zhou , Somayeh Sojoudi

Training a robotic policy from scratch using deep reinforcement learning methods can be prohibitively expensive due to sample inefficiency. To address this challenge, transferring policies trained in the source domain to the target domain…

机器人学 · 计算机科学 2024-03-05 Ruiqi Zhu , Tianhong Dai , Oya Celiktutan