中文
相关论文

相关论文: Lyapunov-based Safe Policy Optimization for Contin…

200 篇论文

Autonomous UAV inspection of confined industrial infrastructure, such as ventilation ducts, demands robust navigation policies where collisions are unacceptable. While Deep Reinforcement Learning (DRL) offers a powerful paradigm for…

Multi-agent reinforcement learning (MARL) addresses sequential decision-making problems with multiple agents, where each agent optimizes its own objective. In many real-world instances, the agents may not only want to optimize their…

机器学习 · 计算机科学 2023-06-14 Pragnya Alatur , Giorgia Ramponi , Niao He , Andreas Krause

Informed and robust decision making in the face of uncertainty is critical for robots that perform physical tasks alongside people. We formulate this as Bayesian Reinforcement Learning over latent Markov Decision Processes (MDPs). While…

机器人学 · 计算机科学 2020-02-11 Gilwoo Lee , Brian Hou , Sanjiban Choudhury , Siddhartha S. Srinivasa

In high-stake scenarios like medical treatment and auto-piloting, it's risky or even infeasible to collect online experimental data to train the agent. Simulation-based training can alleviate this issue, but may suffer from its inherent…

机器学习 · 计算机科学 2022-03-16 Jialian Li , Tongzheng Ren , Dong Yan , Hang Su , Jun Zhu

Long-term fairness is an important factor of consideration in designing and deploying learning-based decision systems in high-stake decision-making contexts. Recent work has proposed the use of Markov Decision Processes (MDPs) to formulate…

机器学习 · 计算机科学 2022-10-25 Eric Yang Yu , Zhizhen Qin , Min Kyung Lee , Sicun Gao

Most reinforcement learning algorithms seek a single optimal strategy that solves a given task. However, it can often be valuable to learn a diverse set of solutions, for instance, to make an agent's interaction with users more engaging, or…

机器学习 · 计算机科学 2024-01-09 Wentse Chen , Shiyu Huang , Yuan Chiang , Tim Pearce , Wei-Wei Tu , Ting Chen , Jun Zhu

In this paper, we use concepts from supervisory control theory of discrete event systems to propose a method to learn optimal control policies for a finite-state Markov Decision Process (MDP) in which (only) certain sequences of actions are…

机器学习 · 计算机科学 2022-01-04 Arun Raman , Keerthan Shagrithaya , Shalabh Bhatnagar

We study reinforcement learning in hybrid discrete-continuous action spaces, such as settings where the discrete component selects a regime (or index) and the continuous component optimizes within it -- a structure common in robotics,…

机器学习 · 计算机科学 2026-05-15 Matias Alvo , Daniel Russo , Yash Kanoria

Safe Reinforcement Learning (RL) often faces significant issues such as constraint violations and instability, necessitating the use of constrained policy optimization, which seeks optimal policies while ensuring adherence to specific…

机器学习 · 计算机科学 2025-08-07 Ning Yang , Pengyu Wang , Guoqing Liu , Haifeng Zhang , Pin Lv , Jun Wang

Policy Gradient (PG) algorithms are among the best candidates for the much-anticipated applications of reinforcement learning to real-world control tasks, such as robotics. However, the trial-and-error nature of these methods poses safety…

机器学习 · 计算机科学 2022-06-20 Matteo Papini , Matteo Pirotta , Marcello Restelli

Policy gradient methods have become a standard for training reinforcement learning agents in a scalable and efficient manner. However, they do not account for transition uncertainty, whereas learning robust policies can be computationally…

机器学习 · 计算机科学 2023-12-12 Navdeep Kumar , Esther Derman , Matthieu Geist , Kfir Levy , Shie Mannor

This article presents a constrained policy optimization approach for the optimal control of systems under nonstationary uncertainties. We introduce an assumption that we call Markov embeddability that allows us to cast the stochastic…

最优化与控制 · 数学 2026-05-11 Sungho Shin , François Pacaud , Emil Contantinescu , Mihai Anitescu

Developing reinforcement learning algorithms that satisfy safety constraints is becoming increasingly important in real-world applications. In multi-agent reinforcement learning (MARL) settings, policy optimisation with safety awareness is…

One of the key challenges to deep reinforcement learning (deep RL) is to ensure safety at both training and testing phases. In this work, we propose a novel technique of unsupervised action planning to improve the safety of on-policy…

机器人学 · 计算机科学 2021-09-30 Hao-Lun Hsu , Qiuhua Huang , Sehoon Ha

This paper introduces an information-theoretic constraint on learned policy complexity in the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithm. Previous research with a related approach in continuous…

人工智能 · 计算机科学 2025-05-16 Tailia Malloy , Tim Klinger , Miao Liu , Matthew Riemer , Gerald Tesauro , Chris R. Sims

Deep reinforcement learning (RL) excels in various control tasks, yet the absence of safety guarantees hampers its real-world applicability. In particular, explorations during learning usually results in safety violations, while the RL…

机器人学 · 计算机科学 2025-06-04 Yifan Sun , Feihan Li , Weiye Zhao , Rui Chen , Tianhao Wei , Changliu Liu

Decision-making under distribution shift is a central challenge in reinforcement learning (RL), where training and deployment environments differ. We study this problem through the lens of robust Markov decision processes (RMDPs), which…

机器学习 · 计算机科学 2025-10-17 Jingwen Gu , Yiting He , Zhishuai Liu , Pan Xu

Robust Markov decision processes (RMDPs) provide a promising framework for computing reliable policies in the face of model errors. Many successful reinforcement learning algorithms build on variations of policy-gradient methods, but…

机器学习 · 计算机科学 2024-05-15 Qiuhao Wang , Chin Pang Ho , Marek Petrik

Deep neural networks are increasingly used as an effective parameterization of control policies in various learning-based control paradigms. For continuous-time optimal control problems (OCPs), which are central to many decision-making…

机器学习 · 计算机科学 2025-11-04 Joshua Hang Sai Ip , Georgios Makrygiorgos , Ali Mesbah

Markov Decision Processes (MDPs) have been used to formulate many decision-making problems in science and engineering. The objective is to synthesize the best decision (action selection) policies to maximize expected rewards (minimize…

最优化与控制 · 数学 2015-07-08 Mahmoud El Chamie , Behcet Acikmese