中文
相关论文

相关论文: Lyapunov-based Safe Policy Optimization for Contin…

200 篇论文

Constrained Markov Decision Process (CMDP) is a natural framework for reinforcement learning tasks with safety constraints, where agents learn a policy that maximizes the long-term reward while satisfying the constraints on the long-term…

人工智能 · 计算机科学 2018-02-20 Qingkai Liang , Fanyu Que , Eytan Modiano

Novel advanced policy gradient (APG) algorithms, such as proximal policy optimization (PPO), trust region policy optimization, and their variations, have become the dominant reinforcement learning (RL) algorithms because of their ease of…

最优化与控制 · 数学 2022-05-05 Mark Gluzman

Reinforcement learning algorithms require a large amount of samples; this often limits their real-world applications on even simple tasks. Such a challenge is more outstanding in multi-agent tasks, as each step of operation is more costly…

机器学习 · 计算机科学 2022-09-05 Yali Du , Chengdong Ma , Yuchen Liu , Runji Lin , Hao Dong , Jun Wang , Yaodong Yang

Safety exploration can be regarded as a constrained Markov decision problem where the expected long-term cost is constrained. Previous off-policy algorithms convert the constrained optimization problem into the corresponding unconstrained…

机器学习 · 计算机科学 2024-10-28 Hengrui Zhang , Youfang Lin , Sheng Han , Shuo Wang , Kai Lv

Incorporating safety is an essential prerequisite for broadening the practical applications of reinforcement learning in real-world scenarios. To tackle this challenge, Constrained Markov Decision Processes (CMDPs) are leveraged, which…

机器学习 · 计算机科学 2023-11-03 Jaafar Mhamed , Shangding Gu

Many physical systems have underlying safety considerations that require that the policy employed ensures the satisfaction of a set of constraints. The analytical formulation usually takes the form of a Constrained Markov Decision Process…

机器学习 · 计算机科学 2021-03-03 Aria HasanzadeZonuzy , Archana Bura , Dileep Kalathil , Srinivas Shakkottai

With a growing interest in data-driven control techniques, Model Predictive Control (MPC) provides an opportunity to exploit the surplus of data reliably, particularly while taking safety and stability into account. In many real-world and…

人工智能 · 计算机科学 2021-06-04 Mayank Mittal , Marco Gallieri , Alessio Quaglino , Seyed Sina Mirrazavi Salehian , Jan Koutník

Deep reinforcement learning (RL) uses model-free techniques to optimize task-specific control policies. Despite having emerged as a promising approach for complex problems, RL is still hard to use reliably for real-world applications. Apart…

机器人学 · 计算机科学 2020-02-25 Siddhant Gangapurwala , Alexander Mitchell , Ioannis Havoutis

Shifting from traditional control strategies to Deep Reinforcement Learning (RL) for legged robots poses inherent challenges, especially when addressing real-world physical constraints during training. While high-fidelity simulations…

机器人学 · 计算机科学 2023-09-28 Joonho Lee , Lukas Schroth , Victor Klemm , Marko Bjelonic , Alexander Reske , Marco Hutter

Reinforcement learning is a powerful paradigm for learning optimal policies from experimental data. However, to find optimal policies, most reinforcement learning algorithms explore all possible actions, which may be harmful for real-world…

机器学习 · 统计学 2017-11-15 Felix Berkenkamp , Matteo Turchetta , Angela P. Schoellig , Andreas Krause

In this paper, we focus on the problem of robustifying reinforcement learning (RL) algorithms with respect to model uncertainties. Indeed, in the framework of model-based RL, we propose to merge the theory of constrained Markov decision…

机器学习 · 计算机科学 2020-10-13 Reazul Hasan Russel , Mouhacine Benosman , Jeroen Van Baar

With the advancement of autonomous driving, ensuring safety during motion planning and navigation is becoming more and more important. However, most end-to-end planning methods suffer from a lack of safety. This research addresses the…

人工智能 · 计算机科学 2024-07-18 Detian Chu , Linyuan Bai , Jianuo Huang , Zhenlong Fang , Peng Zhang , Wei Kang , Haifeng Lin

In the pursuit of autonomous spacecraft proximity maneuvers and docking(PMD), we introduce a novel Bayesian actor-critic reinforcement learning algorithm to learn a control policy with the stability guarantee. The PMD task is formulated as…

机器人学 · 计算机科学 2024-05-24 Desong Du , Naiming Qi , Yanfang Liu , Wei Pan

There are no computationally feasible algorithms that provide solutions to the finite horizon Risk-sensitive Constrained Markov Decision Process (Risk-CMDP) problem, even for problems with moderate horizon. With an aim to design the same,…

最优化与控制 · 数学 2023-03-27 Vartika Singh , Veeraruna Kavitha

We study the problem of computing deterministic optimal policies for constrained Markov decision processes (MDPs) with continuous state and action spaces, which are widely encountered in constrained dynamical systems. Designing…

人工智能 · 计算机科学 2025-04-07 Sergio Rozada , Dongsheng Ding , Antonio G. Marques , Alejandro Ribeiro

We present a learning-based predictive control methodology using the differentiable programming framework with probabilistic Lyapunov-based stability guarantees. The neural Lyapunov differentiable predictive control (NLDPC) learns the…

系统与控制 · 电气工程与系统科学 2025-10-27 Sayak Mukherjee , Ján Drgoňa , Aaron Tuor , Mahantesh Halappanavar , Draguna Vrabie

We introduce and study constrained Markov Decision Processes (cMDPs) with anytime constraints. An anytime constraint requires the agent to never violate its budget at any point in time, almost surely. Although Markovian policies are no…

机器学习 · 计算机科学 2024-06-14 Jeremy McMahan , Xiaojin Zhu

This paper presents a framework to tackle constrained combinatorial optimization problems using deep Reinforcement Learning (RL). To this end, we extend the Neural Combinatorial Optimization (NCO) theory in order to deal with constraints in…

机器学习 · 计算机科学 2020-06-23 Ruben Solozabal , Josu Ceberio , Martin Takáč

As Deep Neural Network (DNN) inference becomes increasingly prevalent on edge and mobile platforms, critical challenges emerge in privacy protection, resource constraints, and dynamic model deployment. This paper proposes a privacy-aware…

多智能体系统 · 计算机科学 2026-03-03 Hong Wang , Xuwei Fan , Zhipeng Cheng , Yachao Yuan , Minghui Min , Minghui Liwang , Xiaoyu Xia

Despite impressive results, reinforcement learning (RL) suffers from slow convergence and requires a large variety of tuning strategies. In this paper, we investigate the ability of RL algorithms on simple continuous control tasks. We show…

机器人学 · 计算机科学 2024-02-16 Daniel Layeghi , Steve Tonneau , Michael Mistry