中文
相关论文

相关论文: Towards Safe Reinforcement Learning Using NMPC and…

200 篇论文

Several works have addressed the problem of incorporating constraints in the reinforcement learning (RL) framework, however majority of them can only guarantee the satisfaction of soft constraints. In this work, we address the problem of…

机器学习 · 计算机科学 2020-06-16 Kwangyeon Kim , Akshita Gupta , Hong-Cheol Choi , Inseok Hwang

Policy gradient methods are a vital ingredient behind the success of modern reinforcement learning. Modern policy gradient methods, although successful, introduce a residual error in gradient estimation. In this work, we argue that this…

机器学习 · 计算机科学 2024-03-05 Pulkit Katdare , Anant Joshi , Katherine Driggs-Campbell

Model predictive control (MPC) is widely used in process control due to its interpretability and ability to handle constraints. As a parametric policy in reinforcement learning (RL), MPC offers strong initial performance and low data…

系统与控制 · 电气工程与系统科学 2026-04-03 Dean Brandner , Sebastien Gros , Sergio Lucia

Sample-based learning model predictive control (LMPC) strategies have recently attracted attention due to their desirable theoretical properties and their good empirical performance on robotic tasks. However, prior analysis of LMPC…

系统与控制 · 电气工程与系统科学 2020-05-19 Brijen Thananjeyan , Ashwin Balakrishna , Ugo Rosolia , Joseph E. Gonzalez , Aaron Ames , Ken Goldberg

Stochastic optimal control of dynamical systems is a crucial challenge in sequential decision-making. Recently, control-as-inference approaches have had considerable success, providing a viable risk-sensitive framework to address the…

机器学习 · 计算机科学 2023-12-22 Hany Abdulsamad , Sahel Iqbal , Adrien Corenflos , Simo Särkkä

This paper investigates methods for estimating the optimal stochastic control policy for a Markov Decision Process with unknown transition dynamics and an unknown reward function. This form of model-free reinforcement learning comprises…

机器学习 · 计算机科学 2019-12-06 Brandon Trabucco , Albert Qu , Simon Li , Ganeshkumar Ashokavardhanan

This paper studies an optimal control problem for continuous-time stochastic systems subject to reachability objectives specified in a subclass of metric interval temporal logic specifications, a temporal logic with real-time constraints.…

系统与控制 · 计算机科学 2015-04-21 Jie Fu , Ufuk Topcu

We study data-driven learning of robust stochastic control for infinite-horizon systems with potentially continuous state and action spaces. In many managerial settings--supply chains, finance, manufacturing, services, and dynamic…

机器学习 · 统计学 2025-11-18 Shengbo Wang , Jason Meng , Nian Si , Jose Blanchet , Zhengyuan Zhou

In this paper we propose a framework towards achieving two intertwined objectives: (i) equipping reinforcement learning with active exploration and deliberate information gathering, such that it regulates state and parameter uncertainties…

机器学习 · 计算机科学 2024-09-10 Mohammad S. Ramadan , Mahmoud A. Hayajnh , Michael T. Tolley , Kyriakos G. Vamvoudakis

We develop policy gradients methods for stochastic control with exit time in a model-free setting. We propose two types of algorithms for learning either directly the optimal policy or by learning alternately the value function (critic) and…

计算金融 · 定量金融 2023-02-16 Mohamed Hamdouche , Pierre Henry-Labordere , Huyen Pham

We study robust reinforcement learning (RL) with the goal of determining a well-performing policy that is robust against model mismatch between the training simulator and the testing environment. Previous policy-based robust RL algorithms…

机器学习 · 计算机科学 2023-12-12 Ruida Zhou , Tao Liu , Min Cheng , Dileep Kalathil , P. R. Kumar , Chao Tian

The problem of achieving a good trade-off in Stochastic Model Predictive Control between the competing goals of improving the average performance and reducing conservativeness, while still guaranteeing recursive feasibility and low…

最优化与控制 · 数学 2016-06-21 Matthias Lorenzen , Frank Allgöwer , Fabrizio Dabbene , Roberto Tempo

Policy gradient methods have been frequently applied to problems in control and reinforcement learning with great success, yet existing convergence analysis still relies on non-intuitive, impractical and often opaque conditions. In…

机器学习 · 计算机科学 2022-04-08 Matthew S. Zhang , Murat A. Erdogdu , Animesh Garg

This paper proposes an adaptive stochastic Model Predictive Control (MPC) strategy for stable linear time invariant systems in the presence of bounded disturbances. We consider multi-input multi-output systems that can be expressed by a…

系统与控制 · 计算机科学 2018-12-03 Monimoy Bujarbaruah , Xiaojing Zhang , Francesco Borrelli

Many robotic tasks, such as human-robot interactions or the handling of fragile objects, require tight control and limitation of appearing forces and moments alongside sensible motion control to achieve safe yet high-performance operation.…

机器人学 · 计算机科学 2023-03-09 Janine Matschek , Johanna Bethge , Rolf Findeisen

Model Predictive Control is an extremely effective control method for systems with input and state constraints. Model Predictive Control performance heavily depends on the accuracy of the open-loop prediction. For systems with uncertainty…

最优化与控制 · 数学 2022-07-27 Francesco Micheli , John Lygeros

In this work we introduce the application of black-box quantum control as an interesting rein- forcement learning problem to the machine learning community. We analyze the structure of the reinforcement learning problems arising in quantum…

机器学习 · 计算机科学 2018-04-16 Moritz August , José Miguel Hernández-Lobato

Model-based policy optimization is a well-established framework for designing reliable and high-performance controllers across a wide range of control applications. Recently, this approach has been extended to model predictive control…

系统与控制 · 电气工程与系统科学 2026-04-15 Riccardo Zuliani , Efe C. Balta , John Lygeros

Stochastic optimization algorithms, particularly stochastic policy gradient (SPG), report significant success in reinforcement learning (RL). Nevertheless, up to now, that how to speedily acquire an optimal solution for RL is still a…

机器学习 · 计算机科学 2024-05-22 Haobin Zhang , Zhuang Yang

This paper presents a distributionally robust stochastic model predictive control (SMPC) approach for linear discrete-time systems subject to unbounded and correlated additive disturbances. We consider hard input constraints and state…

最优化与控制 · 数学 2021-09-21 Christoph Mark , Steven Liu