中文
相关论文

相关论文: Probabilistically safe and efficient model-based r…

200 篇论文

Breaking safety constraints in control systems can lead to potential risks, resulting in unexpected costs or catastrophic damage. Nevertheless, uncertainty is ubiquitous, even among similar tasks. In this paper, we develop a novel adaptive…

系统与控制 · 电气工程与系统科学 2023-07-17 Shengbo Wang , Ke Li , Yin Yang , Yuting Cao , Tingwen Huang , Shiping Wen

It has been shown that optimizing quadratic costs while stabilizing affine control systems to desired (sets of) states subject to state and control constraints can be reduced to a sequence of Quadratic Programs (QPs) by using Control…

最优化与控制 · 数学 2023-03-17 Wei Xiao , Christos G. Cassandras , Calin A. Belta

In this paper, we leverage ideas from model-based control to address the sample efficiency problem of reinforcement learning (RL) algorithms. Accelerating learning is an active field of RL highly relevant in the context of time-varying…

系统与控制 · 电气工程与系统科学 2023-05-23 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

In this paper, we focus on the problem of robustifying reinforcement learning (RL) algorithms with respect to model uncertainties. Indeed, in the framework of model-based RL, we propose to merge the theory of constrained Markov decision…

机器学习 · 计算机科学 2020-10-13 Reazul Hasan Russel , Mouhacine Benosman , Jeroen Van Baar

A common setting of reinforcement learning (RL) is a Markov decision process (MDP) in which the environment is a stochastic discrete-time dynamical system. Whereas MDPs are suitable in such applications as video-games or puzzles, physical…

机器人学 · 计算机科学 2022-11-29 Pavel Osinenko , Dmitrii Dobriborsci , Grigory Yaremenko , Georgiy Malaniya

Vanilla Reinforcement Learning (RL) can efficiently solve complex tasks but does not provide any guarantees on system behavior. To bridge this gap, we propose a three-step safe RL procedure for continuous action spaces that provides…

机器人学 · 计算机科学 2023-09-29 Hanna Krasowski , Prithvi Akella , Aaron D. Ames , Matthias Althoff

We present a methodology to deploy the stochastic policy gradient method, using actor-critic techniques, when the optimal policy is approximated using a parametric optimization problem, allowing one to enforce safety via hard constraints.…

系统与控制 · 电气工程与系统科学 2024-09-23 Sebastien Gros , Mario Zanon

A comprehensive approach addressing identification and control for learningbased Model Predictive Control (MPC) for linear systems is presented. The design technique yields a data-driven MPC law, based on a dataset collected from the…

系统与控制 · 计算机科学 2018-10-31 Enrico Terzi , Lorenzo Fagiano , Marcello Farina , Riccardo Scattolini

This paper addresses learning safe output feedback control laws from partial observations of expert demonstrations. We assume that a model of the system dynamics and a state estimator are available along with corresponding error bounds,…

系统与控制 · 电气工程与系统科学 2024-04-04 Lars Lindemann , Alexander Robey , Lejun Jiang , Satyajeet Das , Stephen Tu , Nikolai Matni

We present a reinforcement learning (RL) framework to synthesize a control policy from a given linear temporal logic (LTL) specification in an unknown stochastic environment that can be modeled as a Markov Decision Process (MDP).…

机器人学 · 计算机科学 2026-04-07 Alper Kamil Bozkurt , Yu Wang , Michael M. Zavlanos , Miroslav Pajic

Inspired by the success of imitation and inverse reinforcement learning in replicating expert behavior through optimal control, we propose a learning based approach to safe controller synthesis based on control barrier functions (CBFs). We…

系统与控制 · 电气工程与系统科学 2020-11-10 Alexander Robey , Haimin Hu , Lars Lindemann , Hanwen Zhang , Dimos V. Dimarogonas , Stephen Tu , Nikolai Matni

This paper presents a model-free reinforcement learning (RL) algorithm to synthesize a control policy that maximizes the satisfaction probability of linear temporal logic (LTL) specifications. Due to the consideration of environment and…

形式语言与自动机理论 · 计算机科学 2022-01-04 Mingyu Cai , Shaoping Xiao , Baoluo Li , Zhiliang Li , Zhen Kan

Economic model predictive control (EMPC) is a promising methodology for optimal operation of dynamical processes that has been shown to improve process economics considerably. However, EMPC performance relies heavily on the accuracy of the…

系统与控制 · 电气工程与系统科学 2021-05-10 Khalid Alhazmi , Fahad Albalawi , S. Mani Sarathy

Reinforcement learning (RL) exhibits impressive performance when managing complicated control tasks for robots. However, its wide application to physical robots is limited by the absence of strong safety guarantees. To overcome this…

机器人学 · 计算机科学 2023-05-18 Desong Du , Shaohang Han , Naiming Qi , Haitham Bou Ammar , Jun Wang , Wei Pan

Constrained Reinforcement Learning has been employed to enforce safety constraints on policy through the use of expected cost constraints. The key challenge is in handling expected cost accumulated using the policy and not just in a single…

机器学习 · 计算机科学 2024-01-17 Hao Jiang , Tien Mai , Pradeep Varakantham , Minh Huy Hoang

Control systems operating in the real world face countless sources of unpredictable uncertainties. These random disturbances can render deterministic guarantees inapplicable and cause catastrophic safety failures. To overcome this, this…

系统与控制 · 电气工程与系统科学 2026-02-10 Pol Mestres , Blake Werner , Ryan K. Cosner , Aaron D. Ames

Model-based Reinforcement Learning (RL) is a popular learning paradigm due to its potential sample efficiency compared to model-free RL. However, existing empirical model-based RL approaches lack the ability to explore. This work studies a…

机器学习 · 计算机科学 2021-07-16 Yuda Song , Wen Sun

This paper proposes an on-policy reinforcement learning (RL) control algorithm that solves the optimal regulation problem for a class of uncertain continuous-time nonlinear systems under user-defined state constraints. We formulate the safe…

系统与控制 · 电气工程与系统科学 2022-09-20 Soutrik Bandyopadhyay , Shubhendu Bhasin

Reinforcement learning (RL) can be used to tune data-driven (economic) nonlinear model predictive controllers ((e)NMPCs) for optimal performance in a specific control task by optimizing the dynamic model or parameters in the policy's…

机器学习 · 计算机科学 2025-05-14 Daniel Mayfrank , Mehmet Velioglu , Alexander Mitsos , Manuel Dahmen

This paper presents the concept of an adaptive safe padding that forces Reinforcement Learning (RL) to synthesise optimal control policies while ensuring safety during the learning process. Policies are synthesised to satisfy a goal,…

机器学习 · 计算机科学 2020-03-24 Mohammadhosein Hasanbeig , Alessandro Abate , Daniel Kroening