English
Related papers

Related papers: Learning Constraints from Stochastic Partially-Obs…

200 papers

In this paper, we investigate the optimal output tracking problem for linear discrete-time systems with unknown dynamics using reinforcement learning and robust output regulation theory. This output tracking problem only allows to utilize…

Dynamical Systems · Mathematics 2021-01-22 Ci Chen , Lihua Xie , Yi Jiang , Kan Xie , Shengli Xie

This paper presents a method to verify closed-loop properties of optimization-based controllers for deterministic and stochastic constrained polynomial discrete-time dynamical systems. The closed-loop properties amenable to the proposed…

Optimization and Control · Mathematics 2016-11-16 Milan Korda , Colin N. Jones

This note proposes a data-driven output-feedback stabilizing policy iteration for unknown linear discrete-time systems with unmeasurable states. Existing policy iteration methods for optimal control must start from a stabilizing control…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Dongdong Li , Jiuxiang Dong

This paper designs a model predictive control (MPC) law for constrained linear systems with stochastic additive disturbances and noisy measurements, minimising a discounted cost subject to a discounted expectation constraint. It is assumed…

Systems and Control · Electrical Eng. & Systems 2022-04-22 Shuhao Yan , Mark Cannon , Paul J. Goulart

Iterative trajectory optimization techniques for non-linear dynamical systems are among the most powerful and sample-efficient methods of model-based reinforcement learning and approximate optimal control. By leveraging time-variant local…

Systems and Control · Electrical Eng. & Systems 2019-08-01 Onur Celik , Hany Abdulsamad , Jan Peters

We propose an open loop methodology based on sample statistics to solve chance constrained stochastic optimal control problems with probabilistic safety guarantees for linear systems where the additive Gaussian noise has unknown mean and…

Systems and Control · Electrical Eng. & Systems 2023-03-24 Shawn Priore , Meeko Oishi

We study the problem of optimal state-feedback tracking control for unknown discrete-time deterministic systems with input constraints. To handle input constraints, state-of-art methods utilize a certain nonquadratic stage cost function,…

Systems and Control · Electrical Eng. & Systems 2020-12-09 Alexandros Tanzanakis , John Lygeros

This paper studies the linear quadratic regulation (LQR) problem of unknown discrete-time systems via dynamic output feedback learning control. In contrast to the state feedback, the optimality of the dynamic output feedback control for…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Kedi Xie , Martin Guay , Shimin Wang , Fang Deng , Maobin Lu

Inferring unknown constraints is a challenging and crucial problem in many robotics applications. When only expert demonstrations are available, it becomes essential to infer the unknown domain constraints to deploy additional agents…

Robotics · Computer Science 2023-12-06 Dimitris Papadimitriou , Jingqi Li

This paper proposes a robust control design method using reinforcement-learning for controlling partially-unknown dynamical systems under uncertain conditions. The method extends the optimal reinforcement-learning algorithm with a new…

Systems and Control · Electrical Eng. & Systems 2020-04-17 Phuong D. Ngo , Fred Godtliebsen

We study the problem of system identification for stochastic continuous-time dynamics, based on a single finite-length state trajectory. We present a method for estimating the possibly unstable open-loop matrix by employing properly…

Machine Learning · Statistics 2025-09-30 Reza Sadeghi Hafshejani , Mohamad Kazem Shirani Fradonbeh

Learning from Demonstration allows robots to mimic human actions. However, these methods do not model constraints crucial to ensure safety of the learned skill. Moreover, even when explicitly modelling constraints, they rely on the…

Robotics · Computer Science 2025-01-09 Shivam Chaubey , Francesco Verdoja , Ville Kyrki

We consider the problem of discounted optimal state-feedback regulation for general unknown deterministic discrete-time systems. It is well known that open-loop instability of systems, non-quadratic cost functions and complex nonlinear…

Systems and Control · Electrical Eng. & Systems 2020-03-31 Alexandros Tanzanakis , John Lygeros

We propose a control design method for linear time-invariant systems that iteratively learns to satisfy unknown polyhedral state constraints. At each iteration of a repetitive task, the method constructs an estimate of the unknown…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Monimoy Bujarbaruah , Charlott Vallon , Francesco Borrelli

Control design for general nonlinear robotic systems with guaranteed stability and/or safety in the presence of model uncertainties is a challenging problem. Recent efforts attempt to learn a controller and a certificate (e.g., a Lyapunov…

Systems and Control · Electrical Eng. & Systems 2025-06-05 Vivek Sharma , Pan Zhao , Naira Hovakimyan

In this work, we propose a framework to learn feedback control policies with guarantees on closed-loop generalization and adversarial robustness. These policies are learned directly from expert demonstrations, contained in a dataset of…

Machine Learning · Computer Science 2022-11-03 Abed AlRahman Al Makdah , Vishaal Krishnan , Fabio Pasqualetti

This work presents a new sufficient condition for synthesizing nonlinear controllers that yield bounded closed-loop tracking error transients despite the presence of unmatched uncertainties that are concurrently being learned online. The…

Systems and Control · Electrical Eng. & Systems 2023-10-23 Samuel G. Gessow , Brett T. Lopez

This paper develops a sliding mode control based frame work for equality constrained optimization by reformulation the first order Karush Kuhn Tucker conditions as control affine dynamical system. The optimization variables are treated as…

Optimization and Control · Mathematics 2026-05-01 Shyam Kamal , Baby Diana , Sunidhi Pandey , Sandip Ghosh , Thach Ngoc Dinh

We consider the joint problem of system identification and inverse optimal control for discrete-time stochastic Linear Quadratic Regulators. We analyze finite and infinite time horizons in a partially observed setting, where the state is…

Optimization and Control · Mathematics 2025-02-24 Victor Geadah , Juncal Arbelaiz , Harrison Ritz , Nathaniel D. Daw , Jonathan D. Cohen , Jonathan W. Pillow

This paper studies the stochastic optimal control problem for systems with unknown dynamics. First, an open-loop deterministic trajectory optimization problem is solved without knowing the explicit form of the dynamical system. Next, a…

Systems and Control · Computer Science 2017-05-30 Dan Yu , Mohammadhussein Rafieisakhaei , Suman Chakravorty