English
Related papers

Related papers: Stochastic Optimal Control for Multivariable Dynam…

200 papers

This paper explores continuous-time and state-space optimal stopping problems from a reinforcement learning perspective. We begin by formulating the stopping problem using randomized stopping times, where the decision maker's control is…

Optimization and Control · Mathematics 2026-03-12 Jodi Dianetti , Giorgio Ferrari , Renyuan Xu

A stochastic procedure is developed which allows one to express Pontryagin's maximum principle for dissipative quantum system solely in terms of stochastic wave functions. Time-optimal controls can be efficiently computed without computing…

Quantum Physics · Physics 2020-11-09 Chungwei Lin , Dries Sels , Yanting Ma , Yebin Wang

We address the risk bounded trajectory optimization problem of stochastic nonlinear robotic systems. More precisely, we consider the motion planning problem in which the robot has stochastic nonlinear dynamics and uncertain initial…

Robotics · Computer Science 2022-03-08 Weiqiao Han , Ashkan Jasour , Brian Williams

Trajectory optimization and model predictive control are essential techniques underpinning advanced robotic applications, ranging from autonomous driving to full-body humanoid control. State-of-the-art algorithms have focused on data-driven…

Systems and Control · Electrical Eng. & Systems 2021-11-15 Hany Abdulsamad , Tim Dorau , Boris Belousov , Jia-Jie Zhu , Jan Peters

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

Systems and Control · Electrical Eng. & Systems 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

We consider a dynamical system with finitely many equilibria and perturbed by small noise, in addition to being controlled by an `expensive' control. The controlled process is optimal for an ergodic criterion with a running cost that…

Probability · Mathematics 2019-03-20 Ari Arapostathis , Anup Biswas , Vivek S. Borkar

Neural networks have been increasingly employed in Model Predictive Controller (MPC) to control nonlinear dynamic systems. However, MPC still poses a problem that an achievable update rate is insufficient to cope with model uncertainty and…

Robotics · Computer Science 2022-07-15 Taekyung Kim , Hojin Lee , Seongil Hong , Wonsuk Lee

This paper is concerned with a constrained stochastic linear-quadratic optimal control problem, in which the terminal state is fixed and the initial state is constrained to lie in a stochastic linear manifold. The controllability of…

Optimization and Control · Mathematics 2019-06-11 Xiuchun Bi , Jingrui Sun , Jie Xiong

In this paper, we consider a modified version of the control problem in a model free Markov decision process (MDP) setting with large state and action spaces. The control problem most commonly addressed in the contemporary literature is to…

Artificial Intelligence · Computer Science 2018-02-01 Ajin George Joseph , Shalabh Bhatnagar

This paper presents a stochastic, model predictive control (MPC) algorithm that leverages short-term probabilistic forecasts for dispatching and rebalancing Autonomous Mobility-on-Demand systems (AMoD, i.e. fleets of self-driving vehicles).…

Systems and Control · Computer Science 2018-05-07 Matthew Tsao , Ramon Iglesias , Marco Pavone

Stochastic Model Predictive Control has proved to be an efficient method to plan trajectories in uncertain environments, e.g., for autonomous vehicles. Chance constraints ensure that the probability of collision is bounded by a predefined…

Systems and Control · Electrical Eng. & Systems 2021-05-17 Tim Brüdigam , Fulvio di Luzio , Lucia Pallottino , Dirk Wollherr , Marion Leibold

Motion planning is a key aspect of robotics. A common approach to address motion planning problems is trajectory optimization. Trajectory optimization can represent the high-level behaviors of robots through mathematical formulations.…

Robotics · Computer Science 2024-08-21 Fatemeh Rastgar

This paper is concerned with impulse approximate controllability for stochastic evolution equations with impulse controls. As direct applications, we formulate captivating minimal norm and time optimal control problems; The minimal norm…

Optimization and Control · Mathematics 2024-01-09 Yuanhang Liu

We address the problem of safely learning controlled stochastic dynamics from discrete-time trajectory observations, ensuring system trajectories remain within predefined safe regions during both training and deployment. Safety-critical…

Machine Learning · Statistics 2026-02-03 Luc Brogat-Motte , Alessandro Rudi , Riccardo Bonalli

The problem of continuous inverse optimal control (over finite time horizon) is to learn the unknown cost function over the sequence of continuous control variables from expert demonstrations. In this article, we study this fundamental…

Machine Learning · Computer Science 2022-04-20 Yifei Xu , Jianwen Xie , Tianyang Zhao , Chris Baker , Yibiao Zhao , Ying Nian Wu

We study feedback motion planning for continuous-time stochastic nonlinear systems under signal temporal logic (STL) specifications. We propose a framework that synthesizes control policies for chance-constrained STL trajectory optimization…

Robotics · Computer Science 2026-05-05 Liqian Ma , Zishun Liu , Glen Chou , Yongxin Chen

Discrete-time stochastic systems are an essential modelling tool for many engineering systems. We consider stochastic control systems that are evolving over continuous spaces. For this class of models, methods for the formal verification…

Systems and Control · Computer Science 2018-11-29 Sofie Haesaert , Sadegh Soudjani

We study the problem of synthesizing a controller that maximizes the entropy of a partially observable Markov decision process (POMDP) subject to a constraint on the expected total reward. Such a controller minimizes the predictability of a…

Optimization and Control · Mathematics 2019-09-16 Michael Hibbard , Yagiz Savas , Bo Wu , Takashi Tanaka , Ufuk Topcu

This paper studies the extremum seeking control (ESC) problem for a class of constrained nonlinear systems. Specifically, we focus on a family of constraints allowing to reformulate the original nonlinear system in the so-called…

Optimization and Control · Mathematics 2021-03-24 Shuai Yuan , Filippo Fabiani , Simone Baldi

Standard Model Predictive Control (MPC) or trajectory optimization approaches perform only a local search to solve a complex non-convex optimization problem. As a result, they cannot capture the multi-modal characteristic of human driving.…

Robotics · Computer Science 2022-03-16 Vivek K. Adajania , Aditya Sharma , Anish Gupta , Houman Masnavi , K Madhava Krishna , Arun K. Singh