English
Related papers

Related papers: Risk Sensitive Path Integral Control

200 papers

We address the role of noise and the issue of efficient computation in stochastic optimal control problems. We consider a class of non-linear control problems that can be formulated as a path integral and where the noise plays the role of…

Computational Physics · Physics 2009-11-10 H. J. Kappen

We consider a continuous-time continuous-space stochastic optimal control problem, where the controller lacks exact knowledge of the underlying diffusion process, relying instead on a finite set of historical disturbance trajectories. In…

Systems and Control · Electrical Eng. & Systems 2023-10-04 Hyuk Park , Duo Zhou , Grani A. Hanasusanto , Takashi Tanaka

In this paper, we consider optimal control of stochastic differential equations subject to an expected path constraint. The stochastic maximum principle is given for a general optimal stochastic control in terms of constrained FBSDEs. In…

Optimization and Control · Mathematics 2022-08-16 Ying Hu , Shanjian Tang , Zuo Quan Xu

Recent low-thrust space missions have highlighted the importance of designing trajectories that are robust against uncertainties. In its complete form, this process is formulated as a nonlinear constrained stochastic optimal control…

Optimization and Control · Mathematics 2022-02-25 Naoya Ozaki , Stefano Campagnola , Ryu Funase

Formulating the intended behavior of a dynamic system can be challenging. Signal temporal logic (STL) is frequently used for this purpose due to its suitability in formalizing comprehensible, modular, and versatile spatiotemporal…

Systems and Control · Electrical Eng. & Systems 2025-03-04 Patrick Halder , Hannes Homburger , Lothar Kiltz , Johannes Reuter , Matthias Althoff

This paper addresses planning and control of robot motion under uncertainty that is formulated as a continuous-time, continuous-space stochastic optimal control problem, by developing a topology-guided path integral control method. The path…

Robotics · Computer Science 2022-08-01 Jung-Su Ha , Soon-Seo Park , Han-Lim Choi

Classical deterministic optimal control problems assume full information about the controlled process. The theory of control for general partially-observable processes is powerful, but the methods are computationally expensive and typically…

Optimization and Control · Mathematics 2024-08-02 Dongping Qi , Adam Dhillon , Alexander Vladimirsky

This paper presents a stochastic model predictive control approach for nonlinear systems subject to time-invariant probabilistic uncertainties in model parameters and initial conditions. The stochastic optimal control problem entails a cost…

Optimization and Control · Mathematics 2014-10-17 Stefan Streif , Matthias Karl , Ali Mesbah

Stochastic Model Predictive Control has proved to be an efficient method to plan trajectories in uncertain environments, e.g., for autonomous vehicles. Chance constraints ensure that the probability of collision is bounded by a predefined…

Systems and Control · Electrical Eng. & Systems 2021-05-17 Tim Brüdigam , Fulvio di Luzio , Lucia Pallottino , Dirk Wollherr , Marion Leibold

Iterative trajectory optimization techniques for non-linear dynamical systems are among the most powerful and sample-efficient methods of model-based reinforcement learning and approximate optimal control. By leveraging time-variant local…

Systems and Control · Electrical Eng. & Systems 2019-08-01 Onur Celik , Hany Abdulsamad , Jan Peters

This work addresses the problem of risk-sensitive control for nonlinear systems with imperfect state observations, extending results for the linear case. In particular, we derive an algorithm that can compute local solutions with…

Optimization and Control · Mathematics 2021-10-22 Bilal Hammoud , Armand Jordana , Ludovic Righetti

We present a novel particle filtering framework for continuous-time dynamical systems with continuous-time measurements. Our approach is based on the duality between estimation and optimal control, which allows reformulating the estimation…

Optimization and Control · Mathematics 2021-10-08 Qinsheng Zhang , Amirhossein Taghvaei , Yongxin Chen

Navigating a collision-free and optimal trajectory for a robot is a challenging task, particularly in environments with moving obstacles such as humans. We formulate this problem as a stochastic optimal control problem. Since solving the…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Seyyed Reza Jafari , Anders Hansson , Bo Wahlberg

This paper studies an optimal control problem for continuous-time stochastic systems subject to reachability objectives specified in a subclass of metric interval temporal logic specifications, a temporal logic with real-time constraints.…

Systems and Control · Computer Science 2015-04-21 Jie Fu , Ufuk Topcu

In this contribution, we derive ILEG, an iterative algorithm to find risk sensitive solutions to nonlinear, stochastic optimal control problems. The algorithm is based on a linear quadratic approximation of an exponential risk sensitive…

Systems and Control · Computer Science 2015-12-23 Farbod Farshidian , Jonas Buchli

In this paper, we consider continuous-time stochastic optimal control problems where the cost is evaluated through a coherent risk measure. We provide an explicit gradient descent-ascent algorithm which applies to problems subject to…

Optimization and Control · Mathematics 2023-06-23 Gabriel Velho , Jean Auriol , Riccardo Bonalli

This paper proposes to parameterize open loop controls in stochastic optimal control problems via suitable classes of functionals depending on the driver's path signature, a concept adopted from rough path integration theory. We rigorously…

Optimization and Control · Mathematics 2025-07-16 P. Bank , C. Bayer , P. P. Hager , S. Riedel , T. Nauen

In this paper, we consider a class of stochastic optimal control problems with risk constraints that are expressed as bounded probabilities of failure for particular initial states. We present here a martingale approach that diffuses a risk…

Systems and Control · Computer Science 2015-07-09 Vu Anh Huynh , Leonid Kogan , Emilio Frazzoli

Trajectory planning in dense, interactive traffic scenarios presents significant challenges for autonomous vehicles, primarily due to the uncertainty of human driver behavior and the non-convex nature of collision avoidance constraints.…

Systems and Control · Electrical Eng. & Systems 2025-10-30 Erik Börve , Nikolce Murgovski , Leo Laine

We provide an overview of an optimal control problem within a stochastic model of tumor growth, which includes drug application. The model comprises two stochastic differential equations (SDE) representing the diffusion of nutrient and drug…

Optimization and Control · Mathematics 2024-11-12 Noelymar Farinacci