English
Related papers

Related papers: HJB Optimal Feedback Control with Deep Differentia…

200 papers

Safe and effective motion planning is crucial for autonomous robots. Diffusion models excel at capturing complex agent interactions, a fundamental aspect of decision-making in dynamic environments. Recent studies have successfully applied…

Robotics · Computer Science 2025-07-18 Giwon Lee , Daehee Park , Jaewoo Jeong , Kuk-Jin Yoon

Traditional stochastic optimal control methods that attempt to obtain an optimal feedback policy for nonlinear systems are computationally intractable. In this paper, we derive a decoupling principle between the open loop plan, and the…

Systems and Control · Computer Science 2019-02-28 Karthikeya S Parunandi , Suman Chakravorty

Model-free control based on the idea of Reinforcement Learning is a promising approach that has recently gained extensive attention. However, Reinforcement-Learning-based control methods solely focus on the regulation problem or learn to…

Systems and Control · Electrical Eng. & Systems 2019-12-02 Florian Köpf , Johannes Westermann , Michael Flad , Sören Hohmann

A fundamental question in neuroscience is how the brain creates an internal model of the world to guide actions using sequences of ambiguous sensory information. This is naturally formulated as a reinforcement learning problem under partial…

Machine Learning · Computer Science 2020-11-02 Minhae Kwon , Saurabh Daptardar , Paul Schrater , Xaq Pitkow

Efficient motion planning algorithms are of central importance for deploying robots in the real world. Unfortunately, these algorithms often drastically reduce the dimensionality of the problem for the sake of feasibility, thereby foregoing…

Robotics · Computer Science 2022-12-02 Alex Beaudin , Hsiu-Chin Lin

As autonomous systems become more ubiquitous in daily life, ensuring high performance with guaranteed safety is crucial. However, safety and performance could be competing objectives, which makes their co-optimization difficult.…

Robotics · Computer Science 2025-05-29 Manan Tayal , Aditya Singh , Shishir Kolathaya , Somil Bansal

The process of robot design is a complex task and the majority of design decisions are still based on human intuition or tedious manual tuning. A more informed way of facing this task is computational design methods where design parameters…

Robotics · Computer Science 2022-10-07 Álvaro Belmonte-Baeza , Joonho Lee , Giorgio Valsecchi , Marco Hutter

The paper present a novel approach for the solution of the Multi-Robot Communication-Aware Trajectory Planning, which builds on a general optimisation framework where the changes in robots positions are used as decision variable, and linear…

Robotics · Computer Science 2024-06-27 Jeppe Heini Mikkelsen , Roberto Galeazzi , Matteo Fumagalli

We study the problem of optimal portfolio selection under stochastic volatility within a continuous time reinforcement learning framework with portfolio constraints. Exploration is modeled through entropy-regularized relaxed controls, where…

Mathematical Finance · Quantitative Finance 2026-04-27 Thai Nguyen , Pertiny Nkuize

A learning approach for optimal feedback gains for nonlinear continuous time control systems is proposed and analysed. The goal is to establish a rigorous framework for computing approximating optimal feedback gains using neural networks.…

Optimization and Control · Mathematics 2020-08-27 Karl Kunisch , Daniel Walter

We describe an approach to learning optimal control policies for a large, linear particle accelerator using deep reinforcement learning coupled with a high-fidelity physics engine. The framework consists of an AI controller that uses deep…

Artificial Intelligence · Computer Science 2020-12-22 Xiaoying Pang , Sunil Thulasidasan , Larry Rybarcyk

Policy gradient methods are powerful reinforcement learning algorithms and have been demonstrated to solve many complex tasks. However, these methods are also data-inefficient, afflicted with high variance gradient estimates, and frequently…

Machine Learning · Computer Science 2019-05-15 Andreas Doerr , Michael Volpp , Marc Toussaint , Sebastian Trimpe , Christian Daniel

We propose a simple, practical and intuitive approach to improve the performance of a conventional controller in uncertain environments using deep reinforcement learning while maintaining safe operation. Our approach is motivated by the…

Systems and Control · Electrical Eng. & Systems 2021-10-07 Tom Staessens , Tom Lefebvre , Guillaume Crevecoeur

Model-based Reinforcement Learning and Control have demonstrated great potential in various sequential decision making problem domains, including in robotics settings. However, real-world robotics systems often present challenges that limit…

Machine Learning · Computer Science 2023-10-24 Achkan Salehi , Steffen Rühl , Stephane Doncieux

Multi-robot navigation is a challenging task in which multiple robots must be coordinated simultaneously within dynamic environments. We apply deep reinforcement learning (DRL) to learn a decentralized end-to-end policy which maps raw…

Robotics · Computer Science 2022-09-08 Christian Jestel , Hartmut Surmann , Jonas Stenzel , Oliver Urbann , Marius Brehler

Model-based controllers on real robots require accurate knowledge of the system dynamics to perform optimally. For complex dynamics, first-principles modeling is not sufficiently precise, and data-driven approaches can be leveraged to learn…

Robotics · Computer Science 2021-05-17 Weixuan Zhang , Marco Tognon , Lionel Ott , Roland Siegwart , Juan Nieto

This paper presents a novel deep learning framework for solving multiple optimal stopping problems in high dimensions. While deep learning has recently shown promise for single stopping problems, the multiple exercise case involves complex…

Optimization and Control · Mathematics 2025-12-30 Mathieu Laurière , Mehdi Talbi

A learning technique for finite horizon optimal control problems and its approximation based on polynomials is analyzed. It allows to circumvent, in part, the curse dimensionality which is involved when the feedback law is constructed by…

Optimization and Control · Mathematics 2023-02-21 Karl Kunisch , Donato Vásquez-Varas

While deep reinforcement learning (RL) methods have achieved unprecedented successes in a range of challenging problems, their applicability has been mainly limited to simulation or game domains due to the high sample complexity of the…

Artificial Intelligence · Computer Science 2017-09-26 Siyi Li , Tianbo Liu , Chi Zhang , Dit-Yan Yeung , Shaojie Shen

We study reinforcement learning in settings where sampling an action from the policy must be done concurrently with the time evolution of the controlled system, such as when a robot must decide on the next action while still performing the…

Machine Learning · Computer Science 2020-04-28 Ted Xiao , Eric Jang , Dmitry Kalashnikov , Sergey Levine , Julian Ibarz , Karol Hausman , Alexander Herzog