English
Related papers

Related papers: Optimal and Learning Control for Autonomous Robots

200 papers

In this paper, we investigate the optimal output tracking problem for linear discrete-time systems with unknown dynamics using reinforcement learning and robust output regulation theory. This output tracking problem only allows to utilize…

Dynamical Systems · Mathematics 2021-01-22 Ci Chen , Lihua Xie , Yi Jiang , Kan Xie , Shengli Xie

Many applications require solving non-linear control problems that are classically not well behaved. This paper develops a simple and efficient chattering algorithm that learns near optimal decision policies through an open-loop feedback…

Machine Learning · Computer Science 2017-03-21 Peeyush Kumar , Wolf Kohn , Zelda B. Zabinsky

This paper is concerned with the linear quadratic optimal control of discrete-time time-varying system with terminal state constraint. The main contribution is to propose a Q-learning algorithm for the optimal controller when the…

Optimization and Control · Mathematics 2023-07-20 Juanjuan Xu , Jingmei Liu , Zhaorong Zhang , Wei Wang

The framework of reinforcement learning or optimal control provides a mathematical formalization of intelligent decision making that is powerful and broadly applicable. While the general form of the reinforcement learning problem enables…

Machine Learning · Computer Science 2018-05-22 Sergey Levine

It is control that turns scientific knowledge into useful technology: in physics and engineering it provides a systematic way for driving a system from a given initial state into a desired target state with minimized expenditure of energy…

This paper presents a machine learning approach for tuning the parameters of a family of stabilizing controllers for orbital tracking. An augmented random search algorithm is deployed, which aims at minimizing a cost function combining…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Gianni Bianchini , Andrea Garulli , Antonio Giannitrapani , Mirko Leomanni , Renato Quartullo

This manuscript surveys reinforcement learning from the perspective of optimization and control with a focus on continuous control applications. It surveys the general formulation, terminology, and typical experimental implementations of…

Optimization and Control · Mathematics 2018-11-13 Benjamin Recht

In this work we present a general machine learning based scheme to optimize experimental control. The method utilizes the neural network to learn the relation between the control parameters and the control goal, with which the optimal…

Quantum Gases · Physics 2020-11-03 Yadong Wu , Zengming Meng , Kai Wen , Chengdong Mi , Jing Zhang , Hui Zhai

Autonomous vehicles with a self-evolving ability are expected to cope with unknown scenarios in the real-world environment. Take advantage of trial and error mechanism, reinforcement learning is able to self evolve by learning the optimal…

Robotics · Computer Science 2024-08-23 Shuo Yang , Liwen Wang , Yanjun Huang , Hong Chen

Motivated by the applications, a class of optimal control problems is investigated, where the goal is to influence the behavior of a given population through another controlled one interacting with the first. Diffusive terms accounting for…

Optimization and Control · Mathematics 2023-03-10 Stefano Almi , Marco Morandotti , Francesco Solombrino

While reinforcement learning (RL) holds great potential for decision making in the real world, it suffers from a number of unique difficulties which often need specific consideration. In particular: it is highly non-stationary; suffers from…

Machine Learning · Computer Science 2025-04-16 Alexander David Goldie , Chris Lu , Matthew Thomas Jackson , Shimon Whiteson , Jakob Nicolaus Foerster

This paper explores continuous-time and state-space optimal stopping problems from a reinforcement learning perspective. We begin by formulating the stopping problem using randomized stopping times, where the decision maker's control is…

Optimization and Control · Mathematics 2026-03-12 Jodi Dianetti , Giorgio Ferrari , Renyuan Xu

This paper presents an adaptive online distributed optimal control approach that is applicable to optimal planning for very-large-scale robotics systems in highly uncertain environments. This approach is developed based on the optimal mass…

Multiagent Systems · Computer Science 2020-03-17 Pingping Zhu , Chang Liu , Silvia Ferrari

Fully autonomous vehicles promise enhanced safety and efficiency. However, ensuring reliable operation in challenging corner cases requires control algorithms capable of performing at the vehicle limits. We address this requirement by…

Robotics · Computer Science 2025-08-14 Grzegorz Czechmanowski , Jan Węgrzynowski , Piotr Kicki , Krzysztof Walas

Reinforcement learning (RL) is promising for complicated stochastic nonlinear control problems. Without using a mathematical model, an optimal controller can be learned from data evaluated by certain performance criteria through…

Systems and Control · Electrical Eng. & Systems 2020-11-16 Minghao Han , Yuan Tian , Lixian Zhang , Jun Wang , Wei Pan

We propose a novel reformulation of the stochastic optimal control problem as an approximate inference problem, demonstrating, that such a interpretation leads to new practical methods for the original problem. In particular we characterise…

Machine Learning · Computer Science 2010-09-22 Konrad Rawlik , Marc Toussaint , Sethu Vijayakumar

This paper presents a novel approach to learning free terminal time closed-loop control for robotic manipulation tasks, enabling dynamic adjustment of task duration and control inputs to enhance performance. We extend the supervised…

Optimization and Control · Mathematics 2025-07-15 Wei Hu , Yue Zhao , Weinan E , Jiequn Han , Jihao Long

In this paper we use an affine connection formulation to study an optimal control problem for a class of nonholonomic, under-actuated mechanical systems. In particular, we aim at minimizing the norm-squared of the control input to move the…

Optimization and Control · Mathematics 2007-05-23 Islam I. Hussein , Anthony M. Bloch

In this survey, we systematically summarize the current literature on studies that apply reinforcement learning (RL) to the motion planning and control of autonomous vehicles. Many existing contributions can be attributed to the pipeline…

Robotics · Computer Science 2021-06-02 Fei Ye , Shen Zhang , Pin Wang , Ching-Yao Chan

Given a sequential learning algorithm and a target model, sequential machine teaching aims to find the shortest training sequence to drive the learning algorithm to the target model. We present the first principled way to find such shortest…

Machine Learning · Computer Science 2018-10-17 Laurent Lessard , Xuezhou Zhang , Xiaojin Zhu