English
Related papers

Related papers: Model-based Path Integral Stochastic Control: A Ba…

200 papers

Discrete-time stochastic optimal control remains a challenging problem for general, nonlinear systems under significant uncertainty, with practical solvers typically relying on the certainty equivalence assumption, replanning and/or…

Systems and Control · Electrical Eng. & Systems 2021-03-12 Joe Watson , Jan Peters

Reinforcement Learning (RL) controllers have generated excitement within the control community. The primary advantage of RL controllers relative to existing methods is their ability to optimize uncertain systems independently of explicit…

Machine Learning · Computer Science 2021-12-07 Max Mowbray , Panagiotis Petsagkourakis , Ehecatl Antonio del Río Chanona , Dongda Zhang

Controller tuning and parameter optimization are crucial in system design to improve closed-loop system performance. Bayesian optimization has been established as an efficient model-free controller tuning and adaptation method. However,…

Systems and Control · Electrical Eng. & Systems 2024-04-24 Christopher König , Raamadaas Krishnadas , Efe C. Balta , Alisa Rupenyan

This paper presents a learning-based control strategy for non-linear throttle valves with an asymmetric hysteresis, leading to a near-optimal controller without requiring any prior knowledge about the environment. We start with a carefully…

Systems and Control · Electrical Eng. & Systems 2024-07-18 Paul Daoudi , Bojan Mavkov , Bogdan Robu , Christophe Prieur , Emmanuel Witrant , Merwan Barlier , Ludovic Dos Santos

Infinite-time nonlinear optimal regulation control is widely utilized in aerospace engineering as a systematic method for synthesizing stable controllers. However, conventional methods often rely on linearization hypothesis, while recent…

Systems and Control · Electrical Eng. & Systems 2025-06-13 Han Wang , Di Wu , Lin Cheng , Shengping Gong , Xu Huang

This paper presents an adaptive online learning framework for systems with uncertain parameters to ensure safety-critical control in non-stationary environments. Our approach consists of two phases. The initial phase is centered on a novel…

Machine Learning · Computer Science 2024-03-06 Yu Zhang , Long Wen , Xiangtong Yao , Zhenshan Bing , Linghuan Kong , Wei He , Alois Knoll

Control of nonlinear uncertain systems is a common challenge in the robotics field. Nonlinear latent force models, which incorporate latent uncertainty characterized as Gaussian processes, carry the promise of representing such systems…

Robotics · Computer Science 2022-07-29 Thomas Woodruff , Iman Askari , Guanghui Wang , Huazhen Fang

Gaussian Process (GP) regression is shown to be effective for learning unknown dynamics, enabling efficient and safety-aware control strategies across diverse applications. However, existing GP-based model predictive control (GP-MPC)…

Systems and Control · Electrical Eng. & Systems 2025-05-13 Manish Prajapat , Johannes Köhler , Amon Lahr , Andreas Krause , Melanie N. Zeilinger

In this paper, we discuss the methodology of generalizing the optimal control law from learned component tasks to unlearned composite tasks on Multi-Agent Systems (MASs), by using the linearity composition principle of linearly solvable…

Systems and Control · Electrical Eng. & Systems 2021-03-24 Lin Song , Neng Wan , Aditya Gahlawat , Naira Hovakimyan , Evangelos A. Theodorou

The connections between optimal control and Bayesian inference have long been recognised, with the field of stochastic (optimal) control combining these frameworks for the solution of partially observable control problems. In particular,…

Optimization and Control · Mathematics 2022-03-10 Manuel Baltieri

We consider nonlinear stochastic systems that arise in path planning and control of mobile robots. As is typical of almost all nonlinear stochastic systems, the optimally solving problem is intractable. We provide a design approach which…

Robotics · Computer Science 2017-05-25 Mohammadhussein Rafieisakhaei , Suman Chakravorty , P. R. Kumar

Cooperative driving relies on communication among vehicles to create situational awareness. One application of cooperative driving is Cooperative Adaptive Cruise Control (CACC) that aims at enhancing highway transportation safety and…

Robotics · Computer Science 2021-12-15 Sahand Mosharafian , Mahdi Razzaghpour , Yaser P. Fallah , Javad Mohammadpour Velni

Bayesian optimization (BO) is a powerful framework for estimating parameters of expensive simulation models, particularly in settings where the likelihood is intractable and evaluations are costly. In stochastic models every simulation is…

Learning-based control methods utilize run-time data from the underlying process to improve the controller performance under model mismatch and unmodeled disturbances. This is beneficial for optimizing industrial processes, where the…

Systems and Control · Electrical Eng. & Systems 2021-11-22 Efe C. Balta , Kira Barton , Dawn M. Tilbury , Alisa Rupenyan , John Lygeros

Physical modeling of robotic system behavior is the foundation for controlling many robotic mechanisms to a satisfactory degree. Mechanisms are also typically designed in a way that good model accuracy can be achieved with relatively simple…

Machine Learning · Statistics 2019-07-01 Sebastian Riedel , Freek Stulp

We present a novel on-policy algorithm for solving stochastic optimal control (SOC) problems. By leveraging the Girsanov theorem, our method directly computes on-policy gradients of the SOC objective without expensive backpropagation…

Machine Learning · Computer Science 2025-05-14 Mengjian Hua , Mathieu Laurière , Eric Vanden-Eijnden

Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions. We study reinforcement learning for control under…

Machine Learning · Computer Science 2026-04-03 Klemens Iten , Bruce Lee , Chenhao Li , Lenart Treven , Andreas Krause , Bhavya Sukhija

Thompson sampling (TS) is a Bayesian randomized exploration strategy that samples options (e.g., system parameters or control laws) from the current posterior and then applies the selected option that is optimal for a task, thereby…

Machine Learning · Computer Science 2026-02-06 Kaikai Zheng , Dawei Shi , Yang Shi , Long Wang

In this work we explore a new framework for approximate Bayesian inference in large datasets based on stochastic control (i.e. Schr\"odinger bridges). We advocate stochastic control as a finite time and low variance alternative to popular…

Safety and tracking stability are crucial for safety-critical systems such as self-driving cars, autonomous mobile robots, industrial manipulators. To efficiently control safety-critical systems to ensure their safety and achieve tracking…

Robotics · Computer Science 2020-09-22 Lei Zheng , Jiesen Pan , Rui Yang , Hui Cheng , Haifeng Hu