English
Related papers

Related papers: On the Certainty-Equivalence Approach to Direct Da…

200 papers

Data-driven control benefits from rich datasets, but constructing such datasets becomes challenging when gathering data is limited. We consider an offline experiment design approach to gathering data where we design a control input to…

Systems and Control · Electrical Eng. & Systems 2024-05-22 Sean Anderson , João Pedro Hespanha

Learning representations for reinforcement learning (RL) has shown much promise for continuous control. We propose an efficient representation learning method using only a self-supervised latent-state consistency loss. Our approach employs…

Machine Learning · Computer Science 2024-06-06 Aidan Scannell , Kalle Kujanpää , Yi Zhao , Mohammadreza Nakhaei , Arno Solin , Joni Pajarinen

A classical approach for solving discrete time nonlinear control on a finite horizon consists in repeatedly minimizing linear quadratic approximations of the original problem around current candidate solutions. While widely popular in many…

Optimization and Control · Mathematics 2025-07-08 Vincent Roulet , Siddhartha Srinivasa , Maryam Fazel , Zaid Harchaoui

In these notes we collect some results from several of the authors' works in order to make available a single source and show how the approximate geometric methods for regulation have been developed, and how the control design strategy has…

Optimization and Control · Mathematics 2022-11-07 Eugenio Aulisa , David S. Gilliam

Regularization is a central tool for addressing ill-posedness in inverse problems and statistical estimation, with the choice of a suitable penalty often determining the reliability and interpretability of downstream solutions. While recent…

Optimization and Control · Mathematics 2025-10-07 Oscar Leong , Eliza O'Reilly , Yong Sheng Soh

Designing planners and controllers for contact-rich manipulation is extremely challenging as contact violates the smoothness conditions that many gradient-based controller synthesis tools assume. Contact smoothing approximates a non-smooth…

Robotics · Computer Science 2025-10-06 Yuki Shirai , Tong Zhao , H. J. Terry Suh , Huaijiang Zhu , Xinpei Ni , Jiuguang Wang , Max Simchowitz , Tao Pang

This paper presents a novel framework for stabilizing nonlinear systems represented in state-dependent form. We first reformulate the nonlinear dynamics as a state-dependent parameter-varying model and synthesize a stabilizing controller…

Systems and Control · Electrical Eng. & Systems 2025-10-21 Lidong Li , Rui Huang , Lin Zhao

The optimal controller design problem for a linear, first-order spatially-invariant distributed parameter system is considered. Through a case study of the Linear Quadratic Regulator (LQR) problem for the diffusion equation over the torus,…

Optimization and Control · Mathematics 2026-03-20 Addie McCurdy , Andrew Gusty , Emily Jensen

We propose and analyse a new methodology based on linear-quadratic regulation (LQR) for stabilising falling liquid films via blowing and suction at the base. LQR methods enable rapidly responding feedback control by precomputing a gain…

Optimization and Control · Mathematics 2023-07-11 Oscar A. Holroyd , Radu Cimpeanu , Susana N. Gomes

Recent methods for imitation learning directly learn a $Q$-function using an implicit reward formulation rather than an explicit reward function. However, these methods generally require implicit reward regularization to improve stability…

Machine Learning · Computer Science 2023-03-02 Firas Al-Hafez , Davide Tateo , Oleg Arenz , Guoping Zhao , Jan Peters

In this paper, we propose a novel dynamic state-feedback controller for polytopic linear parameter-varying (LPV) systems with constant input matrix. The controller employs a projected gradient flow method to continuously improve its control…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Armin Gießler , Felix Strehle , Jochen Illerhaus , Sören Hohmann

Quadratic discriminant analysis (QDA) is a widely used method for classification problems, particularly preferable over Linear Discriminant Analysis (LDA) for heterogeneous data. However, QDA loses its effectiveness in high-dimensional…

Machine Learning · Computer Science 2025-03-19 Wenya Luo , Hua Li , Zhidong Bai , Zhijun Liu

We explore reinforcement learning methods for finding the optimal policy in the linear quadratic regulator (LQR) problem. In particular, we consider the convergence of policy gradient methods in the setting of known and unknown parameters.…

Machine Learning · Computer Science 2021-06-25 Ben Hambly , Renyuan Xu , Huining Yang

In this paper, we will deal with a Linear Quadratic Optimal Control problem with unknown dynamics. As a modeling assumption, we will suppose that the knowledge that an agent has on the current system is represented by a probability…

Optimization and Control · Mathematics 2022-01-13 Andrea Pesare , Michele Palladino , Maurizio Falcone

Robust controllers ensure stability in feedback loops designed under uncertainty but at the cost of performance. Model uncertainty in time-invariant systems can be reduced by recently proposed learning-based methods, which improve the…

Systems and Control · Electrical Eng. & Systems 2023-01-18 Alexander von Rohr , Friedrich Solowjow , Sebastian Trimpe

This paper revisits and extends the convergence and robustness properties of value and policy iteration algorithms for discrete-time linear quadratic regulator problems. In the model-based case, we extend current results concerning the…

Systems and Control · Electrical Eng. & Systems 2025-04-11 Bowen Song , Chenxuan Wu , Andrea Iannelli

This paper presents a robust control synthesis and analysis framework for nonlinear systems with uncertain initial conditions. First, a deep learning-based lifting approach is proposed to approximate nonlinear dynamical systems with linear…

Systems and Control · Electrical Eng. & Systems 2026-01-06 Sourav Sinha , Mazen Farhood

Domain randomization (DR) enables sim-to-real transfer by training controllers on a distribution of simulated environments, with the goal of achieving robust performance in the real world. Although DR is widely used in practice and is often…

Systems and Control · Electrical Eng. & Systems 2025-04-01 Tesshu Fujinami , Bruce D. Lee , Nikolai Matni , George J. Pappas

In this paper, we solve the long-standing fundamental problem of irregular linear--quadratic (LQ) optimal control, which has received significant attention since the 1960s. We derive the optimal controllers via the key technique of finding…

Optimization and Control · Mathematics 2019-02-15 Huanshui Zhang , Juanjuan Xu

Quadratic programming is a workhorse of modern nonlinear optimization, control, and data science. Although regularized methods offer convergence guarantees under minimal assumptions on the problem data, they can exhibit the slow…

Optimization and Control · Mathematics 2026-05-18 Jeremy Bertoncini , Alberto De Marchi , Matthias Gerdts , Simon Gottschalk