English
Related papers

Related papers: Transfer Learning for LQR Control

200 papers

In this paper, we leverage ideas from model-based control to address the sample efficiency problem of reinforcement learning (RL) algorithms. Accelerating learning is an active field of RL highly relevant in the context of time-varying…

Systems and Control · Electrical Eng. & Systems 2023-05-23 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

Linear Quadratic Regulator (LQR) design is one of the most classical optimal control problems, whose well-known solution is an input sequence expressed as a state-feedback. In this work, finite-horizon and discrete-time LQR is solved under…

Optimization and Control · Mathematics 2020-01-17 Anna Scampicchio , Aleksandr Aravkin , Gianluigi Pillonetto

The principal task to control dynamical systems is to ensure their stability. When the system is unknown, robust approaches are promising since they aim to stabilize a large set of plausible systems simultaneously. We study linear…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Lenart Treven , Sebastian Curi , Mojmir Mutny , Andreas Krause

Robust and adaptive control strategies are needed when robots or automated systems are introduced to unknown and dynamic environments where they are required to cope with disturbances, unmodeled dynamics, and parametric uncertainties. In…

Robotics · Computer Science 2018-07-17 Karime Pereida , Dave Kooijman , Rikky R. P. R. Duivenvoorden , Angela P. Schoellig

This paper delves into designing stabilizing feedback control gains for continuous linear systems with unknown state matrix, in which the control is subject to a general structural constraint. We bring forth the ideas from reinforcement…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Sayak Mukherjee , Thanh Long Vu

We investigate the problem of learning linear quadratic regulators (LQR) in a multi-task, heterogeneous, and model-free setting. We characterize the stability and personalization guarantees of a policy gradient-based (PG) model-agnostic…

Optimization and Control · Mathematics 2024-06-04 Leonardo F. Toso , Donglin Zhan , James Anderson , Han Wang

We propose an online learning algorithm that adaptively designs a decentralized linear quadratic regulator when the system model is unknown a priori and new data samples from a single system trajectory become progressively available. The…

Optimization and Control · Mathematics 2024-07-08 Lintao Ye , Ming Chi , Ruiquan Liao , Vijay Gupta

This manuscript surveys reinforcement learning from the perspective of optimization and control with a focus on continuous control applications. It surveys the general formulation, terminology, and typical experimental implementations of…

Optimization and Control · Mathematics 2018-11-13 Benjamin Recht

We consider adaptive control of the Linear Quadratic Regulator (LQR), where an unknown linear system is controlled subject to quadratic costs. Leveraging recent developments in the estimation of linear systems and in robust controller…

Machine Learning · Computer Science 2018-05-25 Sarah Dean , Horia Mania , Nikolai Matni , Benjamin Recht , Stephen Tu

We introduce a new problem setting for continuous control called the LQR with Rich Observations, or RichLQR. In our setting, the environment is summarized by a low-dimensional continuous latent state with linear dynamics and quadratic…

In this paper, we propose an approach for transferring the knowledge of a neural model for sequence labeling, learned from the source domain, to a new model trained on a target domain, where new label categories appear. Our transfer…

Computation and Language · Computer Science 2019-02-15 Lingzhen Chen , Alessandro Moschitti

Over-actuated systems often make it possible to achieve specific performances by switching between different subsets of actuators. However, when the system parameters are unknown, transferring authority to different subsets of actuators is…

Systems and Control · Electrical Eng. & Systems 2023-10-04 Jafar Abbaszadeh Chekan , Cédric Langbort

Transfer learning aims at improving the performance of target learners on target domains by transferring the knowledge contained in different but related source domains. In this way, the dependence on a large number of target domain data…

Machine Learning · Computer Science 2020-06-24 Fuzhen Zhuang , Zhiyuan Qi , Keyu Duan , Dongbo Xi , Yongchun Zhu , Hengshu Zhu , Hui Xiong , Qing He

The aim in this paper is to apply the iLQR, iterative Linear Quadratic Regulator, to control the movement of a mobile robot following an already defined trajectory. This control strategy has proven its utility for nonlinear systems. As…

Systems and Control · Electrical Eng. & Systems 2024-04-30 Ayoub Aaqaoui , Yousif Mohammed Elsheikh Mohammed

Transfer Learning (TL) is an efficient machine learning paradigm that allows overcoming some of the hurdles that characterize the successful training of deep neural networks, ranging from long training times to the needs of large datasets.…

Machine Learning · Computer Science 2021-11-24 Matthia Sabatelli , Pierre Geurts

This paper studies the robustness of reinforcement learning algorithms to errors in the learning process. Specifically, we revisit the benchmark problem of discrete-time linear quadratic regulation (LQR) and study the long-standing open…

Optimization and Control · Mathematics 2021-03-16 Bo Pang , Zhong-Ping Jiang

Transfer learning plays a key role in modern data analysis when: (1) the target data are scarce but the source data are sufficient; (2) the distributions of the source and target data are heterogeneous. This paper develops an interpretable…

Machine Learning · Statistics 2024-01-31 Shuo Shuo Liu

Quantile regression is increasingly encountered in modern big data applications due to its robustness and flexibility. We consider the scenario of learning the conditional quantiles of a specific target population when the available data…

Statistics Theory · Mathematics 2024-02-27 Jun Jin , Jun Yan , Robert H. Aseltine , Kun Chen

We study transfer learning for estimation in latent variable network models. In our setting, the conditional edge probability matrices given the latent variables are represented by $P$ for the source and $Q$ for the target. We wish to…

Machine Learning · Computer Science 2024-06-07 Akhil Jalan , Arya Mazumdar , Soumendu Sundar Mukherjee , Purnamrita Sarkar

Latent space model plays a crucial role in network analysis, and accurate estimation of latent variables is essential for downstream tasks such as link prediction. However, the large number of parameters to be estimated presents a…

Methodology · Statistics 2025-09-22 Kuangnan Fang , Ruixuan Qin , Xinyan Fan