English
Related papers

Related papers: Domain Randomization is Sample Efficient for Linea…

200 papers

This paper studies the linear quadratic regulator (LQR) problem over an unknown Bernoulli packet loss channel. The unknown loss rate is estimated using finite channel samples and a certainty-equivalence (CE) optimal controller is then…

Systems and Control · Electrical Eng. & Systems 2025-06-17 Zhenning Zhang , Liang Xu , Yilin Mo , Xiaofan Wang

This paper is concerned with the linear quadratic optimal control of discrete-time time-varying system with terminal state constraint. The main contribution is to propose a Q-learning algorithm for the optimal controller when the…

Optimization and Control · Mathematics 2023-07-20 Juanjuan Xu , Jingmei Liu , Zhaorong Zhang , Wei Wang

We investigate the problem of learning linear quadratic regulators (LQR) in a multi-task, heterogeneous, and model-free setting. We characterize the stability and personalization guarantees of a policy gradient-based (PG) model-agnostic…

Optimization and Control · Mathematics 2024-06-04 Leonardo F. Toso , Donglin Zhan , James Anderson , Han Wang

With the ability to learn from static datasets, Offline Reinforcement Learning (RL) emerges as a compelling avenue for real-world applications. However, state-of-the-art offline RL algorithms perform sub-optimally when confronted with…

Machine Learning · Computer Science 2024-06-12 Briti Gangopadhyay , Zhao Wang , Jia-Fong Yeh , Shingo Takamatsu

Linear Quadratic Regulator (LQR) design is one of the most classical optimal control problems, whose well-known solution is an input sequence expressed as a state-feedback. In this work, finite-horizon and discrete-time LQR is solved under…

Optimization and Control · Mathematics 2020-01-17 Anna Scampicchio , Aleksandr Aravkin , Gianluigi Pillonetto

We study the problem of probability distribution matching and sampling on near-term quantum computers, aiming to construct parameterized circuits that generate samples from a target distribution while minimizing resource overhead. This task…

Quantum Physics · Physics 2026-05-26 Nicholas S. DiBrita , Jason Han , Krishna Bhatia , Younghyun Cho , Hengrui Luo , Tirthak Patel

Contact-rich manipulation plays an important role in human daily activities, but uncertain parameters pose significant challenges for robots to achieve comparable performance through planning and control. To address this issue, domain…

Robotics · Computer Science 2024-10-16 Teng Xue , Amirreza Razmjoo , Suhan Shetty , Sylvain Calinon

In this paper, we study the statistical difficulty of learning to control linear systems. We focus on two standard benchmarks, the sample complexity of stabilization, and the regret of the online learning of the Linear Quadratic Regulator…

Machine Learning · Computer Science 2022-05-30 Anastasios Tsiamis , Ingvar Ziemann , Manfred Morari , Nikolai Matni , George J. Pappas

We solve a linear quadratic optimal control problem for sampled-data systems with stochastic delays. The delays are stochastically determined by the last few delays. The proposed optimal controller can be efficiently computed by iteratively…

Optimization and Control · Mathematics 2018-05-18 Masashi Wakaiki , Masaki Ogura , Joao P. Hespanha

Successful robotic operation in stochastic environments relies on accurate characterization of the underlying probability distributions, yet this is often imperfect due to limited knowledge. This work presents a control algorithm that is…

Robotics · Computer Science 2021-01-19 Haruki Nishimura , Negar Mehr , Adrien Gaidon , Mac Schwager

We study control of constrained linear systems with only partial statistical information about the uncertainty affecting the system dynamics and the sensor measurements. Specifically, given a finite collection of disturbance realizations…

Optimization and Control · Mathematics 2024-07-15 Jean-Sébastien Brouillon , Andrea Martin , John Lygeros , Florian Dörfler , Giancarlo Ferrari Trecate

In this paper, we consider robust control using randomized algorithms. We extend the existing order statistics distribution theory to the general case in which the distribution of population is not assumed to be continuous and the order…

Optimization and Control · Mathematics 2008-05-13 Xinjia Chen , Kemin Zhou

When learning policies for robot control, the required real-world data is typically prohibitively expensive to acquire, so learning in simulation is a popular strategy. Unfortunately, such polices are often not transferable to the real…

Machine Learning · Computer Science 2021-06-22 Fabio Muratore , Christian Eilers , Michael Gienger , Jan Peters

This paper studies an infinite horizon optimal control problem for discrete-time linear systems and quadratic criteria, both with random parameters which are independent and identically distributed with respect to time. A classical approach…

Optimization and Control · Mathematics 2020-11-11 Kai Du , Qingxin Meng , Fu Zhang

A fundamental assumption of most machine learning algorithms is that the training and test data are drawn from the same underlying distribution. However, this assumption is violated in almost all practical applications: machine learning…

Machine Learning · Computer Science 2021-12-02 Marvin Zhang , Henrik Marklund , Nikita Dhawan , Abhishek Gupta , Sergey Levine , Chelsea Finn

Low-rank representation learning has emerged as a powerful tool for recovering missing values in power load data due to its ability to exploit the inherent low-dimensional structures of spatiotemporal measurements. Among various techniques,…

Machine Learning · Computer Science 2025-06-24 Yan Xia , Hao Feng , Hongwei Sun , Junjie Wang , Qicong Hu

This paper considers the linear-quadratic dual control problem where the system parameters need to be identified and the control objective needs to be optimized in the meantime. Contrary to existing works on data-driven linear-quadratic…

Systems and Control · Electrical Eng. & Systems 2021-11-22 Yiwen Lu , Yilin Mo

Incorporating domain knowledge into the modeling process is an effective way to improve learning accuracy. However, as it is provided by humans, domain knowledge can only be specified with some degree of uncertainty. We propose to…

Machine Learning · Computer Science 2012-05-14 Yi Mao , Guy Lebanon

We explore reinforcement learning methods for finding the optimal policy in the linear quadratic regulator (LQR) problem. In particular, we consider the convergence of policy gradient methods in the setting of known and unknown parameters.…

Machine Learning · Computer Science 2021-06-25 Ben Hambly , Renyuan Xu , Huining Yang

Researchers have been facing a difficult problem that data generation mechanisms could be influenced by internal or external factors leading to the training and test data with quite different distributions, consequently traditional…

Machine Learning · Statistics 2021-10-14 Anqi Wu