English
Related papers

Related papers: Cost-Driven Representation Learning for Linear Qua…

200 papers

We consider the problem of controlling a linear dynamical system from bilinear observations with minimal quadratic cost. Despite the similarity of this problem to standard linear quadratic Gaussian (LQG) control, we show that when the…

Optimization and Control · Mathematics 2025-10-23 Yahya Sattar , Sunmook Choi , Yassir Jedra , Maryam Fazel , Sarah Dean

Scaling end-to-end reinforcement learning to control real robots from vision presents a series of challenges, in particular in terms of sample efficiency. Against end-to-end learning, state representation learning can help learn a compact,…

Machine Learning · Computer Science 2019-06-25 Antonin Raffin , Ashley Hill , René Traoré , Timothée Lesort , Natalia Díaz-Rodríguez , David Filliat

Reinforcement learning provides a framework for learning to control which actions to take towards completing a task through trial-and-error. In many applications observing interactions is costly, necessitating sample-efficient learning. In…

Machine Learning · Statistics 2020-11-04 Charles Gadd , Markus Heinonen , Harri Lähdesmäki , Samuel Kaski

Successful applications of reinforcement learning in real-world problems often require dealing with partially observable states. It is in general very challenging to construct and infer hidden states as they often depend on the agent's…

Machine Learning · Computer Science 2015-11-20 Xiujun Li , Lihong Li , Jianfeng Gao , Xiaodong He , Jianshu Chen , Li Deng , Ji He

We study the problem of learning to stabilize (LTS) a linear time-invariant (LTI) system. Policy gradient (PG) methods for control assume access to an initial stabilizing policy. However, designing such a policy for an unknown system is one…

Machine Learning · Computer Science 2025-05-07 Leonardo F. Toso , Lintao Ye , James Anderson

Consider a control problem with a communication channel connecting the observer of a linear stochastic system to the controller. The goal of the controller is to minimize a quadratic cost function in the state variables and control signal,…

Information Theory · Computer Science 2018-11-27 Victoria Kostina , Babak Hassibi

In this report, linear quadratic regulator is used to design adaptive cruise control system. In the regulator, Q and R parameters vary with time according to current traffic situations. Phase-plant method is used to give constraints on Q…

Systems and Control · Electrical Eng. & Systems 2020-08-06 Yuncheng Jiang

Deep reinforcement learning (RL) algorithms suffer severe performance degradation when the interaction data is scarce, which limits their real-world application. Recently, visual representation learning has been shown to be effective and…

Machine Learning · Computer Science 2022-08-17 Yang Yue , Bingyi Kang , Zhongwen Xu , Gao Huang , Shuicheng Yan

Recent work on data-driven control and reinforcement learning has renewed interest in a relative old field in control theory: model-free optimal control approaches which work directly with a cost function and do not rely upon perfect…

Optimization and Control · Mathematics 2021-08-31 Eduardo D. Sontag

We investigate a Linear-Quadratic-Gaussian (LQG) control and sensing co-design problem, where one jointly designs sensing and control policies. We focus on the realistic case where the sensing design is selected among a finite set of…

Optimization and Control · Mathematics 2020-05-20 Vasileios Tzoumas , Luca Carlone , George J. Pappas , Ali Jadbabaie

We propose a methodology for performing risk-averse quadratic regulation of partially observed Linear Time-Invariant (LTI) systems disturbed by process and output noise. To compensate against the induced variability due to both types of…

Optimization and Control · Mathematics 2022-04-20 Nikolas Koumpis , Anastasios Tsiamis , Dionysios Kalogerias

Offline reinforcement learning leverages large datasets to train policies without interactions with the environment. The learned policies may then be deployed in real-world settings where interactions are costly or dangerous. Current…

Machine Learning · Computer Science 2022-06-29 Matthias Weissenbacher , Samarth Sinha , Animesh Garg , Yoshinobu Kawahara

We study in this paper a class of constrained linear-quadratic (LQ) optimal control problem formulations for the scalar-state stochastic system with multiplicative noise, which has various applications, especially in the financial risk…

Systems and Control · Computer Science 2017-09-19 Weipin Wu , Jianjun Gao , Duan Li , Yun Shi

We consider the problem of controlling an unknown linear dynamical system under a stochastic convex cost and full feedback of both the state and cost function. We present a computationally efficient algorithm that attains an optimal…

Optimization and Control · Mathematics 2022-06-23 Asaf Cassel , Alon Cohen , Tomer Koren

Humans excel in continuously learning with small data without forgetting how to solve old problems. However, neural networks require large datasets to compute latent representations across different tasks while minimizing a loss function.…

Machine Learning · Computer Science 2019-11-21 Omar U. Florez , Erik Mueller

Reinforcement learning (RL) has seen significant research and application results but often requires large amounts of training data. This paper proposes two data-efficient off-policy RL methods that use parametrized Q-learning. In these…

Systems and Control · Electrical Eng. & Systems 2025-04-09 J. S. van Hulst , W. P. M. H. Heemels , D. J. Antunes

Recently, many reinforcement learning techniques were shown to have provable guarantees in the simple case of linear dynamics, especially in problems like linear quadratic regulators. However, in practice, many reinforcement learning…

Machine Learning · Computer Science 2020-06-30 Abraham Frandsen , Rong Ge

First order policy optimization has been widely used in reinforcement learning. It guarantees to find the optimal policy for the state-feedback linear quadratic regulator (LQR). However, the performance of policy optimization remains…

Optimization and Control · Mathematics 2022-04-05 Yang Zheng , Yue Sun , Maryam Fazel , Na Li

The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can…

Machine Learning · Computer Science 2024-02-12 Somjit Nath , Rushiv Arora , Samira Ebrahimi Kahou

Efficient representation of patients is very important in the healthcare domain and can help with many tasks such as medical risk prediction. Many existing methods, such as diagnostic Cost Groups (DCG), rely on expert knowledge to build…

Machine Learning · Computer Science 2019-09-17 Xianlong Zeng , Soheil Moosavinasab , En-Ju D Lin , Simon Lin , Razvan Bunescu , Chang Liu