English
Related papers

Related papers: Cost-Driven Representation Learning for Linear Qua…

200 papers

This paper investigates a class of unified stochastic linear quadratic Gaussian (LQG) social optima problems involving a large number of weakly-coupled interactive agents under a {generalized} setting. For each individual agent, the control…

Optimization and Control · Mathematics 2020-05-15 Zhenghong Qiu , Jianhui Huang , Tinghan Xie

The Linear Quadratic Gaussian (LQG) controller is known to be inherently fragile to model misspecifications common in real-world situations. We consider discrete-time partially observable stochastic linear systems and provide a…

Optimization and Control · Mathematics 2025-07-31 Marta Fochesato , Lucia Falconi , Mattia Zorzi , Augusto Ferrante , John Lygeros

We consider the problem of controlling a linear dynamical system from bilinear observations with minimal quadratic cost. Despite the similarity of this problem to standard linear quadratic Gaussian (LQG) control, we show that when the…

Optimization and Control · Mathematics 2025-10-23 Yahya Sattar , Sunmook Choi , Yassir Jedra , Maryam Fazel , Sarah Dean

Many applications -- including power systems, robotics, and economics -- involve a dynamical system interacting with a stochastic and hard-to-model environment. We adopt a reinforcement learning approach to control such systems.…

Optimization and Control · Mathematics 2025-08-26 Abed AlRahman Al Makdah , Oliver Kosut , Lalitha Sankar , Shaofeng Zou

This paper is concerned with risk-sensitive performance analysis for linear quantum stochastic systems interacting with external bosonic fields. We consider a cost functional in the form of the exponential moment of the integral of a…

Optimization and Control · Mathematics 2017-07-31 Igor G. Vladimirov , Ian R. Petersen , Matthew R. James

This article is concerned with learning and stochastic control in physical systems which contain unknown input signals. These unknown signals are modeled as Gaussian processes (GP) with certain parametrized covariance structures. The…

Systems and Control · Computer Science 2018-08-15 Simo Särkkä , Mauricio A. Álvarez , Neil D. Lawrence

Direct policy search has achieved great empirical success in reinforcement learning. Many recent studies have revisited its theoretical foundation for continuous control, which reveals elegant nonconvex geometry in various benchmark…

Optimization and Control · Mathematics 2023-12-27 Yang Zheng , Chih-fan Pai , Yujie Tang

Model-based reinforcement learning (RL) has proven to be a data efficient approach for learning control tasks but is difficult to utilize in domains with complex observations such as images. In this paper, we present a method for learning…

Machine Learning · Computer Science 2019-06-25 Marvin Zhang , Sharad Vikram , Laura Smith , Pieter Abbeel , Matthew J. Johnson , Sergey Levine

Computational level explanations based on optimal feedback control with signal-dependent noise have been able to account for a vast array of phenomena in human sensorimotor behavior. However, commonly a cost function needs to be assumed for…

Machine Learning · Computer Science 2021-10-22 Matthias Schultheis , Dominik Straub , Constantin A. Rothkopf

Safety-critical cyber-physical systems require control strategies whose worst-case performance is robust against adversarial disturbances and modeling uncertainties. In this paper, we present a framework for approximate control and learning…

Optimization and Control · Mathematics 2023-04-04 Aditya Dave , Ioannis Faros , Nishanth Venkatesh , Andreas A. Malikopoulos

Recently, many reinforcement learning techniques were shown to have provable guarantees in the simple case of linear dynamics, especially in problems like linear quadratic regulators. However, in practice, many reinforcement learning…

Machine Learning · Computer Science 2020-06-30 Abraham Frandsen , Rong Ge

We present a novel framework for learning cost-efficient latent representations in problems with high-dimensional state spaces through nonlinear dimension reduction. By enriching linear state approximations with low-order polynomial terms…

Numerical Analysis · Mathematics 2026-05-27 Rudy Geelen , Laura Balzano , Karen Willcox

The article poses a general model for optimal control subject to information constraints, motivated in part by recent work of Sims and others on information-constrained decision-making by economic agents. In the average-cost optimal control…

Optimization and Control · Mathematics 2016-02-24 Ehsan Shafieepoorfard , Maxim Raginsky , Sean P. Meyn

This paper revisits the classical Linear Quadratic Gaussian (LQG) control from a modern optimization perspective. We analyze two aspects of the optimization landscape of the LQG problem: 1) connectivity of the set of stabilizing controllers…

Optimization and Control · Mathematics 2021-02-09 Yang Zheng , Yujie Tang , Na Li

This paper is concerned with the linear quadratic optimal control of discrete-time time-varying system with terminal state constraint. The main contribution is to propose a Q-learning algorithm for the optimal controller when the…

Optimization and Control · Mathematics 2023-07-20 Juanjuan Xu , Jingmei Liu , Zhaorong Zhang , Wei Wang

Autonomous learning has been a promising direction in control and robotics for more than a decade since data-driven learning allows to reduce the amount of engineering knowledge, which is otherwise required. However, autonomous…

Machine Learning · Statistics 2017-10-12 Marc Peter Deisenroth , Dieter Fox , Carl Edward Rasmussen

The goal of this paper is to study a multi-objective linear quadratic Gaussian (LQG) control problem. In particular, we consider an optimal control problem minimizing a quadratic cost over a finite time horizon for linear stochastic systems…

Optimization and Control · Mathematics 2021-06-01 Donghwan Lee , Do Wan Kim

Policy gradient algorithms are widely used in reinforcement learning and belong to the class of approximate dynamic programming methods. This paper studies two key policy gradient algorithms, the Natural Policy Gradient and the Gauss-Newton…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Bowen Song , Sebastien Gros , Andrea Iannelli

We consider a discrete-time Linear-Quadratic-Gaussian (LQG) control problem in which Massey's directed information from the observed output of the plant to the control input is minimized while required control performance is attainable.…

Optimization and Control · Mathematics 2017-06-13 Takashi Tanaka , Peyman Mohajerin Esfahani , Sanjoy K. Mitter

This paper studies the problem of steering a linear time-invariant system subject to state and input constraints towards a goal location that may be inferred only through partial observations. We assume mixed-observable settings, where the…

Optimization and Control · Mathematics 2022-11-22 Ugo Rosolia , Yuxiao Chen , Shreyansh Daftry , Masahiro Ono , Yisong Yue , Aaron D. Ames