English
Related papers

Related papers: Comparative Study of Q-Learning for State-Feedback…

200 papers

A study of the linear quadratic (LQ) control problem on a finite time interval for a model equation in Hilbert spaces which comprehends the memory of the inputs was performed recently by the authors. The outcome included a closed-loop…

Optimization and Control · Mathematics 2025-03-19 Paolo Acquistapace , Francesca Bucci

We consider the problem of controlling a linear dynamical system from bilinear observations with minimal quadratic cost. Despite the similarity of this problem to standard linear quadratic Gaussian (LQG) control, we show that when the…

Optimization and Control · Mathematics 2025-10-23 Yahya Sattar , Sunmook Choi , Yassir Jedra , Maryam Fazel , Sarah Dean

This paper investigates a model-free solution to the stochastic linear quadratic regulation (LQR) problem for linear discrete-time systems with both multiplicative and additive noises. We formulate the stochastic LQR problem as a nonconvex…

Optimization and Control · Mathematics 2025-12-25 Jing Guo , Xiushan Jiang , Weihai Zhang

The linear quadratic regulator (LQR) problem has reemerged as an important theoretical benchmark for reinforcement learning-based control of complex dynamical systems with continuous state and action spaces. In contrast with nearly all…

Machine Learning · Computer Science 2020-05-04 Benjamin Gravell , Peyman Mohajerin Esfahani , Tyler Summers

We consider the problem of controlling a possibly unknown linear dynamical system with adversarial perturbations, adversarially chosen convex loss functions, and partially observed states, known as non-stochastic control. We introduce a…

Machine Learning · Computer Science 2020-06-26 Max Simchowitz , Karan Singh , Elad Hazan

In this paper, we present the combined learning-and-control (CLC) approach, which is a new way to solve optimal control problems with unknown dynamics by unifying model-based control and data-driven learning. The key idea is simple: we…

Systems and Control · Electrical Eng. & Systems 2025-10-02 Panagiotis Kounatidis , Andreas A. Malikopoulos

Stochastic Optimal Control models represent the state-of-the-art in modeling goal-directed human movements. The linear-quadratic sensorimotor (LQS) model based on signal-dependent noise processes in state and output equation is the current…

Optimization and Control · Mathematics 2023-03-28 Philipp Karg , Simon Stoll , Simon Rothfuß , Sören Hohmann

In this paper, we define and solve the Inverse Stochastic Optimal Control (ISOC) problem of the linear-quadratic Gaussian (LQG) and the linear-quadratic sensorimotor (LQS) control model. These Stochastic Optimal Control (SOC) models are…

Optimization and Control · Mathematics 2022-11-01 Philipp Karg , Simon Stoll , Simon Rothfuß , Sören Hohmann

Robust control design for quantum systems has been recognized as a key task in the development of practical quantum technology. In this paper, we present a systematic numerical methodology of sampling-based learning control (SLC) for…

Quantum Physics · Physics 2016-03-29 Daoyi Dong , Mohamed A. Mabrok , Ian R. Petersen , Bo Qi , Chunlin Chen , Herschel Rabitz

This paper is a continuation work of Ren et al. (2026) aiming to further devise q-learning algorithms for mean-field control (MFC) with controlled common noise. Based on the relaxed control formulation, we first establish the martingale…

Optimization and Control · Mathematics 2026-05-01 Zhenjie Ren , Xiaoli Wei , Xiang Yu , Xun Yu Zhou

If NISQ-era quantum computers are to perform useful tasks, they will need to employ powerful error mitigation techniques. Quasi-probability methods can permit perfect error compensation at the cost of additional circuit executions, provided…

Quantum Physics · Physics 2022-02-14 Armands Strikis , Dayue Qin , Yanzhu Chen , Simon C. Benjamin , Ying Li

It is well-known that linear dynamical systems with Gaussian noise and quadratic cost (LQG) satisfy a separation principle. Finding the optimal controller amounts to solving separate dual problems; one for control and one for estimation.…

Systems and Control · Computer Science 2013-09-10 Laurent Lessard , Ashutosh Nayyar

Unlike traditional model-based reinforcement learning approaches that estimate system parameters from data, non-model-based data-driven control learns the optimal policy directly from input-state data without any intermediate model…

Optimization and Control · Mathematics 2026-05-05 Leilei Cui , Zhong-Ping Jiang , Petter N. Kolm , Grégoire G. Macqueron

Efficiently characterizing large quantum states and processes is a central yet notoriously challenging task in quantum information science, as conventional tomography methods typically require resources that grow exponentially with system…

Quantum Physics · Physics 2026-03-03 Chenyang Li , Shengxin Zhuang , Yukun Zhang , Jingbo B. Wang , Xiao Yuan , Yusen Wu , Chuan Wang

This article investigates the modeling and control of Lagrangian systems involving non-conservative forces using a hybrid method that does not require acceleration calculations. It focuses in particular on the derivation and identification…

Systems and Control · Electrical Eng. & Systems 2025-12-03 Ibrahim Laiche , Mokrane Boudaoud , Patrick Gallinari , Pascal Morin

We study a model-free federated linear quadratic regulator (LQR) problem where M agents with unknown, distinct yet similar dynamics collaboratively learn an optimal policy to minimize an average quadratic cost while keeping their data…

Optimization and Control · Mathematics 2023-08-24 Han Wang , Leonardo F. Toso , Aritra Mitra , James Anderson

Stochastic optimal control usually requires an explicit dynamical model with probability distributions, which are difficult to obtain in practice. In this work, we consider the linear quadratic regulator (LQR) problem of unknown linear…

Optimization and Control · Mathematics 2023-01-18 Feiran Zhao , Keyou You

In this paper, we propose a novel learning-based robust feedback linearization strategy to ensure precise trajectory tracking for an important family of Lagrangian systems. We assume a nominal knowledge of the dynamics is given but no…

Robotics · Computer Science 2025-07-16 Giulio Giacomuzzo , Mohamed Abdelwahab , Marco Calì , Alberto Dalla Libera , Ruggero Carli

The principal task to control dynamical systems is to ensure their stability. When the system is unknown, robust approaches are promising since they aim to stabilize a large set of plausible systems simultaneously. We study linear…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Lenart Treven , Sebastian Curi , Mojmir Mutny , Andreas Krause

In the reinforcement learning literature, strong theoretical guarantees have been obtained for algorithms applicable to LTI systems. However, in the nonlinear case only weaker results have been obtained for algorithms that mostly rely on…

Systems and Control · Electrical Eng. & Systems 2026-04-01 Victor G. Lopez , Malte Heinrich , Matthias A. Müller