English
Related papers

Related papers: Kullback-Leibler control for discrete-time nonline…

200 papers

A loss function measures the discrepancy between the true values (observations) and their estimated fits, for a given instance of data. A loss function is said to be proper (unbiased, Fisher consistent) if the fits are defined over a unit…

Information Theory · Computer Science 2018-05-11 Amichai Painsky , Gregory W. Wornell

This paper is concerned with the linear/nonlinear Kalman-like filtering problem under binary sensors. Since innovation represents new information in the sensor measurement and serves to correct the prediction for the Kalman-like filter…

Systems and Control · Electrical Eng. & Systems 2021-10-28 Zhongyao Hu , Bo Chen , Yuchen Zhang , Li Yu

In this paper, we delve deeper into the Kullback-Leibler (KL) Divergence loss and mathematically prove that it is equivalent to the Decoupled Kullback-Leibler (DKL) Divergence loss that consists of (1) a weighted Mean Square Error (wMSE)…

Machine Learning · Computer Science 2025-03-12 Jiequan Cui , Beier Zhu , Qingshan Xu , Zhuotao Tian , Xiaojuan Qi , Bei Yu , Hanwang Zhang , Richang Hong

We study model-free learning methods for the output-feedback Linear Quadratic (LQ) control problem in finite-horizon subject to subspace constraints on the control policy. Subspace constraints naturally arise in the field of distributed…

Systems and Control · Electrical Eng. & Systems 2021-07-14 Luca Furieri , Yang Zheng , Maryam Kamgarpour

Semantic communications based on deep joint source-channel coding (JSCC) aim to improve communication efficiency by transmitting only task-relevant information. However, ensuring robustness to the stochasticity of communication channels…

Signal Processing · Electrical Eng. & Systems 2025-03-18 Taewoo Park , Eunhye Hong , Yo-Seb Jeon , Namyoon Lee , Yongjune Kim

Time delays are ubiquitous in industrial processes, and they must be accounted for when designing control algorithms because they have a significant effect on the process dynamics. Therefore, in this work, we propose a simultaneous approach…

Optimization and Control · Mathematics 2024-10-22 Tobias K. S. Ritschel

We consider the fundamental problem of estimating a discrete distribution on a domain of size $K$ with high probability in Kullback-Leibler divergence. We provide upper and lower bounds on the minimax estimation rate, which show that the…

Machine Learning · Statistics 2026-02-23 Dirk van der Hoeven , Julia Olkhovskaia , Tim van Erven

The question of controllability is investigated for a quantum control system in which the Hamiltonian operator components carry explicit time dependence which is not under the control of an external agent. We consider the general situation…

Quantum Physics · Physics 2009-11-10 Chunhua Lan , Tzyh-Jong Tarn , Quo-Shin Chi , John W. Clark

This paper focuses on adaptive control of the discrete-time linear quadratic regulator (adaptive LQR). Recent literature has made significant contributions in proving non-asymptotic convergence rates, but existing approaches have a few…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Peter A. Fisher , Anuradha M. Annaswamy

Reachable sets of nonlinear control systems can in general only be approximated numerically, and these approximations are typically very expensive to compute. In this paper, we explore a strategy for choosing the temporal and spatial…

Numerical Analysis · Mathematics 2023-07-24 Janosch Rieger , Kyria Wawryk

This work presents a novel algorithm for impulsive optimal control of linear time-varying systems with the inclusion of input magnitude constraints. Impulsive optimal control problems, where the optimal input solution is a sum of delta…

Optimization and Control · Mathematics 2026-03-17 Ethan Foss , Simone D'Amico

Recent Reinforcement Learning (RL) algorithms making use of Kullback-Leibler (KL) regularization as a core component have shown outstanding performance. Yet, only little is understood theoretically about why KL regularization helps, so far.…

Machine Learning · Computer Science 2021-01-07 Nino Vieillard , Tadashi Kozuno , Bruno Scherrer , Olivier Pietquin , Rémi Munos , Matthieu Geist

A default assumption in reinforcement learning (RL) and optimal control is that observations arrive at discrete time points on a fixed clock cycle. Yet, many applications involve continuous-time systems where the time discretization, in…

Machine Learning · Computer Science 2024-01-17 Zichen Zhang , Johannes Kirschner , Junxi Zhang , Francesco Zanini , Alex Ayoub , Masood Dehghan , Dale Schuurmans

Universal hypothesis testing refers to the problem of deciding whether samples come from a nominal distribution or an unknown distribution that is different from the nominal distribution. Hoeffding's test, whose test statistic is equivalent…

Information Theory · Computer Science 2017-11-15 Pengfei Yang , Biao Chen

We provide a functional view of distributional robustness motivated by robust statistics and functional analysis. This results in two practical computational approaches for approximate distributionally robust nonlinear optimization based on…

Systems and Control · Electrical Eng. & Systems 2021-10-27 Yassine Nemmour , Bernhard Schölkopf , Jia-Jie Zhu

Quantum phenomena of interest in connection with applications to computation and communication almost always involve generating specific transfers between eigenstates, and their linear superpositions. For some quantum systems, such as spin…

Quantum Physics · Physics 2016-11-18 A. M. Bloch , R. W. Brockett , C. Rangan

Robust control of complex engineered and biological systems hinges on the integration of feedforward and feedback mechanisms. This is exemplified in neural motor control, where feedforward muscle co-contraction complements sensory-driven…

Optimization and Control · Mathematics 2026-03-06 Bastien Berret , Frédéric Jean

The optimal control of a mechanical system is of crucial importance in many realms. Typical examples are the determination of a time-minimal path in vehicle dynamics, a minimal energy trajectory in space mission design, or optimal motion…

Optimization and Control · Mathematics 2008-10-09 S. Ober-Bloebaum , O. Junge , J. E. Marsden

Linear time-invariant control systems can be considered as finitely generated modules over the commutative principal ideal ring $\mathbb{R}[\frac{d}{dt}]$ of linear differential operators with respect to the time derivative. The Kalman…

Optimization and Control · Mathematics 2025-12-15 Cédric Join , Emmanuel Delaleau , Michel Fliess

We introduce a mini-batch stochastic variance-reduced algorithm to solve finite-sum scale invariant problems which cover several examples in machine learning and statistics such as principal component analysis (PCA) and estimation of…

Optimization and Control · Mathematics 2023-04-25 Cheolmin Kim , Youngseok Kim , Diego Klabjan