English
Related papers

Related papers: A PAC-Bayes Approach for Controlling Unknown Linea…

200 papers

We introduce a new framework for studying meta-learning methods using PAC-Bayesian theory. Its main advantage over previous work is that it allows for more flexibility in how the transfer of knowledge between tasks is realized. For previous…

Machine Learning · Computer Science 2024-05-30 Hossein Zakerinia , Amin Behjati , Christoph H. Lampert

We make three related contributions motivated by the challenge of training stochastic neural networks, particularly in a PAC-Bayesian setting: (1) we show how averaging over an ensemble of stochastic neural networks enables a new class of…

Machine Learning · Computer Science 2021-12-16 Felix Biggs , Benjamin Guedj

A robust model predictive control scheme for a class of constrained norm-bounded uncertain discrete-time linear systems is developed under the hypothesis that only partial state measurements are available for feedback. Off-line calculations…

Systems and Control · Computer Science 2018-07-23 Giuseppe Franzè , Massimiliano Mattei , Luciano Ollio , Valerio Scordamaglia

Finding optimal feedback controllers for nonlinear dynamic systems from data is hard. Recently, Bayesian optimization (BO) has been proposed as a powerful framework for direct controller tuning from experimental trials. For selecting the…

Systems and Control · Computer Science 2018-02-07 Alonso Marco , Philipp Hennig , Stefan Schaal , Sebastian Trimpe

PAC-Bayes learning is a comprehensive setting for (i) studying the generalisation ability of learning algorithms and (ii) deriving new learning algorithms by optimising a generalisation bound. However, optimising generalisation bounds might…

Machine Learning · Statistics 2024-11-27 Antoine Picard-Weibel , Roman Moscoviz , Benjamin Guedj

Control systems operating in the real world face countless sources of unpredictable uncertainties. These random disturbances can render deterministic guarantees inapplicable and cause catastrophic safety failures. To overcome this, this…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Pol Mestres , Blake Werner , Ryan K. Cosner , Aaron D. Ames

One of the defining properties of deep learning is that models are chosen to have many more parameters than available training data. In light of this capacity for overfitting, it is remarkable that simple algorithms like SGD reliably return…

Machine Learning · Computer Science 2017-10-20 Gintare Karolina Dziugaite , Daniel M. Roy

Many practical machine learning tasks can be framed as Structured prediction problems, where several output variables are predicted and considered interdependent. Recent theoretical advances in structured prediction have focused on…

Machine Learning · Computer Science 2020-12-22 Théophile Cantelobre , Benjamin Guedj , María Pérez-Ortiz , John Shawe-Taylor

By leveraging experience from previous tasks, meta-learning algorithms can achieve effective fast adaptation ability when encountering new tasks. However it is unclear how the generalization property applies to new tasks. Probably…

Machine Learning · Computer Science 2021-02-09 Tianyu Liu , Jie Lu , Zheng Yan , Guangquan Zhang

This paper studies the linear quadratic regulator (LQR) problem over an unknown Bernoulli packet loss channel. The unknown loss rate is estimated using finite channel samples and a certainty-equivalence (CE) optimal controller is then…

Systems and Control · Electrical Eng. & Systems 2025-06-17 Zhenning Zhang , Liang Xu , Yilin Mo , Xiaofan Wang

This paper studies a discrete-time stochastic control problem with linear quadratic criteria over an infinite-time horizon. We focus on a class of control systems whose system matrices are associated with random parameters involving unknown…

Optimization and Control · Mathematics 2022-01-17 Zhaorong Zhang , Juanjuan Xu , Xun Li

Deep Probabilistic Programming (DPP) allows powerful models based on recursive computation to be learned using efficient deep-learning optimization techniques. Additionally, DPP offers a unified perspective, where inference and learning…

Machine Learning · Computer Science 2022-03-31 Jonathan Warrell , Mark Gerstein

In this paper, we present an approach for designing correct-by-design controllers for cyber-physical systems composed of multiple dynamically interconnected uncertain systems. We consider networked discrete-time uncertain nonlinear systems…

Systems and Control · Electrical Eng. & Systems 2023-09-06 Oliver Schön , Birgit van Huijgevoort , Sofie Haesaert , Sadegh Soudjani

This paper presents a strictly convex chance-constrained stochastic control framework that accounts for uncertainty in control specifications such as reference trajectories and operational constraints. By jointly optimizing control inputs…

Systems and Control · Electrical Eng. & Systems 2026-01-27 Teruki Kato , Ryotaro Shima , Kenji Kashima

Inductive Conformal Prediction (ICP) provides a practical and effective approach for equipping deep learning models with uncertainty estimates in the form of set-valued predictions which are guaranteed to contain the ground truth with high…

Machine Learning · Computer Science 2023-12-11 Apoorva Sharma , Sushant Veer , Asher Hancock , Heng Yang , Marco Pavone , Anirudha Majumdar

Despite the celebrated success of stochastic control approaches for uncertain systems, such approaches are limited in the ability to handle non-Gaussian uncertainties. This work presents an adaptive robust control for linear uncertain…

Optimization and Control · Mathematics 2026-01-13 Xuehui Ma , Shiliang Zhang , Zhiyong Sun , Xiaohui Zhang , Sabita Maharjan

In this paper we develop a novel, discrete-time optimal control framework for mechanical systems with uncertain model parameters. We consider finite-horizon problems where the performance index depends on the statistical moments of the…

Optimization and Control · Mathematics 2017-05-17 George I. Boutselis , Yunpeng Pan , Gerardo De La Tore , Evangelos A. Theodorou

We study the generalization error of randomized learning algorithms -- focusing on stochastic gradient descent (SGD) -- using a novel combination of PAC-Bayes and algorithmic stability. Importantly, our generalization bounds hold for all…

Machine Learning · Computer Science 2020-06-23 Ben London

We present new PAC-Bayesian generalisation bounds for learning problems with unbounded loss functions. This extends the relevance and applicability of the PAC-Bayes learning framework, where most of the existing literature focuses on…

Machine Learning · Statistics 2021-12-16 Maxime Haddouche , Benjamin Guedj , Omar Rivasplata , John Shawe-Taylor

Safe control of constrained linear systems under both epistemic and aleatory uncertainties is considered. The aleatory uncertainty characterizes random noises and is modeled by a probability distribution function (PDF) and the epistemic…

Systems and Control · Electrical Eng. & Systems 2022-10-28 Hamidreza Modares