English
Related papers

Related papers: PAC-Bayesian-Like Error Bound for a Class of Linea…

200 papers

We consider the continuous-time setting of linear time-invariant (LTI) systems in feedback with multiplicative stochastic uncertainties. The objective of the paper is to characterize the conditions of Mean-Square Stability (MSS) using a…

Systems and Control · Computer Science 2018-06-26 Maurice Filo , Bassam Bamieh

Discovering a suitable neural network architecture for modeling complex dynamical systems poses a formidable challenge, often involving extensive trial and error and navigation through a high-dimensional hyper-parameter space. In this…

Machine Learning · Computer Science 2024-03-26 Chinmay Datar , Adwait Datar , Felix Dietrich , Wil Schilders

This thesis focuses on the discovery of stochastic differential equations (SDEs) and stochastic partial differential equations (SPDEs) from noisy and discrete time series. A major challenge is selecting the simplest possible correct model…

Machine Learning · Statistics 2025-07-08 Andonis Gerardos

We study online control of time-varying linear systems with unknown dynamics in the nonstochastic control model. At a high level, we demonstrate that this setting is \emph{qualitatively harder} than that of either unknown time-invariant or…

Machine Learning · Computer Science 2022-02-17 Edgar Minasyan , Paula Gradu , Max Simchowitz , Elad Hazan

Deep learning is renowned for its theory-practice gap, whereby principled theory typically fails to provide much beneficial guidance for implementation in practice. This has been highlighted recently by the benign overfitting phenomenon:…

Machine Learning · Statistics 2023-11-14 Liam Hodgkinson , Chris van der Heide , Robert Salomone , Fred Roosta , Michael W. Mahoney

Meta-Learning aims to speed up the learning process on new tasks by acquiring useful inductive biases from datasets of related learning tasks. While, in practice, the number of related tasks available is often small, most of the existing…

Machine Learning · Statistics 2023-12-27 Jonas Rothfuss , Martin Josifoski , Vincent Fortuin , Andreas Krause

Unsupervised estimation of latent variable models is a fundamental problem central to numerous applications of machine learning and statistics. This work presents a principled approach for estimating broad classes of such models, including…

Machine Learning · Statistics 2013-05-27 Animashree Anandkumar , Daniel Hsu , Adel Javanmard , Sham M. Kakade

Several non-linear operators in stochastic analysis, such as solution maps to stochastic differential equations, depend on a temporal structure which is not leveraged by contemporary neural operators designed to approximate general maps…

Dynamical Systems · Mathematics 2025-04-11 Luca Galimberti , Anastasis Kratsios , Giulia Livieri

Generalization is a central concept in machine learning theory, yet for quantum models, it is predominantly analyzed through uniform bounds that depend on a model's overall capacity rather than the specific function learned. These…

We develop a principled approach to end-to-end learning in stochastic optimization. First, we show that the standard end-to-end learning algorithm admits a Bayesian interpretation and trains a posterior Bayes action map. Building on the…

Optimization and Control · Mathematics 2023-06-13 Yves Rychener , Daniel Kuhn , Tobias Sutter

Time-dependently driven stochastic systems form a vast and manifold class of non-equilibrium systems used to model important applications on small length scales such as bit erasure protocols or microscopic heat engines. One property that…

Statistical Mechanics · Physics 2022-04-07 Julius Degünther , Timur Koyuk , Udo Seifert

Under-approximations of reachable sets and tubes have been receiving growing research attention due to their important roles in control synthesis and verification. Available under-approximation methods applicable to continuous-time linear…

Systems and Control · Electrical Eng. & Systems 2023-05-15 Mohamed Serry , Jun Liu

Many practical machine learning tasks can be framed as Structured prediction problems, where several output variables are predicted and considered interdependent. Recent theoretical advances in structured prediction have focused on…

Machine Learning · Computer Science 2020-12-22 Théophile Cantelobre , Benjamin Guedj , María Pérez-Ortiz , John Shawe-Taylor

Neural network models become increasingly popular as dynamic modeling tools in the control community. They have many appealing features including nonlinear structures, being able to approximate any functions. While most researchers hold…

Machine Learning · Computer Science 2023-10-23 Jinming Zhou , Yucai Zhu

The traditional statistical inference is static, in the sense that the estimate of the quantity of interest does not affect the future evolution of the quantity. In some sequential estimation problems however, the future values of the…

Machine Learning · Computer Science 2023-01-03 Aolin Xu , Peng Guan

In this paper, we provide a unified analysis of temporal difference learning algorithms with linear function approximators by exploiting their connections to Markov jump linear systems (MJLS). We tailor the MJLS theory developed in the…

Machine Learning · Computer Science 2019-11-06 Bin Hu , Usman Ahmed Syed

This paper studies the problem of secure state estimation of a linear time-invariant (LTI) system with bounded noise in the presence of sparse attacks on an unknown, time-varying set of sensors. In other words, at each time, the attacker…

Systems and Control · Electrical Eng. & Systems 2023-07-24 Zishuo Li , Muhammad Umar B. Niazi , Changxin Liu , Yilin Mo , Karl H. Johansson

PAC-Bayesian bounds have proven to be a valuable tool for deriving generalization bounds and for designing new learning algorithms in machine learning. However, it typically focus on providing generalization bounds with respect to a chosen…

Machine Learning · Statistics 2024-08-19 The Tien Mai

Time-varying linear state-space models are powerful tools for obtaining mathematically interpretable representations of neural signals. For example, switching and decomposed models describe complex systems using latent variables that evolve…

We employ the scenario approach to compute probably approximately correct (PAC) bounds on the average inter-sample time (AIST) generated by an unknown PETC system, based on a finite number of samples. We extend the scenario approach to…

Systems and Control · Electrical Eng. & Systems 2022-03-11 Andrea Peruffo , Manuel Mazo