English
Related papers

Related papers: A Tutorial on Concentration Bounds for System Iden…

200 papers

In this paper we present an approach in which synchronization of chaos is used to address identification problems. In particular, we are able to identify: (i) the discontinuity points of systems described by piecewise dynamical equations…

Mathematical Physics · Physics 2015-05-14 Francesco Sorrentino

The system identification problem is to estimate dynamical parameters from the output data, obtained by performing measurements on the output fields. We investigate system identification for quantum linear systems. Our main objectives are…

Quantum Physics · Physics 2017-12-25 Matthew Levitt , Mădălin Guţă , Theodore Kypraios

Using a martingale concentration inequality, concentration bounds `from time $n_0$ on' are derived for stochastic approximation algorithms with contractive maps and both martingale difference and Markov noises. These are applied to…

Machine Learning · Computer Science 2022-06-14 Siddharth Chandak , Vivek S. Borkar , Parth Dodhia

During the last two decades, concentration inequalities have been the subject of exciting developments in various areas, including convex geometry, functional analysis, statistical physics, high-dimensional statistics, pure and applied…

Information Theory · Computer Science 2015-02-26 Maxim Raginsky , Igal Sason

This paper details how to parameterize the posterior distribution of state-space systems to generate improved optimization problems for system identification using variational inference. Three different parameterizations of the assumed…

Applications · Statistics 2025-01-15 Dimas Abreu Archanjo Dutra

Viewing a two time scale stochastic approximation scheme as a noisy discretization of a singularly perturbed differential equation, we obtain a concentration bound for its iterates that captures its behavior with quantifiable high…

Optimization and Control · Mathematics 2018-06-29 Vivek S. Borkar , Sarath Pattathil

A learning-based safety filter is developed for discrete-time linear time-invariant systems with unknown models subject to Gaussian noises with unknown covariance. Safety is characterized using polytopic constraints on the states and…

Machine Learning · Computer Science 2023-05-09 Farhad Farokhi , Alex S. Leong , Mohammad Zamani , Iman Shames

The aim of this paper is to discuss various concentration inequalities for U-statistics and most recent results. A special focus will be on providing proofs for bounds on the U-statistics using classical concentration inequalities, which,…

Statistics Theory · Mathematics 2019-03-18 Yannik Pitcan

In this paper, we prove maximal inequalities and study the functional central limit theorem for the partial sums of linear processes generated by dependent innovations. Due to the general weights, these processes can exhibit long-range…

Statistics Theory · Mathematics 2011-03-21 Jérôme Dedecker , Florence Merlevède , Magda Peligrad

We characterize those ex-ante restrictions on the random utility model which lead to identification. We first identify a simple class of perturbations which transfer mass from a suitable pair of preferences to the pair formed by swapping…

Theoretical Economics · Economics 2024-08-14 Peter P. Caradonna , Christopher Turansick

Parametric system identification methods estimate the parameters of explicitly defined physical systems from data. Yet, they remain constrained by the need to provide an explicit function space, typically through a predefined library of…

Machine Learning · Computer Science 2026-03-17 Markus W. Baumgartner , Anson Lei , Joe Watson , Ingmar Posner

This paper considers a finite sample perspective on the problem of identifying an LTI system from a finite set of possible systems using trajectory data. To this end, we use the maximum likelihood estimator to identify the true system and…

Systems and Control · Electrical Eng. & Systems 2024-12-03 Nicolas Chatzikiriakos , Andrea Iannelli

System identification is a common tool for estimating (linear) plant models as a basis for model-based predictive control and optimization. The current challenges in process industry, however, ask for data-driven modelling techniques that…

Systems and Control · Computer Science 2018-02-06 Paul M. J. Van den Hof , Arne G. Dankers , Harm H. M. Weerts

Concentration inequalities, a major tool in probability theory, quantify how much a random variable deviates from a certain quantity. This paper proposes a systematic convex optimization approach to studying and generating concentration…

Probability · Mathematics 2024-08-30 Celine Moucer , Adrien Taylor , Francis Bach

In causal models, a given mechanism is assumed to be invariant to changes of other mechanisms. While this principle has been utilized for inference in settings where the causal variables are observed, theoretical insights when the variables…

Machine Learning · Statistics 2023-12-07 Simon Bing , Jonas Wahl , Urmi Ninad , Jakob Runge

In this paper, we study moment and concentration inequalities for the spectral norm of sums of dependent random matrices. We establish novel Rosenthal-Burkholder inequalities for discrete-time matrix local martingales,…

Probability · Mathematics 2025-11-13 Yang Peng , Yuchen Xin , Zhihua Zhang

We consider the effect of parametric uncertainty on properties of Linear Time Invariant systems. Traditional approaches to this problem determine the worst-case gains of the system over the uncertainty set. Whilst such approaches are…

Optimization and Control · Mathematics 2015-05-21 Giorgio Valmorbida , Dhruva Raman , James Anderson

During the last two decades, concentration of measure has been a subject of various exciting developments in convex geometry, functional analysis, statistical physics, high-dimensional statistics, probability theory, information theory,…

Information Theory · Computer Science 2015-10-13 Maxim Raginsky , Igal Sason

We analyze phase transitions in the conditional entropy of a sequence caused by a change in the conditional variables. Such transitions happen, for example, when training to learn the parameters of a system, since the transition from the…

Information Theory · Computer Science 2021-01-07 Kang Gao , Bertrand Hochwald

We derive concentration inequalities for functions of the empirical measure of large random matrices with infinitely divisible entries and, in particular, stable ones. We also give concentration results for some other functionals of these…

Probability · Mathematics 2007-06-13 Christian Houdré , Hua Xu