English
Related papers

Related papers: Random Quadratic Forms with Dependence: Applicatio…

200 papers

This paper considers the problem of learning, from samples, the dependency structure of a system of linear stochastic differential equations, when some of the variables are latent. In particular, we observe the time evolution of some…

Machine Learning · Computer Science 2012-05-02 Ali Jalali , Sujay Sanghavi

This work initiates a general study of learning and generalization without the i.i.d. assumption, starting from first principles. While the traditional approach to statistical learning theory typically relies on standard assumptions from…

Machine Learning · Statistics 2020-10-21 Steve Hanneke

Let $A$ be a matrix whose columns $X_1,\dots, X_N$ are independent random vectors in $\mathbb{R}^n$. Assume that the tails of the 1-dimensional marginals decay as $\mathbb{P}(|\langle X_i, a\rangle|\geq t)\leq t^{-p}$ uniformly in $a\in…

Probability · Mathematics 2015-09-09 Olivier Guédon , Alexander E. Litvak , Alain Pajor , Nicole Tomczak-Jaegermann

The seminal result of Johnson and Lindenstrauss on random embeddings has been intensively studied in applied and theoretical computer science. Despite that vast body of literature, we still lack of complete understanding of statistical…

Machine Learning · Computer Science 2021-04-13 Maciej Skorski

This work unifies the analysis of various randomized methods for solving linear and nonlinear inverse problems by framing the problem in a stochastic optimization setting. By doing so, we show that many randomized methods are variants of a…

Numerical Analysis · Mathematics 2023-06-21 Jonathan Wittmer , C. G. Krishnanunni , Hai V. Nguyen , Tan Bui-Thanh

Many latent-variable applications, including community detection, collaborative filtering, genomic analysis, and NLP, model data as generated by low-rank matrices. Yet despite considerable research, except for very special cases, the number…

Machine Learning · Computer Science 2020-10-02 Ayush Jain , Alon Orlitsky

Linear constrained switching systems are linear switched systems whose switching sequences are constrained by a deterministic finite automaton. This work investigates how to generate a sequence of matrices with an asymptotic growth rate…

Optimization and Control · Mathematics 2021-03-26 Yuhao Zhang , Xiangru Xu

Random Projections have been widely used to generate embeddings for various graph learning tasks due to their computational efficiency. The majority of applications have been justified through the Johnson-Lindenstrauss Lemma. In this paper,…

Social and Information Networks · Computer Science 2024-07-30 Tvrtko Tadić , Cassiano Becker , Jennifer Neville

Optimistic algorithms have been extensively studied for regret minimization in episodic tabular MDPs, both from a minimax and an instance-dependent view. However, for the PAC RL problem, where the goal is to identify a near-optimal policy…

Machine Learning · Computer Science 2022-07-14 Andrea Tirinzoni , Aymen Al-Marjani , Emilie Kaufmann

This paper investigates the stochastic program with the chance constraint on a quadratic form of random variables following multivariate Gaussian mixture distribution (GMD). Under some mild conditions, it is proved that the asymptotic…

Optimization and Control · Mathematics 2023-03-02 Xiaochuan Pang , Shushang Zhu , Zhaolin Hu

This paper establishes the asymptotic independence between the quadratic form and maximum of a sequence of independent random variables. Based on this theoretical result, we find the asymptotic joint distribution for the quadratic form and…

Methodology · Statistics 2023-08-03 Dachuan Chen , Decai Liang , Long Feng

This paper motivates the use of random-bridges -- stochastic processes conditioned to take target distributions at fixed timepoints -- in the realm of generative modelling. Herein, random-bridges can act as stochastic transports between two…

Machine Learning · Computer Science 2026-04-07 Stefano Goria , Levent A. Mengütürk , Murat C. Mengütürk , Berkan Sesen

We analyze numerical properties of Layer-wise relevance propagation (LRP)-type attribution methods by representing them as a product of modified gradient matrices. This representation creates an analogy to matrix multiplications of…

Machine Learning · Computer Science 2025-09-12 Alexander Binder , Nastaran Takmil-Homayouni , Urun Dogan

The expected signature uniquely determines the law of a random rough path under a moment-growth condition, yet finite-sample bounds for estimating it from a single long dependent trajectory have been lacking. We study a stationary…

Statistics Theory · Mathematics 2026-05-21 Bryson Schenck

We present a general central limit theorem with simple, easy-to-check covariance-based sufficient conditions for triangular arrays of random vectors when all variables could be interdependent. The result is constructed from Stein's method,…

This paper is inspired by the problem of understanding in a mathematical sense the Liouville quantum gravity on surfaces. Here we show how to define a stationary random metric on self-similar spaces which are the limit of nice finite…

Probability · Mathematics 2015-09-15 Mikhail Khristoforov , Victor Kleptsyn , Michele Triestino

In this paper, we prove a universality result for the limiting distribution of persistence diagrams arising from geometric filtrations over random point processes. Specifically, we consider the distribution of the ratio of persistence…

Probability · Mathematics 2024-08-13 Omer Bobrowski , Primoz Skraba

We focus on a stochastic learning model where the learner observes a finite set of training examples and the output of the learning process is a data-dependent distribution over a space of hypotheses. The learned data-dependent distribution…

Machine Learning · Statistics 2020-12-29 Omar Rivasplata , Ilja Kuzborskij , Csaba Szepesvari , John Shawe-Taylor

We propose a certainty-equivalence scheme for adaptive control of scalar linear systems subject to additive, i.i.d. Gaussian disturbances and bounded control input constraints, without requiring prior knowledge of the bounds of the system…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Seth Siriya , Jingge Zhu , Dragan Nešić , Ye Pu

We show bounds on tail probabilities for quadratic forms in sub-gaussian non-necessarily independent random variables. Our main tool will be estimates of the Luxemburg norms of such forms. This will allow us to formulate the above-mentioned…

Probability · Mathematics 2020-08-14 Krzysztof Zajkowski