English
Related papers

Related papers: Uniform Concentration for $\alpha$-subexponential …

200 papers

This note describes the concentration phenomenon for a high dimensional sub-gaussian vector \( X \). In the Gaussian case, for any linear operator \( Q \), it holds \( P\bigl( \| Q X \|^{2} - tr (B) > 2 \sqrt{x\, tr(B^{2})} + 2 \| B \| x…

Probability · Mathematics 2024-06-11 Vladimir Spokoiny

In this paper we present a novel methodology to perform Bayesian model selection in linear models with heavy-tailed distributions. We consider a finite mixture of distributions to model a latent variable where each component of the mixture…

Methodology · Statistics 2017-08-21 Flávio B Gonçalves , Marcos O. Prates , Victor H. Lachos

Unraveling the reasons behind the remarkable success and exceptional generalization capabilities of deep neural networks presents a formidable challenge. Recent insights from random matrix theory, specifically those concerning the spectral…

Machine Learning · Statistics 2023-04-10 Xuanzhe Xiao , Zeng Li , Chuanlong Xie , Fengwei Zhou

Big data can easily be contaminated by outliers or contain variables with heavy-tailed distributions, which makes many conventional methods inadequate. To address this challenge, we propose the adaptive Huber regression for robust…

Statistics Theory · Mathematics 2018-10-11 Qiang Sun , Wenxin Zhou , Jianqing Fan

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

Statistics Theory · Mathematics 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

We consider $N\times N$ self-adjoint Gaussian random matrices defined by an arbitrary deterministic sparsity pattern with $d$ nonzero entries per row. We show that such random matrices exhibit a canonical localization-delocalization…

Probability · Mathematics 2024-01-03 Laura Shou , Ramon van Handel

Riemannian Gaussian distributions were initially introduced as basic building blocks for learning models which aim to capture the intrinsic structure of statistical populations of positive-definite matrices (here called covariance…

Statistics Theory · Mathematics 2023-02-16 Salem Said , Simon Heuveline , Cyrus Mostajeran

The random graph model has recently been extended to a random preferential attachment graph model, in order to enable the study of general asymptotic properties in network types that are better represented by the preferential attachment…

Social and Information Networks · Computer Science 2015-02-10 Chen Avin , Zvi Lotker , David Peleg

We introduce a variational Bayesian neural network where the parameters are governed via a probability distribution on random matrices. Specifically, we employ a matrix variate Gaussian \cite{gupta1999matrix} parameter posterior…

Machine Learning · Statistics 2016-06-24 Christos Louizos , Max Welling

We present some extensions of Bernstein's concentration inequality for random matrices. This inequality has become a useful and powerful tool for many problems in statistics, signal processing and theoretical computer science. The main…

Probability · Mathematics 2017-04-18 Stanislav Minsker

Generative Adversarial Networks (GAN) are a powerful methodology and can be used for unsupervised anomaly detection, where current techniques have limitations such as the accurate detection of anomalies near the tail of a distribution. GANs…

Machine Learning · Computer Science 2022-02-03 Nikolaos Dionelis , Mehrdad Yaghoobi , Sotirios A. Tsaftaris

There has recently been interest in relating properties of matrices drawn at random from the classical compact groups to statistical characteristics of number-theoretical L-functions. One example is the relationship conjectured to hold…

Mathematical Physics · Physics 2009-11-07 J. P. Keating , N. Linden , Z. Rudnick

We study the accuracy of estimating the covariance and the precision matrix of a $D$-variate sub-Gaussian distribution along a prescribed subspace or direction using the finite sample covariance. Our results show that the estimation…

Statistics Theory · Mathematics 2021-01-14 Zeljko Kereta , Timo Klock

In the study of heavy tail data, several models have been introduced. If the interest is in the tail of the distribution, block maxima or excess over thresholds are the typical approaches, wasting relevant information in the bulk of the…

Methodology · Statistics 2026-02-10 Luis E. Nieto-Barajas

Let $n>m$, and let $A$ be an $(m\times n)$-matrix of full rank. Then obviously the estimate $\|Ax\|\leq\|A\|\|x\|$ holds for the euclidean norm of $x$ and $Ax$ and the spectral norm as the assigned matrix norm. We study the sets of all $x$…

Rings and Algebras · Mathematics 2022-03-16 Harry Yserentant

Real-world data is often unbalanced and long-tailed, but deep models struggle to recognize rare classes in the presence of frequent classes. To address unbalanced data, most studies try balancing the data, the loss, or the classifier to…

Machine Learning · Computer Science 2021-11-02 Dvir Samuel , Gal Chechik

Stochastic dominance of a random variable by a convex combination of its independent copies has recently been shown to hold within the relatively narrow class of distributions with concave odds function, and later extended to broader…

Probability · Mathematics 2024-12-13 Idir Arab , Tommaso Lando , Paulo Eduardo Oliveira

We show that a tessellation generated by a small number of random affine hyperplanes can be used to approximate Euclidean distances between any two points in an arbitrary bounded set $T$, where the random hyperplanes are generated by…

Information Theory · Computer Science 2018-08-14 Sjoerd Dirksen , Shahar Mendelson

Tensor regression is an important tool for tensor data analysis, but existing works have not considered the impact of outliers, making them potentially sensitive to such data points. This paper proposes a low tubal rank robust regression…

Methodology · Statistics 2026-05-11 Zihao Song , Jicai Liu , Heng Lian , Weihua Zhao

Eigenvalues of Wigner matrices has been a major topic of investigation. A particularly important subclass of such random matrices is formed by the adjacency matrix of an Erd\H{o}s-R\'{e}nyi graph $\mathcal{G}_{n,p}$ equipped with i.i.d.…

Probability · Mathematics 2022-06-15 Shirshendu Ganguly , Ella Hiesmayr , Kyeongsik Nam
‹ Prev 1 8 9 10 Next ›