English
Related papers

Related papers: Singular Subspace Perturbation Bounds via Rectangu…

200 papers

We derive a singular diffusion limit for the position of a tagged particle in zero range interacting particle processes on a one dimensional torus with a Sinai-type random environment via two steps. In the first step, a regularization is…

Probability · Mathematics 2025-02-25 Marcel Hudiani , Claudio Landim , Sunder Sethuraman

Consider a $N\times n$ matrix $\Sigma_n=\frac{1}{\sqrt{n}}R_n^{1/2}X_n$, where $R_n$ is a nonnegative definite Hermitian matrix and $X_n$ is a random matrix with i.i.d. real or complex standardized entries. The fluctuations of the linear…

Probability · Mathematics 2016-06-29 Jamal Najim , Jianfeng Yao

We develop generalization error bounds for stochastic gradient descent (SGD) with label noise in non-convex settings under uniform dissipativity and smoothness conditions. Under a suitable choice of semimetric, we establish a contraction in…

Machine Learning · Statistics 2023-11-02 Jung Eun Huh , Patrick Rebeschini

In this paper we present a method for learning the parameters of a mixture of $k$ identical spherical Gaussians in $n$-dimensional space with an arbitrarily small separation between the components. Our algorithm is polynomial in all…

Machine Learning · Computer Science 2010-05-14 Mikhail Belkin , Kaushik Sinha

We prove a bound for the Wasserstein distance between vectors of smooth complex random variables and complex Gaussians in the framework of complex Markov diffusion generators. For the special case of chaotic eigenfunctions, this bound can…

Probability · Mathematics 2015-11-03 Simon Campese

Generating data from discrete distributions is important for a number of application domains including text, tabular data, and genomic data. Several groups have recently used random $k$-satisfiability ($k$-SAT) as a synthetic benchmark for…

Machine Learning · Computer Science 2026-03-24 Alankrita Bhatt , Mukur Gupta , Germain Kolossov , Andrea Montanari

We study the problem of estimating mixtures of Gaussians under the constraint of differential privacy (DP). Our main result is that $\text{poly}(k,d,1/\alpha,1/\varepsilon,\log(1/\delta))$ samples are sufficient to estimate a mixture of $k$…

Machine Learning · Statistics 2024-04-24 Mohammad Afzali , Hassan Ashtiani , Christopher Liaw

We consider finite blocklength lossy compression of information sources whose components are independent but non-identically distributed. Crucially, Gaussian sources with memory and quadratic distortion can be cast in this form. We show…

Information Theory · Computer Science 2026-02-11 Eyyup Tasci , Victoria Kostina

We study the fluctuations of the largest eigenvalue $\lambda_{\max}$ of $N \times N$ random matrices in the limit of large $N$. The main focus is on Gaussian $\beta$-ensembles, including in particular the Gaussian orthogonal ($\beta=1$),…

Statistical Mechanics · Physics 2015-05-29 Satya N. Majumdar , Gregory Schehr

In this letter, we consider two sets of observations defined as subspace signals embedded in noise and we wish to analyze the distance between these two subspaces. The latter entails evaluating the angles between the subspaces, an issue…

Methodology · Statistics 2015-06-17 Olivier Besson , Nicolas Dobigeon , Jean-Yves Tourneret

In this paper, we study the matrix denosing model $Y=S+X$, where $S$ is a low-rank deterministic signal matrix and $X$ is a random noise matrix, and both are $M\times n$. In the scenario that $M$ and $n$ are comparably large and the signals…

Statistics Theory · Mathematics 2020-07-08 Zhigang Bao , Xiucai Ding , Ke Wang

In this work, we examine the optimality of Gaussian signalling for covert communications with an upper bound on $\mathcal{D}(p_{_1}||p_{_0})$ or $\mathcal{D}(p_{_0}||p_{_1})$ as the covertness constraint, where $\mathcal{D}(p_{_1}||p_{_0})$…

Information Theory · Computer Science 2019-05-10 Shihao Yan , Yirui Cong , Stephen Hanly , Xiangyun Zhou

In recent years, differential privacy has been adopted by tech-companies and governmental agencies as the standard for measuring privacy in algorithms. In this article, we study differential privacy in Bayesian posterior sampling settings.…

Statistics Theory · Mathematics 2026-02-13 Shenggang Hu , Louis Aslett , Hongsheng Dai , Murray Pollock , Gareth O. Roberts

This paper studies the sample complexity of learning the $k$ unknown centers of a balanced Gaussian mixture model (GMM) in $\mathbb{R}^d$ with spherical covariance matrix $\sigma^2\mathbf{I}$. In particular, we are interested in the…

Information Theory · Computer Science 2022-06-15 Elad Romanov , Tamir Bendory , Or Ordentlich

Let A be a self-adjoint operator on a Hilbert space H. Assume that {\sigma} is an isolated component of the spectrum of A, i.e. dist({\sigma},{\Sigma})=d>0 where {\Sigma}=spec(A)\{\sigma}. Suppose that V is a bounded self-adjoint operator…

Spectral Theory · Mathematics 2013-07-23 Sergio Albeverio , Alexander K. Motovilov

Randomized matrix sparsification has proven to be a fruitful technique for producing faster algorithms in applications ranging from graph partitioning to semidefinite programming. In the decade or so of research into this technique, the…

Numerical Analysis · Mathematics 2009-11-23 Alex Gittens , Joel A. Tropp

We study the problem of privately estimating the parameters of $d$-dimensional Gaussian Mixture Models (GMMs) with $k$ components. For this, we develop a technique to reduce the problem to its non-private counterpart. This allows us to…

Machine Learning · Statistics 2023-06-09 Jamil Arbas , Hassan Ashtiani , Christopher Liaw

We study spectral graph clustering under edge differential privacy. We propose a matrix shuffling mechanism that combines randomized edge flipping with a random permutation of the adjacency matrix. While edge flipping alone provides only a…

Information Theory · Computer Science 2026-05-12 Antti Koskela , Mohamed Seif , H. Vincent Poor , Andrea J. Goldsmith

In a very long Gaussian polymer on time scales shorter that the maximal relaxation time, the mean squared distance travelled by a tagged monomer grows as ~t^{1/2}. We analyze such sub-diffusive behavior in the presence of one or two…

Statistical Mechanics · Physics 2011-11-10 Yacov Kantor , Mehran Kardar

Inspired by the boolean discrepancy problem, we study the following optimization problem which we term \textsc{Spherical Discrepancy}: given $m$ unit vectors $v_1, \dots, v_m$, find another unit vector $x$ that minimizes $\max_i \langle x,…

Computational Complexity · Computer Science 2019-11-19 Chris Jones , Matt McPartlon