English
Related papers

Related papers: Sparse Hanson-Wright Inequalities with Application…

200 papers

Several approximate inference methods have been proposed for deep discrete latent variable models. However, non-parametric methods which have previously been successfully employed for classical sparse coding models have largely been…

Machine Learning · Computer Science 2023-03-16 Arunesh Mittal , Kai Yang , Paul Sajda , John Paisley

We introduce a new method for sparse principal component analysis, based on the aggregation of eigenvector information from carefully-selected axis-aligned random projections of the sample covariance matrix. Unlike most alternative…

Methodology · Statistics 2019-05-07 Milana Gataric , Tengyao Wang , Richard J. Samworth

Inhomogeneous random matrices with non-trivial variance profiles determined by symmetric stochastic matrices and with independent sub-Gaussian entries up to Hermitian symmetry, encompass a wide range of important models, including sparse…

Probability · Mathematics 2026-02-24 Ruohan Geng , Dang-Zheng Liu , Guangyi Zou

We present a non perturbative calculation technique providing the mixed moments of the overlaps between the eigenvectors of two large quantum Hamiltonians: $\hat{H}_0$ and $\hat{H}_0+\hat{W}$, where $\hat{H}_0$ is deterministic and…

Quantum Physics · Physics 2018-11-14 Grégoire Ithier , Saeed Ascroft

We establish bounds on the spectral radii for a large class of sparse random matrices, which includes the adjacency matrices of inhomogeneous Erd\H{o}s-R\'enyi graphs. Our error bounds are sharp for a large class of sparse random matrices.…

Probability · Mathematics 2021-01-25 Florent Benaych-Georges , Charles Bordenave , Antti Knowles

Recently several methods were proposed for sparse optimization which make careful use of second-order information [10, 28, 16, 3] to improve local convergence rates. These methods construct a composite quadratic approximation using Hessian…

Machine Learning · Computer Science 2015-07-15 Katya Scheinberg , Xiaocheng Tang

This paper introduces a version of decoupling and randomization to establish concentration inequalities for double-indexed permutation statistics. The results yield, among other applications, a new combinatorial Hanson-Wright inequality and…

Statistics Theory · Mathematics 2026-03-23 Mingxuan Zou , Jingfan Xu , Peng Ding , Fang Han

We analyze the convergence rate of the randomized Newton-like method introduced by Qu et. al. (2016) for smooth and convex objectives, which uses random coordinate blocks of a Hessian-over-approximation matrix $\bM$ instead of the true…

Numerical Analysis · Mathematics 2020-02-13 Mojmír Mutný , Michał Dereziński , Andreas Krause

The techniques suggested in Fr\"uhwirth-Schnatter et al. (2024) concern sparsity and factor selection and have enormous potential beyond standard factor analysis applications. We show how these techniques can be applied to Latent Space (LS)…

Methodology · Statistics 2024-11-15 Roberto Casarin , Antonio Peruzzi

We introduce a nonasymptotic framework for sub-Poisson distributions with moment generating function dominated by that of a Poisson distribution. At its core is a new notion of optimal sub-Poisson variance proxy, analogous to the variance…

Probability · Mathematics 2025-08-19 Lasse Leskelä , Ian Välimaa

Allen-Zhu, Gelashvili, Micali, and Shavit construct a sparse, sign-consistent Johnson-Lindenstrauss distribution, and prove that this distribution yields an essentially optimal dimension for the correct choice of sparsity. However, their…

Data Structures and Algorithms · Computer Science 2019-10-01 Meena Jagadeesan

We consider $N\times N$ Hermitian random matrices with independent identical distributed entries. The matrix is normalized so that the average spacing between consecutive eigenvalues is of order 1/N. Under suitable assumptions on the…

Mathematical Physics · Physics 2009-11-13 Laszlo Erdos , Benjamin Schlein , Horng-Tzer Yau

A polynomial matrix inequality is a formula asserting that a polynomial matrix is positive semidefinite. Polynomial matrix optimization concerns minimizing the smallest eigenvalue of a symmetric polynomial matrix subject to a tuple of…

Optimization and Control · Mathematics 2025-06-06 Jared Miller , Jie Wang , Feng Guo

Randomized algorithms can be used to speed up the analysis of large datasets. In this paper, we develop a unified methodology for statistical inference via randomized sketching or projections in two of the most fundamental problems in…

Statistics Theory · Mathematics 2024-04-02 Leda Wang , Zhixiang Zhang , Edgar Dobriban

We develop a new, mathematically precise framework for treating the effects of nonlinear phenomena occurring on small scales in general relativity. Our approach is an adaptation of Burnett's formulation of the "shortwave approximation",…

General Relativity and Quantum Cosmology · Physics 2011-04-14 Stephen R. Green , Robert M. Wald

We propose a novel sparse sliced inverse regression method based on random projections in a large $p$ small $n$ setting. Embedded in a generalized eigenvalue framework, the proposed approach finally reduces to parallel execution of…

Methodology · Statistics 2023-08-04 Jia Zhang , Runxiong Wu , Xin Chen

Using numerical exact diagonalization, we study matrix elements of a local spin operator in the eigenbasis of two different nonintegrable quantum spin chains. Our emphasis is on the question to what extent local operators can be represented…

Statistical Mechanics · Physics 2020-10-27 Jonas Richter , Anatoly Dymarsky , Robin Steinigeweg , Jochen Gemmer

We introduce a Bernstein-type inequality which serves to uniformly control quadratic forms of gaussian variables. The latter can for example be used to derive sharp model selection criteria for linear estimation in linear regression and…

Statistics Theory · Mathematics 2009-09-22 Ikhlef Bechar

We investigate concentration properties of functions of random vectors with values in the discrete cube, satisfying the stochastic covering property (SCP) or the strong Rayleigh property (SRP). Our result for SCP measures include…

Probability · Mathematics 2021-08-31 Radosław Adamczak , Bartłomiej Polaczyk

The paper re-analyzes a version of the celebrated Johnson-Lindenstrauss Lemma, in which matrices are subjected to constraints that naturally emerge from neuroscience applications: a) sparsity and b) sign-consistency. This particular variant…

Statistics Theory · Mathematics 2020-08-21 Maciej Skorski