English
Related papers

Related papers: Universality of General Spiked Tensor Models

200 papers

We consider the problem of detecting signals in the rank-one signal-plus-noise data matrix models that generalize the spiked Wishart matrices. We show that the principal component analysis can be improved by pre-transforming the matrix…

Statistics Theory · Mathematics 2021-04-29 Ji Hyung Jung , Hye Won Chung , Ji Oon Lee

Motivated by distributed machine learning settings such as Federated Learning, we consider the problem of fitting a statistical model across a distributed collection of heterogeneous data sets whose similarity structure is encoded by a…

Statistics Theory · Mathematics 2021-11-30 Dominic Richards , Sahand N. Negahban , Patrick Rebeschini

Let $X$ be an $n\times n$ symmetric random matrix with independent but non-identically distributed entries. The deviation inequalities of the spectral norm of $X$ with Gaussian entries have been obtained by using the standard concentration…

Probability · Mathematics 2023-08-22 Guozheng Dai , Zhonggen Su , Hanchao Wang

In this work we study high probability bounds for stochastic subgradient methods under heavy tailed noise. In this setting the noise is only assumed to have finite variance as opposed to a sub-Gaussian distribution for which it is known…

Optimization and Control · Mathematics 2024-04-16 Daniela A. Parletta , Andrea Paudice , Massimiliano Pontil , Saverio Salzo

We introduce a complex-plane generalization of the consecutive level-spacing distribution, used to distinguish regular from chaotic quantum spectra. Our approach features the distribution of complex-valued ratios between nearest- and…

Statistical Mechanics · Physics 2020-07-15 Lucas Sá , Pedro Ribeiro , Tomaž Prosen

We obtain quenched hitting distributions to be compound Poissonian for a certain class of random dynamical systems. The theory is general and designed to accommodate non-uniformly expanding behavior and targets that do not overlap much with…

Dynamical Systems · Mathematics 2024-02-06 Lucas Amorim , Nicolai Haydn , Sandro Vaienti

In various applications of regression analysis, in addition to errors in the dependent observations also errors in the predictor variables play a substantial role and need to be incorporated in the statistical modeling process. In this…

Statistics Theory · Mathematics 2020-09-03 Katharina Proksch , Nicolai Bissantz , Hajo Holzmann

In problems involving approximation, completion, denoising, dimension reduction, estimation, interpolation, modeling, order reduction, regression, etc, we argue that the near-universal practice of assuming that a function, matrix, or tensor…

Numerical Analysis · Mathematics 2019-02-12 Ke Ye , Lek-Heng Lim

In this article, we develop methods for estimating a low rank tensor from noisy observations on a subset of its entries to achieve both statistical and computational efficiencies. There have been a lot of recent interests in this problem of…

Machine Learning · Statistics 2018-03-21 Dong Xia , Ming Yuan , Cun-Hui Zhang

We introduce a rank-statistic approximation of $f$-divergences that avoids explicit density-ratio estimation by working directly with the distribution of ranks. For a resolution parameter $K$, we map the mismatch between two univariate…

Machine Learning · Statistics 2026-02-02 Viktor Stein , José Manuel de Frutos

We consider the problem of estimating the factors of a rank-$1$ matrix with i.i.d. Gaussian, rank-$1$ measurements that are nonlinearly transformed and corrupted by noise. Considering two prototypical choices for the nonlinearity, we study…

Optimization and Control · Mathematics 2024-10-02 Kabir Aladin Chandrasekher , Mengqi Lou , Ashwin Pananjady

Higher-order multiway data is ubiquitous in machine learning and statistics and often exhibits community-like structures, where each component (node) along each different mode has a community membership associated with it. In this paper we…

Statistics Theory · Mathematics 2024-02-02 Joshua Agterberg , Anru Zhang

Diffusion Models (DMs) are powerful generative models that add Gaussian noise to the data and learn to remove it. We wanted to determine which noise distribution (Gaussian or non-Gaussian) led to better generated data in DMs. Since DMs do…

Machine Learning · Computer Science 2023-04-13 Alexia Jolicoeur-Martineau , Kilian Fatras , Ke Li , Tal Kachman

Tensor rank learning for canonical polyadic decomposition (CPD) has long been deemed as an essential yet challenging problem. In particular, since the tensor rank controls the complexity of the CPD model, its inaccurate learning would cause…

Machine Learning · Computer Science 2022-03-30 Lei Cheng , Zhongtao Chen , Qingjiang Shi , Yik-Chung Wu , Sergios Theodoridis

We have previously reported a Bayesian algorithm for determining the coordinates of points in three-dimensional space from uncertain constraints. This method is useful in the determination of biological molecular structure. It is limited,…

Artificial Intelligence · Computer Science 2013-02-28 Russ B. Altman , Cheng C. Chen , William B. Poland , Jaswinder Pal Singh

Accurate statistical models of neural spike responses can characterize the information carried by neural populations. But the limited samples of spike counts during recording usually result in model overfitting. Besides, current models…

Quantitative Methods · Quantitative Biology 2021-06-17 Qi She , Xiaoli Wu , Beth Jelfs , Adam S. Charles , Rosa H. M. Chan

For a Haar random set $\mathcal{S}\subset U(d)$ of quantum gates we consider the uniform measure $\nu_\mathcal{S}$ whose support is given by $\mathcal{S}$. The measure $\nu_\mathcal{S}$ can be regarded as a…

Quantum Physics · Physics 2024-04-17 Piotr Dulian , Adam Sawicki

The complex Gaussian distribution has been widely used as a fundamental spectral and noise model in signal processing and communication. However, its Gaussian structure often limits its ability to represent the diverse amplitude…

Machine Learning · Statistics 2026-03-30 Toru Nakashika

The paper studies distributed static parameter (vector) estimation in sensor networks with nonlinear observation models and noisy inter-sensor communication. It introduces \emph{separably estimable} observation models that generalize the…

Multiagent Systems · Computer Science 2012-05-21 Soummya Kar , Jose M. F. Moura , Kavita Ramanan

This paper studies inference in linear models with a high-dimensional parameter matrix that can be well-approximated by a ``spiked low-rank matrix.'' A spiked low-rank matrix has rank that grows slowly compared to its dimensions and nonzero…

Statistics Theory · Mathematics 2023-01-04 Victor Chernozhukov , Christian Hansen , Yuan Liao , Yinchu Zhu