English
Related papers

Related papers: Randomized low-rank approximations beyond Gaussian…

200 papers

We consider the problem of low rank matrix recovery in a stochastically noisy high dimensional setting. We propose a new estimator for the low rank matrix, based on the iterative hard thresholding method, and that is computationally…

Statistics Theory · Mathematics 2016-03-02 Alexandra Carpentier , Arlene K. H. Kim

We consider the problem of finding a dense submatrix of a matrix with i.i.d. Gaussian entries, where density is measured by average value. This problem arose from practical applications in biology and social sciences…

Probability · Mathematics 2025-07-28 Shankar Bhamidi , David Gamarnik , Shuyang Gong

CUR matrix decomposition is a randomized algorithm that can efficiently compute the low rank approximation for a given rectangle matrix. One limitation with the existing CUR algorithms is that they require an access to the full matrix A for…

Machine Learning · Computer Science 2014-03-25 Rong Jin , Shenghuo Zhu

Gaussian random fields are popular models for spatially varying uncertainties, arising for instance in geotechnical engineering, hydrology or image processing. A Gaussian random field is fully characterised by its mean function and…

Numerical Analysis · Mathematics 2019-02-19 Jonas Latz , Marvin Eisenberger , Elisabeth Ullmann

We outline a procedure for jointly sampling substitution matrices and multiple sequence alignments, according to an approximate posterior distribution, using an MCMC-based algorithm. This procedure provides an efficient and simple method by…

Quantitative Methods · Quantitative Biology 2015-01-22 Joseph L. Herman , Adrienn Szabó , Instván Miklós , Jotun Hein

Integer data sets frequently appear in many applications in sciences and technology. To analyze these, integer low rank approximation has received much attention due to its capacity of representing the results in integers preserving the…

Numerical Analysis · Mathematics 2015-10-20 Bo Dong , Matthew M. Lin , Haesun Park

An approximation method is presented for probabilistic inference with continuous random variables. These problems can arise in many practical problems, in particular where there are "second order" probabilities. The approximation, based on…

Artificial Intelligence · Computer Science 2013-04-10 Ross D. Shachter

In this paper, we study the low-rank matrix completion problem, a class of machine learning problems, that aims at the prediction of missing entries in a partially observed matrix. Such problems appear in several challenging applications…

Machine Learning · Statistics 2023-09-04 The Tien Mai

Low-rank approximations of data matrices are an important dimensionality reduction tool in machine learning and regression analysis. We consider the case of categorical variables, where it can be formulated as the problem of finding…

Machine Learning · Computer Science 2018-03-14 Reka Kovacs , Oktay Gunluk , Raphael Hauser

In this paper, we propose a low-rank approximation method based on discrete least-squares for the approximation of a multivariate function from random, noisy-free observations. Sparsity inducing regularization techniques are used within…

Numerical Analysis · Mathematics 2015-12-09 Mathilde Chevreuil , Régis Lebrun , Anthony Nouy , Prashant Rai

We introduce a Generalized LU-Factorization (\textbf{GLU}) for low-rank matrix approximation. We relate this to past approaches and extensively analyze its approximation properties. The established deterministic guarantees are combined with…

Numerical Analysis · Mathematics 2019-10-02 James Demmel , Laura Grigori , Alexander Rusciano

In order to have a better understanding of finite random matrices with non-Gaussian entries, we study the $1/N$ expansion of local eigenvalue statistics in both the bulk and at the hard edge of the spectrum of random matrices. This gives…

Probability · Mathematics 2016-06-28 Alan Edelman , A. Guionnet , S. Péché

It is common practice to use Laplace approximations to compute marginal likelihoods in Bayesian versions of generalised linear models (GLM). Marginal likelihoods combined with model priors are then used in different search algorithms to…

Methodology · Statistics 2022-02-01 Jon Lachmann , Geir Storvik , Florian Frommlet , Aliaksadr Hubin

We study low-rank matrix regression in settings where matrix-valued predictors and scalar responses are observed across multiple individuals. Rather than assuming a fully homogeneous coefficient matrices across individuals, we accommodate…

Methodology · Statistics 2025-10-28 Di Wang , Xiaoyu Zhang , Guodong Li , Wenyang Zhang

We provide a randomized linear time approximation scheme for a generic problem about clustering of binary vectors subject to additional constrains. The new constrained clustering problem encompasses a number of problems and by solving it,…

Data Structures and Algorithms · Computer Science 2018-07-20 Fedor V. Fomin , Petr A. Golovach , Daniel Lokshtanov , Fahad Panolan , Saket Saurabh

As Gaussian processes are used to answer increasingly complex questions, analytic solutions become scarcer and scarcer. Monte Carlo methods act as a convenient bridge for connecting intractable mathematical expressions with actionable…

A Random SubMatrix method (RSM) is proposed to calculate the low-rank decomposition of large-scale matrices with known entry percentage \rho. RSM is very fast as the floating-point operations (flops) required are compared favorably with the…

Numerical Analysis · Computer Science 2015-10-28 Yiguang Liu

The topics dicussed in this paper take their origin inthe estimation of the Gram matrix of a random vector from a sample made of n independent copies. They comprise the estimation of the covariance matrix and the study of least squares…

Statistics Theory · Mathematics 2016-03-17 Olivier Catoni

The influence-matrix formalism provides an alternative route to the classical simulation of quantum dynamics. Because influence matrices retain information only about the effective bath seen by local observables, they are expected to be…

Quantum Physics · Physics 2026-05-14 Cathy Li , Bruno Bertini , Katja Klobas , Tianci Zhou

Matrices of (approximate) low rank are pervasive in data science, appearing in recommender systems, movie preferences, topic models, medical records, and genomics. While there is a vast literature on how to exploit low rank structure in…

Machine Learning · Computer Science 2018-05-31 Madeleine Udell , Alex Townsend