English
Related papers

Related papers: Accuracy of empirical projections of high-dimensio…

200 papers

Asymptotic lower bounds for estimation play a fundamental role in assessing the quality of statistical procedures. In this paper we propose a framework for obtaining semi-parametric efficiency bounds for sparse high-dimensional models,…

Statistics Theory · Mathematics 2017-10-16 Jana Jankova , Sara van de Geer

In this paper, we establish explicit convergence rates for the stochastic smooth approximations of infimal convolutions introduced and developed in \cite{MR4581306,MR4923371}. In particular, we quantify the convergence of the associated…

Optimization and Control · Mathematics 2026-02-23 Diego Morales , Pedro Pérez-Aros , Emilio Vilches

We consider the high-dimensional inference problem where the signal is a low-rank matrix which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low-rank matrix, we compute the limit in the large dimension…

Probability · Mathematics 2018-06-01 Léo Miolane

Generalized linear models are flexible tools for the analysis of diverse datasets, but the classical formulation requires that the parametric component is correctly specified and the data contain no atypical observations. To address these…

Methodology · Statistics 2023-04-21 Ioannis Kalogridis , Gerda Claeskens , Stefan Van Aelst

This paper studies Graphical SLOPE for precision matrix estimation, with emphasis on its ability to recover both sparsity and clusters of edges with equal or similar strength. In a fixed-dimensional regime, we establish that the root-$n$…

Statistics Theory · Mathematics 2026-04-15 Ivan Hejný , Giovanni Bonaccolto , Philipp Kremer , Sandra Paterlini , Małgorzata Bogdan , Jonas Wallin

Inference for spatial generalized linear mixed models (SGLMMs) for high-dimensional non-Gaussian spatial data is computationally intensive. The computational challenge is due to the high-dimensional random effects and because Markov chain…

Computation · Statistics 2018-10-09 Yawen Guan , Murali Haran

Parametric stochastic simulators are ubiquitous in science, often featuring high-dimensional input parameters and/or an intractable likelihood. Performing Bayesian parameter inference in this context can be challenging. We present a neural…

Machine Learning · Statistics 2021-10-27 Benjamin Kurt Miller , Alex Cole , Patrick Forré , Gilles Louppe , Christoph Weniger

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

Factorization-based gradient descent is a scalable and efficient algorithm for solving low-rank matrix completion. Recent progress in structured non-convex optimization has offered global convergence guarantees for gradient descent under…

Optimization and Control · Mathematics 2021-02-09 Trung Vu , Raviv Raich

We study the problem of symmetric positive semi-definite low-rank matrix completion (MC) with deterministic entry-dependent sampling. In particular, we consider rectified linear unit (ReLU) sampling, where only positive entries are…

Machine Learning · Computer Science 2024-06-11 Huikang Liu , Peng Wang , Longxiu Huang , Qing Qu , Laura Balzano

In this paper, we consider the matrix recovery from rank-one projection measurements proposed in [Cai and Zhang, Ann. Statist., 43(2015), 102-138], via nonconvex minimization. We establish a sufficient identifiability condition, which can…

Information Theory · Computer Science 2018-06-29 Peng Li , Wengu Chen

In this paper, we develop a new alternating projection method to compute nonnegative low rank matrix approximation for nonnegative matrices. In the nonnegative low rank matrix approximation method, the projection onto the manifold of fixed…

Machine Learning · Computer Science 2020-09-10 Guangjing Song , Michael K. Ng , Tai-Xiang Jiang

In this work, we analyze the variance of a stochastic estimator for computing Schatten norms of matrices. The estimator extracts information from a single sketch of the matrix, that is, the product of the matrix with a few standard Gaussian…

Numerical Analysis · Mathematics 2025-01-17 Ya-Chi Chu , Alice Cortinovis

The Collective Graphical Model (CGM) models a population of independent and identically distributed individuals when only collective statistics (i.e., counts of individuals) are observed. Exact inference in CGMs is intractable, and previous…

Machine Learning · Computer Science 2014-05-21 Li-Ping Liu , Daniel Sheldon , Thomas G. Dietterich

Motivated by a wide variety of applications, ranging from stochastic optimization to dimension reduction through variable selection, the problem of estimating gradients accurately is of crucial importance in statistics and learning theory.…

Machine Learning · Computer Science 2020-06-29 Guillaume Ausset , Stephan Clémençon , François Portier

Over the past decade, characterizing the exact asymptotic risk of regularized estimators in high-dimensional regression has emerged as a popular line of work. This literature considers the proportional asymptotics framework, where the…

Statistics Theory · Mathematics 2024-01-02 Samriddha Lahiry , Pragya Sur

We introduce a method that uses low-rank approximations of cross-correlation matrices in mixed continuous and categorical Gaussian Process models. This new method -- called Low-Rank Correlation (LRC) -- offers the ability to flexibly adapt…

Machine Learning · Statistics 2020-10-07 Dominik Kirchhoff , Sonja Kuhnt

Low-rank matrix estimation is a canonical problem that finds numerous applications in signal processing, machine learning and imaging science. A popular approach in practice is to factorize the matrix into two compact low-rank factors, and…

Machine Learning · Computer Science 2021-06-16 Tian Tong , Cong Ma , Yuejie Chi

Randomized subspace approximation with "matrix sketching" is an effective approach for constructing approximate partial singular value decompositions (SVDs) of large matrices. The performance of such techniques has been extensively…

Numerical Analysis · Mathematics 2024-06-28 Yijun Dong , Per-Gunnar Martinsson , Yuji Nakatsukasa

For solving large-scale non-convex problems, we propose inexact variants of trust region and adaptive cubic regularization methods, which, to increase efficiency, incorporate various approximations. In particular, in addition to approximate…

Optimization and Control · Mathematics 2018-02-21 Zhewei Yao , Peng Xu , Farbod Roosta-Khorasani , Michael W. Mahoney