English
Related papers

Related papers: Optimal Estimation of Schatten Norms of a rectangu…

200 papers

We consider the problem of noisy matrix completion, in which the goal is to reconstruct a structured matrix whose entries are partially observed in noise. Standard approaches to this underdetermined inverse problem are based on assuming…

Machine Learning · Statistics 2017-09-04 Nihar B. Shah , Sivaraman Balakrishnan , Martin J. Wainwright

In many contexts one encounters Hermitian operators $M$ on a Hilbert space whose dimension is so large that it is impossible to write down all matrix entries in an orthonormal basis. How does one determine whether such $M$ is positive…

Algebraic Geometry · Mathematics 2020-04-17 Gemma de las Cuevas , Tobias Fritz , Tim Netzer

We study random submatrices of a large matrix A. We show how to approximately compute A from its random submatrix of the smallest possible size O(r log r) with a small error in the spectral norm, where r = ||A||_F^2 / ||A||_2^2 is the…

Functional Analysis · Mathematics 2016-12-23 Mark Rudelson , Roman Vershynin

Spectral functions of large matrices contains important structural information about the underlying data, and is thus becoming increasingly important. Many times, large matrices representing real-world data are \emph{sparse} or \emph{doubly…

Data Structures and Algorithms · Computer Science 2020-02-28 Vladimir Braverman , Robert Krauthgamer , Aditya Krishnan , Roi Sinoff

We consider the synthesis problem of Compressed Sensing - given s and an MXn matrix A, extract from it an mXn submatrix A', certified to be s-good, with m as small as possible. Starting from the verifiable sufficient conditions of…

Optimization and Control · Mathematics 2014-04-11 Anatoli Juditsky , Fatma Kilinc Karzan , Arkadii S. Nemirovski

We consider the problem of linear estimation, and establish an extension of the Gauss-Markov theorem, in which the bias operator is allowed to be non-zero but bounded with respect to a matrix norm of Schatten type. We derive simple and…

Machine Learning · Computer Science 2023-11-21 Simon Segert

The Schatten-$p$ quasi-norm with $p\in(0,1)$ has recently gained considerable attention in various low-rank matrix estimation problems offering significant benefits over relevant convex heuristics such as the nuclear norm. However, due to…

Numerical Analysis · Mathematics 2020-10-28 Paris Giampouras , René Vidal , Athanasios Rontogiannis , Benjamin Haeffele

This paper considers estimation of sparse covariance matrices and establishes the optimal rate of convergence under a range of matrix operator norm and Bregman divergence losses. A major focus is on the derivation of a rate sharp minimax…

Statistics Theory · Mathematics 2013-02-14 T. Tony Cai , Harrison H. Zhou

Motivated by applications in single-cell biology and metagenomics, we investigate the problem of matrix reordering based on a noisy disordered monotone Toeplitz matrix model. We establish the fundamental statistical limit for this problem…

Statistics Theory · Mathematics 2023-08-15 T. Tony Cai , Rong Ma

We consider the problem of computing the q->p norm of a matrix A, which is defined for p,q \ge 1, as |A|_{q->p} = max_{x !=0 } |Ax|_p / |x|_q. This is in general a non-convex optimization problem, and is a natural generalization of the…

Data Structures and Algorithms · Computer Science 2010-05-04 Aditya Bhaskara , Aravindan Vijayaraghavan

Consider estimating the n by p matrix of means of an n by p matrix of independent normally distributed observations with constant variance, where the performance of an estimator is judged using a p by p matrix quadratic error loss function.…

Statistics Theory · Mathematics 2011-01-19 Reman Abu-Shanab , John T. Kent , William E. Strawderman

This paper deals with the numerical computation of the least singular value of a rectangular matrix $A$ relative to a pair of closed convex cones $(P,Q)$, which is defined as the optimal value of the non-convex optimization problem of…

Optimization and Control · Mathematics 2026-05-28 Giovanni Barbarino , Nicolas Gillis , David Sossa

This paper considers the problem of recovery of a low-rank matrix in the situation when most of its entries are not observed and a fraction of observed entries are corrupted. The observations are noisy realizations of the sum of a low rank…

Statistics Theory · Mathematics 2016-07-05 Olga Klopp , Karim Lounici , Alexandre B. Tsybakov

Estimating linear, mean-square continuous functionals is a pivotal challenge in statistics. In high-dimensional contexts, this estimation is often performed under the assumption of exact model sparsity, meaning that only a small number of…

Statistics Theory · Mathematics 2025-08-04 Jelena Bradic , Victor Chernozhukov , Whitney K. Newey , Yinchu Zhu

To recover a low rank structure from a noisy matrix, truncated singular value decomposition has been extensively used and studied. Recent studies suggested that the signal can be better estimated by shrinking the singular values. We pursue…

Methodology · Statistics 2014-11-25 Julie Josse , Sylvain Sardy

Consider a sequence of real data points $X_1,\ldots, X_n$ with underlying means $\theta^*_1,\dots,\theta^*_n$. This paper starts from studying the setting that $\theta^*_i$ is both piecewise constant and monotone as a function of the index…

Statistics Theory · Mathematics 2019-08-05 Chao Gao , Fang Han , Cun-Hui Zhang

This work studies the computational aspects of multivariate convex regression in dimensions $d \ge 5$. Our results include the \emph{first} estimators that are minimax optimal (up to logarithmic factors) with polynomial runtime in the…

Statistics Theory · Mathematics 2025-12-30 Gil Kur , Eli Putterman

We present a polynomial time algorithm to approximately scale tensors of any format to arbitrary prescribed marginals (whenever possible). This unifies and generalizes a sequence of past works on matrix, operator and tensor scaling. Our…

Data Structures and Algorithms · Computer Science 2020-03-10 Peter Bürgisser , Cole Franks , Ankit Garg , Rafael Oliveira , Michael Walter , Avi Wigderson

We study the problem of estimating the trace of a matrix $A$ that can only be accessed through matrix-vector multiplication. We introduce a new randomized algorithm, Hutch++, which computes a $(1 \pm \epsilon)$ approximation to $tr(A)$ for…

Data Structures and Algorithms · Computer Science 2021-06-14 Raphael A. Meyer , Cameron Musco , Christopher Musco , David P. Woodruff

We consider in this paper the problem of noisy 1-bit matrix completion under a general non-uniform sampling distribution using the max-norm as a convex relaxation for the rank. A max-norm constrained maximum likelihood estimate is…

Machine Learning · Statistics 2013-09-25 T. Tony Cai , Wen-Xin Zhou