English
Related papers

Related papers: Norm and trace estimation with random rank-one vec…

200 papers

We consider the problem of estimating the spectral norm of a matrix using only matrix-vector products. We propose a new Counterbalance estimator that provides upper bounds on the norm and derive probabilistic guarantees on its…

Numerical Analysis · Mathematics 2025-06-19 Alexey Naumov , Maxim Rakhuba , Denis Ryapolov , Sergey Samsonov

We prove some probabilistic estimates for tensor products of random vectors. As an application we obtain embeddings of certain matrix spaces into $L_1$.

Functional Analysis · Mathematics 2015-06-11 David Alonso-Gutierrez , Markus Passenbrunner , Joscha Prochno

In this paper, we propose new randomized algorithms for estimating the two-to-infinity and one-to-two norms in a matrix-free setting, using only matrix-vector multiplications. Our methods are based on appropriate modifications of…

Machine Learning · Computer Science 2026-01-21 Askar Tsyganov , Evgeny Frolov , Sergey Samsonov , Maxim Rakhuba

We consider the problem of estimation of a low-rank matrix from a limited number of noisy rank-one projections. In particular, we propose two fast, non-convex \emph{proper} algorithms for matrix recovery and support them with rigorous…

Machine Learning · Statistics 2017-05-23 Mohammadreza Soltani , Chinmay Hegde

We introduce the notion of a random matrix-valued multiplicative function, generalizing Rademacher random multiplicative functions to matrices. We provide an asymptotic for the second moment based on a linear recurrence property for…

Number Theory · Mathematics 2018-12-12 Maxim Gerspach

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

Observables in random tensor theory are polynomials in the entries of a tensor of rank $d$ which are invariant under $U(N)^d$. It is notoriously difficult to evaluate the expectations of such polynomials, even in the Gaussian distribution.…

Mathematical Physics · Physics 2014-11-26 Valentin Bonzom , Frédéric Combes

We propose a variational tail bound for norms of random vectors under moment assumptions on their one-dimensional marginals. A simplified version of the bound that parametrizes the ``aggregating distribution'' using a certain pushforward of…

Probability · Mathematics 2026-02-02 Sohail Bahmani

Several statistics-based detectors, based on unimodal matrix models, for determining the number of sources in a field are designed. A new variance ratio statistic is proposed, and its asymptotic distribution is analyzed. The variance ratio…

Applications · Statistics 2021-06-09 Rui Zhang , Junting Chen , Yao Xie , Alexander Shapiro , Urbashi Mitra

We propose a general error analysis related to the low-rank approximation of a given real matrix in both the spectral and Frobenius norms. First, we derive deterministic error bounds that hold with some minimal assumptions. Second, we…

Numerical Analysis · Mathematics 2022-06-22 Youssef Diouane , Selime Gürol , Alexandre Scotto Di Perrotolo , Xavier Vasseur

We derive new comparison inequalities between weak and strong moments of norms of random vectors with optimal (up to an universal factor) constants. We discuss applications to the concentration of log-concave random vectors and bounds on…

Probability · Mathematics 2021-06-08 Rafał Latała , Piotr Nayar

Many results have been proved for various nuclear norm penalized estimators of the uniform sampling matrix completion problem. However, most of these estimators are not robust: in most of the cases the quadratic loss function and its…

Statistics Theory · Mathematics 2017-07-25 Andreas Elsener , Sara van de Geer

In this paper, we derive nearly tight probabilistic norm bounds for a class of random matrices we call graph matrices. While the classical case of symmetric matrices with independent random entries (Wigner's matrices) is a special case, in…

Combinatorics · Mathematics 2021-04-30 Kwangjun Ahn , Dhruv Medarametla , Aaron Potechin

Low-rank tensor approximations have shown great potential for uncertainty quantification in high dimensions, for example, to build surrogate models that can be used to speed up large-scale inference problems (Eigel et al., Inverse Problems…

Numerical Analysis · Mathematics 2020-11-30 Paul B. Rohrbach , Sergey Dolgov , Lars Grasedyck , Robert Scheichl

In this paper we suggest a new algorithm for the computation of a best rank one approximation of tensors, called alternating singular value decomposition. This method is based on the computation of maximal singular values and the…

Numerical Analysis · Mathematics 2015-03-19 S. Friedland , V. Mehrmann , R. Pajarola , S. K. Suter

Covariance estimation for matrix-valued data has received an increasing interest in applications. Unlike previous works that rely heavily on matrix normal distribution assumption and the requirement of fixed matrix size, we propose a class…

Methodology · Statistics 2022-04-20 Yichi Zhang , Weining Shen , Dehan Kong

Suppose that we observe entries or, more generally, linear combinations of entries of an unknown $m\times T$-matrix $A$ corrupted by noise. We are particularly interested in the high-dimensional setting where the number $mT$ of unknown…

Statistics Theory · Mathematics 2011-05-16 Angelika Rohde , Alexandre B. Tsybakov

Can the behavior of a random matrix be improved by modifying a small fraction of its entries? Consider a random matrix $A$ with i.i.d. entries. We show that the operator norm of $A$ can be reduced to the optimal order $O(\sqrt{n})$ by…

Probability · Mathematics 2017-11-02 Elizaveta Rebrova , Roman Vershynin

Relying on random matrix theory (RMT), this paper studies asymmetric order-$d$ spiked tensor models with Gaussian noise. Using the variational definition of the singular vectors and values of (Lim, 2005), we show that the analysis of the…

Probability · Mathematics 2022-11-22 Mohamed El Amine Seddik , Maxime Guillaud , Romain Couillet

Matrices can be decomposed via rank-one approximations: the best rank-one approximation is a singular vector pair, and the singular value decomposition writes a matrix as a sum of singular vector pairs. The singular vector tuples of a…

Algebraic Geometry · Mathematics 2025-12-02 Alvaro Ribot , Emil Horobet , Anna Seigal , Ettore Teixeira Turatti