English
Related papers

Related papers: Hutch++: Optimal Stochastic Trace Estimation

200 papers

Many fields require computing the trace of the inverse of a large, sparse matrix. The typical method used for such computations is the Hutchinson method which is a Monte Carlo (MC) averaging over matrix quadratures. To improve its…

High Energy Physics - Lattice · Physics 2017-05-12 Arjun Singh Gambhir , Andreas Stathopoulos , Kostas Orginos

We study the problem of estimating the diagonal of an implicitly given matrix $A$. For such a matrix we have access to an oracle that allows us to evaluate the matrix vector product $Av$. For random variable $v$ drawn from an appropriate…

Data Structures and Algorithms · Computer Science 2022-01-27 Robert A. Baston , Yuji Nakatsukasa

We consider the problem of estimating the trace and diagonal entries of an N-order tensor (where $N \geq 2$) under the framework where the tensor can only be accessed through tensor-vector multiplication. The aim is to estimate the tensor's…

Numerical Analysis · Mathematics 2025-10-28 Bhisham Dev Verma , Rameshwar Pratap , Keegan Kang

The ODE method has been a workhorse for algorithm design and analysis since the introduction of the stochastic approximation. It is now understood that convergence theory amounts to establishing robustness of Euler approximations for ODEs,…

Optimization and Control · Mathematics 2020-10-02 Shuhang Chen , Adithya Devraj , Andrey Bernstein , Sean Meyn

Some data analysis problems require the computation of (regularised) inverse traces, i.e. quantities of the form $\Tr (q \bI + \bL)^{-1}$. For large matrices, direct methods are unfeasible and one must resort to approximations, for example…

We study the problem of learning a structured approximation (low-rank, sparse, banded, etc.) to an unknown matrix $A$ given access to matrix-vector product (matvec) queries of the form $x \rightarrow Ax$ and $x \rightarrow A^Tx$. This…

Data Structures and Algorithms · Computer Science 2025-07-28 Noah Amsel , Pratyush Avi , Tyler Chen , Feyza Duman Keles , Chinmay Hegde , Cameron Musco , Christopher Musco , David Persson

We introduce a novel algorithm for approximating the logarithm of the determinant of a symmetric positive definite (SPD) matrix. The algorithm is randomized and approximates the traces of a small number of matrix powers of a specially…

Data Structures and Algorithms · Computer Science 2016-09-01 Christos Boutsidis , Petros Drineas , Prabhanjan Kambadur , Eugenia-Maria Kontopoulou , Anastasios Zouzias

An algorithm for solving nonconvex smooth optimization problems is proposed, analyzed, and tested. The algorithm is an extension of the Trust Region Algorithm with Contractions and Expansions (TRACE) [Math. Prog. 162(1):132, 2017]. In…

Optimization and Control · Mathematics 2022-04-26 Frank E. Curtis , Qi Wang

In the trace reconstruction problem, one attempts to reconstruct a fixed but unknown string $x$ of length $n$ from a given number of traces $\tilde{x}$ drawn iid from the application of a noisy process (such as the deletion channel) to $x$.…

Data Structures and Algorithms · Computer Science 2024-10-17 Ittai Rubinstein

Matrix completion, where we wish to recover a low rank matrix by observing a few entries from it, is a widely studied problem in both theory and practice with wide applications. Most of the provable algorithms so far on this problem have…

Machine Learning · Computer Science 2016-05-27 Chi Jin , Sham M. Kakade , Praneeth Netrapalli

We study how to utilize (possibly erroneous) predictions in a model for computing under uncertainty in which an algorithm can query unknown data. Our aim is to minimize the number of queries needed to solve the minimum spanning tree…

Data Structures and Algorithms · Computer Science 2022-07-01 Thomas Erlebach , Murilo Santos de Lima , Nicole Megow , Jens Schlöter

Logarithms of determinants of large positive definite matrices appear ubiquitously in machine learning applications including Gaussian graphical and Gaussian process models, partition functions of discrete graphical models, minimum-volume…

Data Structures and Algorithms · Computer Science 2015-03-24 Insu Han , Dmitry Malioutov , Jinwoo Shin

The scatter halfspace depth (sHD) is an extension of the location halfspace (also called Tukey) depth that is applicable in the nonparametric analysis of scatter. Using sHD, it is possible to define minimax optimal robust scatter estimators…

Computation · Statistics 2022-08-11 Xiaohui Liu , Yuzi Liu , Petra Laketa , Stanislav Nagy , Yuting Chen

We describe several algorithms for matrix completion and matrix approximation when only some of its entries are known. The approximation constraint can be any whose approximated solution is known for the full matrix. For low rank…

Numerical Analysis · Mathematics 2014-07-01 Gil Shabat , Yaniv Shmueli , Amir Averbuch

In this paper, we propose new randomized algorithms for estimating the two-to-infinity and one-to-two norms in a matrix-free setting, using only matrix-vector multiplications. Our methods are based on appropriate modifications of…

Machine Learning · Computer Science 2026-01-21 Askar Tsyganov , Evgeny Frolov , Sergey Samsonov , Maxim Rakhuba

Random projections or sketching are widely used in many algorithmic and learning contexts. Here we study the performance of iterative Hessian sketch for least-squares problems. By leveraging and extending recent results from random matrix…

Optimization and Control · Mathematics 2020-10-26 Jonathan Lacotte , Sifan Liu , Edgar Dobriban , Mert Pilanci

We develop several efficient algorithms for the classical \emph{Matrix Scaling} problem, which is used in many diverse areas, from preconditioning linear systems to approximation of the permanent. On an input $n\times n$ matrix $A$, this…

Data Structures and Algorithms · Computer Science 2017-04-10 Zeyuan Allen-Zhu , Yuanzhi Li , Rafael Oliveira , Avi Wigderson

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

We propose a general method for optimally approximating an arbitrary matrix $\mathbf{M}$ by a structured matrix $\mathbf{T}$ (circulant, Toeplitz/Hankel, etc.) and examine its use for estimating the spectra of genomic linkage disequilibrium…

Applications · Statistics 2024-09-10 Chris Salahub , Jeffrey Uhlmann

Correspondence problems are often modelled as quadratic optimization problems over permutations. Common scalable methods for approximating solutions of these NP-hard problems are the spectral relaxation for non-convex energies and the…

Graphics · Computer Science 2017-05-18 Nadav Dym , Haggai Maron , Yaron Lipman