English
Related papers

Related papers: Stochastic trace estimation for parameter-dependen…

200 papers

Randomized methods, such as the randomized SVD (singular value decomposition) and Nystr\"om approximation, are an effective way to compute low-rank approximations of large matrices. Motivated by applications to operator learning, Boull\'e…

Numerical Analysis · Mathematics 2026-02-09 Daniel Kressner , David Persson , André Uschmajew

This survey explores modern approaches for computing low-rank approximations of high-dimensional matrices by means of the randomized SVD, randomized subspace iteration, and randomized block Krylov iteration. The paper compares the…

Numerical Analysis · Mathematics 2023-09-25 Joel A. Tropp , Robert J. Webber

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

Second-order optimization methods are among the most widely used optimization approaches for convex optimization problems, and have recently been used to optimize non-convex optimization problems such as deep learning models. The widely…

Optimization and Control · Mathematics 2022-02-01 Dinesh Singh , Hardik Tankaria , Makoto Yamada

The Sinkhorn "distance", a variant of the Wasserstein distance with entropic regularization, is an increasingly popular tool in machine learning and statistical inference. However, the time and memory requirements of standard algorithms for…

Machine Learning · Statistics 2021-11-16 Jason Altschuler , Francis Bach , Alessandro Rudi , Jonathan Niles-Weed

A/B testing, a widely used form of Randomized Controlled Trial (RCT), is a fundamental tool in business data analysis and experimental design. However, despite its intent to maintain randomness, A/B testing often faces challenges that…

Methodology · Statistics 2024-08-13 Zihao Zheng , Carol Liu

In order to compute fast approximations to the singular value decompositions (SVD) of very large matrices, randomized sketching algorithms have become a leading approach. However, a key practical difficulty of sketching an SVD is that the…

Machine Learning · Statistics 2020-03-12 Miles E. Lopes , N. Benjamin Erichson , Michael W. Mahoney

Stochastic variational inference algorithms are derived for fitting various heteroskedastic time series models. We examine Gaussian, t, and skew-t response GARCH models and fit these using Gaussian variational approximating densities. We…

Computation · Statistics 2023-08-30 Hanwen Xuan , Luca Maestrini , Feng Chen , Clara Grazian

The characteristic feature of semi-selfsimilar process is the invariance of its finite dimensional distributions by certain dilation for specific scaling factor. Estimating the scale parameter $\lambda$ and the Hurst index of such processes…

Statistics Theory · Mathematics 2012-07-11 Saeid Rezakhah , Anne Philippe , Navideh Modarresi

We present randomized algorithms for estimating the log-determinant of regularized symmetric positive semi-definite matrices. The algorithms access the matrix only through matrix vector products, and are based on the introduction of a…

Numerical Analysis · Mathematics 2026-02-20 Alice Cortinovis , Daniele Toni

This paper is concerned with the low-rank approximation for large-scale nonsymmetric matrices. Inspired by the classical Nystrom method, which is a popular method to find the low-rank approximation for symmetric positive semidefinite…

Numerical Analysis · Mathematics 2024-10-30 Yatian Wang , Hua Xiang , Chi Zhang , Songling Zhang

Given an implicit $n\times n$ matrix $A$ with oracle access $x^TA x$ for any $x\in \mathbb{R}^n$, we study the query complexity of randomized algorithms for estimating the trace of the matrix. This problem has many applications in quantum…

Computational Complexity · Computer Science 2014-05-29 Karl Wimmer , Yi Wu , Peng Zhang

We adapt a well known streaming algorithm for approximating item frequencies to the matrix sketching setting. The algorithm receives the rows of a large matrix $A \in \R^{n \times m}$ one after the other in a streaming fashion. It maintains…

Data Structures and Algorithms · Computer Science 2012-07-12 Edo Liberty

Considering the increasing size of available data, the need for statistical methods that control the finite sample bias is growing. This is mainly due to the frequent settings where the number of variables is large and allowed to increase…

Statistics Theory · Mathematics 2018-10-12 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

An ensemble of random unistochastic (orthostochastic) matrices is defined by taking squared moduli of elements of random unitary (orthogonal) matrices distributed according to the Haar measure on U(N) (or O(N), respectively). An ensemble of…

Chaotic Dynamics · Physics 2009-11-07 K. Zyczkowski , W. Slomczynski , M. Kus , H. -J. Sommers

Stochastic reaction networks are mathematical models with a wide range of applications in biochemistry, ecology, and epidemiology, and are often complex to analyze. Except for some special cases, it is generally difficult to predict how the…

Probability · Mathematics 2026-04-02 Daniele Cappelletti , Giulio Cuniberti , Paola Siri

In this paper we propose and analyze an algorithm for identifying spectral gaps of a real symmetric matrix $A$ by simultaneously approximating the traces of spectral projectors associated with multiple different spectral slices. Our method…

Numerical Analysis · Mathematics 2025-09-09 Michele Benzi , Michele Rinelli , Igor Simunec

Although the operator (spectral) norm is one of the most widely used metrics for covariance estimation, comparatively little is known about the fluctuations of error in this norm. To be specific, let $\hat\Sigma$ denote the sample…

Statistics Theory · Mathematics 2019-09-16 Miles E. Lopes , N. Benjamin Erichson , Michael W. Mahoney

Computing eigenvalues of very large matrices is a critical task in many machine learning applications, including the evaluation of log-determinants, the trace of matrix functions, and other important metrics. As datasets continue to grow in…

Machine Learning · Statistics 2025-06-16 Siavash Ameli , Chris van der Heide , Liam Hodgkinson , Michael W. Mahoney

We provide a numerically robust and fast method capable of exploiting the local geometry when solving large-scale stochastic optimisation problems. Our key innovation is an auxiliary variable construction coupled with an inverse Hessian…

Machine Learning · Statistics 2018-02-14 Adrian Wills , Thomas Schön