English
Related papers

Related papers: Faster Stochastic Trace Estimation with a Chebyshe…

200 papers

A method for evaluating matrix polynomials have recently been developed that require one fewer matrix product ($1M$) than the Paterson--Stockmeyer (PS) method. Since the computational cost for large-scale matrices is asymptotically…

Numerical Analysis · Mathematics 2026-03-25 J. M. Alonso , J. Sastre , J. Ibáñez , E. Defez

We develop a simple two-step algorithm for enclosing Chebyshev expansions whose cost is linear in terms of the polynomial degree. The algorithm first transforms the expansion from Chebyshev to the Laurent basis and then applies the interval…

Numerical Analysis · Mathematics 2024-09-24 Jared L. Aurentz , Behnam Hashemi

The trace of a matrix function f(A), most notably of the matrix inverse, can be estimated stochastically using samples< x,f(A)x> if the components of the random vectors x obey an appropriate probability distribution. However such a…

Numerical Analysis · Mathematics 2021-08-26 Andreas Frommer , Mostafa Nasr Khalil , Gustavo Ramirez-Hidalgo

For a linearly recurrent vector sequence P[n+1] = A(n) * P[n], consider the problem of calculating either the n-th term P[n] or L<=n arbitrary terms P[n_1],...,P[n_L], both for the case of constant coefficients A(n)=A and for a matrix A(n)…

Symbolic Computation · Computer Science 2007-05-23 Martin Ziegler

We present sparse interpolation algorithms for recovering a polynomial with $\le B$ terms from $N$ evaluations at distinct values for the variable when $\le E$ of the evaluations can be erroneous. Our algorithms perform exact arithmetic in…

Symbolic Computation · Computer Science 2020-11-05 Erich L. Kaltofen , Zhi-Hong Yang

In this paper we present a new algorithm for computing a low rank approximation of the product $A^TB$ by taking only a single pass of the two matrices $A$ and $B$. The straightforward way to do this is to (a) first sketch $A$ and $B$…

Machine Learning · Statistics 2016-10-27 Shanshan Wu , Srinadh Bhojanapalli , Sujay Sanghavi , Alexandros G. Dimakis

This paper studies theoretical lower bounds for estimating the trace of a matrix function, $\text{tr}(f(A))$, focusing on methods that use Hutchinson's method along with Block Krylov techniques. These methods work by approximating…

Statistics Theory · Mathematics 2025-07-01 Shi Jie Yu

This paper studies two potential modifications of XTrace (Epperly et al., SIMAX 45(1):1-23, 2024), a randomized algorithm for estimating the trace of a matrix. The first is a variance reduction step that averages the output of XTrace over…

Numerical Analysis · Mathematics 2025-12-03 Eric Hallman

In this paper, we consider the estimation and inference of precision matrices of a rich class of locally stationary and nonlinear time series assuming that only one realization of the time series is observed. Using a Cholesky decomposition…

Statistics Theory · Mathematics 2019-08-15 Xiucai Ding , Zhou Zhou

The growing availability of large and complex datasets has increased interest in temporal stochastic processes that can capture stylized facts such as marginal skewness, non-Gaussian tails, long memory, and even non-Markovian dynamics.…

Machine Learning · Statistics 2025-10-09 Dan Leonte , Raphaël Huser , Almut E. D. Veraart

We consider the problem of estimating the trace and diagonal entries of an N-order tensor (where $N \geq 2$) under the framework where the tensor can only be accessed through tensor-vector multiplication. The aim is to estimate the tensor's…

Numerical Analysis · Mathematics 2025-10-28 Bhisham Dev Verma , Rameshwar Pratap , Keegan Kang

The solution of a (stochastic) differential equation can be locally approximated by a (stochastic) expansion. If the vector field of the differential equation is a polynomial, the corresponding expansion is a linear combination of iterated…

Probability · Mathematics 2010-09-29 Christophe Ladroue , Anastasia Papavasiliou

We solve principal component regression (PCR), up to a multiplicative accuracy $1+\gamma$, by reducing the problem to $\tilde{O}(\gamma^{-1})$ black-box calls of ridge regression. Therefore, our algorithm does not require any explicit…

Machine Learning · Statistics 2017-04-26 Zeyuan Allen-Zhu , Yuanzhi Li

We introduce a new method to price American options based on Chebyshev interpolation. In each step of a dynamic programming time-stepping we approximate the value function with Chebyshev polynomials. The key advantage of this approach is…

Computational Finance · Quantitative Finance 2018-06-15 Kathrin Glau , Mirco Mahlstedt , Christian Pötz

The Paterson--Stockmeyer method is an evaluation scheme for matrix polynomials with scalar coefficients that arise in many state-of-the-art algorithms based on polynomial or rational approximation, for example, those for computing…

Numerical Analysis · Mathematics 2024-12-06 Xiaobo Liu

A number of recent works have proposed to solve the line spectral estimation problem by applying off-the-grid extensions of sparse estimation techniques. These methods are preferable over classical line spectral estimation algorithms…

Signal Processing · Electrical Eng. & Systems 2018-02-19 Thomas Lundgaard Hansen , Bernard Henri Fleury , Bhaskar D. Rao

A number of applications require the computation of the trace of a matrix that is implicitly available through a function. A common example of a function is the inverse of a large, sparse matrix, which is the focus of this paper. When the…

Numerical Analysis · Computer Science 2016-09-07 Lingfei Wu , Jesse Laeuchli , Vassilis Kalantzis , Andreas Stathopoulos , Efstratios Gallopoulos

The dominant cost in solving least-square problems using Newton's method is often that of factorizing the Hessian matrix over multiple values of the regularization parameter ($\lambda$). We propose an efficient way to interpolate the…

Machine Learning · Computer Science 2015-06-11 Da Kuang , Alex Gittens , Raffay Hamid

We study the problem of estimating the trace of a matrix $\mathbf{A}$ that can only be accessed through Kronecker-matrix-vector products. That is, for any Kronecker-structured vector $\mathrm{x} = \otimes_{i=1}^k \mathrm{x}_i$, we can…

Data Structures and Algorithms · Computer Science 2025-02-03 Raphael A. Meyer , Haim Avron

In this paper we consider symmetric, positive semidefinite (SPSD) matrix $A$ and present two algorithms for computing the $p$-Schatten norm $\|A\|_p$. The first algorithm works for any SPSD matrix $A$. The second algorithm works for…

Data Structures and Algorithms · Computer Science 2018-08-08 Vladimir Braverman