English
Related papers

Related papers: Novel technique based on L\'eja Points Approximati…

200 papers

We develop a novel convergence analysis of the classical deterministic block Krylov methods for the approximation of $h$-dimensional dominant subspaces and low-rank approximations of matrices $ A\in\mathbb K^{m\times n}$ (where $\mathbb…

Numerical Analysis · Mathematics 2024-08-22 Pedro Massey

Mixed-effects models are widely used to model data with hierarchical grouping structures and high-cardinality categorical predictor variables. However, for high-dimensional crossed random effects, current standard computations relying on…

Methodology · Statistics 2026-05-15 Pascal Kündig , Fabio Sigrist

An outstanding problem when computing a function of a matrix, $f(A)$, by using a Krylov method is to accurately estimate errors when convergence is slow. Apart from the case of the exponential function which has been extensively studied in…

Numerical Analysis · Mathematics 2018-02-15 Jie Chen , Yousef Saad

This work suggests an interpolation-based stochastic collocation method for the non-intrusive and adaptive construction of sparse polynomial chaos expansions (PCEs). Unlike pseudo-spectral projection and regression-based stochastic…

Numerical Analysis · Mathematics 2019-11-21 Dimitrios Loukrezis , Herbert De Gersem

Randomized sketching is currently introduced into every area of numerical linear algebra. In Krylov subspace methods, it allows runtime savings at the cost of small accuracy reductions. This work offers a different view on sketching in…

Numerical Analysis · Mathematics 2026-04-09 Kai Bergermann

The dominant cost in solving least-square problems using Newton's method is often that of factorizing the Hessian matrix over multiple values of the regularization parameter ($\lambda$). We propose an efficient way to interpolate the…

Machine Learning · Computer Science 2015-06-11 Da Kuang , Alex Gittens , Raffay Hamid

We study parameter estimation for univariate stochastic differential equations with locally Lipschitz drift and H\"older continuous multiplicative diffusion, a class commonly arising in several applications. Existing inference methods…

Methodology · Statistics 2026-05-19 Bowen Fang , Dario Spanò , Massimiliano Tamborrino

The L1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix, or alternatively the underlying graph structure of a Gaussian Markov…

Machine Learning · Computer Science 2013-06-14 Cho-Jui Hsieh , Matyas A. Sustik , Inderjit S. Dhillon , Pradeep Ravikumar

Krylov subspace methods are a powerful tool for efficiently solving high-dimensional linear algebra problems. In this work, we study the approximation quality that a Krylov subspace provides for estimating the numerical range of a matrix.…

Numerical Analysis · Mathematics 2024-12-02 Cecilia Chen , John Urschel

Randomized trace estimation is a popular and well studied technique that approximates the trace of a large-scale matrix $B$ by computing the average of $x^T Bx$ for many samples of a random vector $X$. Often, $B$ is symmetric positive…

Numerical Analysis · Mathematics 2021-05-26 Alice Cortinovis , Daniel Kressner

The Leja method is a polynomial interpolation procedure that can be used to compute matrix functions. In particular, computing the action of the matrix exponential on a given vector is a typical application. This quantity is required, e.g.,…

Numerical Analysis · Mathematics 2016-07-15 Marco Caliari , Peter Kandolf , Alexander Ostermann , Stefan Rainer

The Fr\'echet derivative $L_f(A,E)$ of the matrix function $f(A)$ plays an important role in many different applications, including condition number estimation and network analysis. We present several different Krylov subspace methods for…

Numerical Analysis · Mathematics 2020-09-01 Peter Kandolf , Antti Koskela , Samuel D. Relton , Marcel Schweitzer

Determinantal point processes (DPPs) have wide-ranging applications in machine learning, where they are used to enforce the notion of diversity in subset selection problems. Many estimators have been proposed, but surprisingly the basic…

Statistics Theory · Mathematics 2017-07-25 Victor-Emmanuel Brunel , Ankur Moitra , Philippe Rigollet , John Urschel

We study classic streaming and sparse recovery problems using deterministic linear sketches, including l1/l1 and linf/l1 sparse recovery problems (the latter also being known as l1-heavy hitters), norm estimation, and approximate inner…

Data Structures and Algorithms · Computer Science 2012-12-12 Jelani Nelson , Huy Nguyen , David P. Woodruff

In various areas of applied numerics, the problem of calculating the logarithm of a matrix A emerges. Since series expansions of the logarithm usually do not converge well for matrices far away from the identity, the standard numerical…

Numerical Analysis · Computer Science 2007-07-19 Gernot Schaller

Randomized block Krylov subspace methods form a powerful class of algorithms for computing the extreme eigenvalues of a symmetric matrix or the extreme singular values of a general matrix. The purpose of this paper is to develop new…

Numerical Analysis · Mathematics 2021-10-05 Joel A. Tropp

In some cases, computational benefit can be gained by exploring the hyper parameter space using a deterministic set of grid points instead of a Markov chain. We view this as a numerical integration problem and make three unique…

Computation · Statistics 2016-09-30 Chaitanya Joshi , Paul T. Brown , Stephen Joe

Matrices arising in scientific applications frequently admit linear low-rank approximations due to smoothness in the physical and/or temporal domain of the problem. In large-scale problems, computing an optimal low-rank approximation can be…

Numerical Analysis · Mathematics 2021-05-05 Alec Michael Dunton , Alireza Doostan

This paper considers eigenpair computations of large symmetric matrices with the desired eigenvalues lying in a given interval using the contour integral-based block SS--RR method, a Rayleigh--Ritz projection onto a certain subspace…

Numerical Analysis · Mathematics 2025-08-29 Zhongxiao Jia , Tianhang Liu

In this paper we propose and analyze an algorithm for identifying spectral gaps of a real symmetric matrix $A$ by simultaneously approximating the traces of spectral projectors associated with multiple different spectral slices. Our method…

Numerical Analysis · Mathematics 2025-09-09 Michele Benzi , Michele Rinelli , Igor Simunec