English
Related papers

Related papers: A Multilevel Approach to Stochastic Trace Estimati…

200 papers

Bilevel optimization problems are receiving increasing attention in machine learning as they provide a natural framework for hyperparameter optimization and meta-learning. A key step to tackle these problems is the efficient computation of…

Machine Learning · Statistics 2025-05-20 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian…

Machine Learning · Statistics 2024-05-21 Sohail Reddy , Hillary Fairbanks

We consider the task of estimating the trace of a matrix function, ${\rm tr}(f({\bf A}))$, of a large symmetric positive semi-definite matrix ${\bf A}$. This problem arises in multiple applications, including kernel methods and inverse…

Numerical Analysis · Mathematics 2026-03-09 Madhusudan Madhavan , Alen Alexanderian , Arvind K. Saibaba

We present randomized algorithms for estimating the trace and deter- minant of Hermitian positive semi-definite matrices. The algorithms are based on subspace iteration, and access the matrix only through matrix vector products. We analyse…

Numerical Analysis · Mathematics 2017-02-17 Arvind K. Saibaba , Alen Alexanderian , Ilse C. F. Ipsen

This work is concerned with computing low-rank approximations of a matrix function $f(A)$ for a large symmetric positive semi-definite matrix $A$, a task that arises in, e.g., statistical learning and inverse problems. The application of…

Numerical Analysis · Mathematics 2023-06-13 David Persson , Daniel Kressner

We consider the task of approximating a matrix function $f(A)$, where $A$ is a matrix in which only a relatively small number of (not necessarily consecutive) sub- and superdiagonals contain nonzero entries. Approximating $f$ by a…

Numerical Analysis · Mathematics 2025-12-09 Majed Hamadi , Nezam Mahdavi-Amiri , Marcel Schweitzer

Stochastic collocation methods for approximating the solution of partial differential equations with random input data (e.g., coefficients and forcing terms) suffer from the curse of dimensionality whereby increases in the stochastic…

Numerical Analysis · Mathematics 2014-05-23 Aretha L. Teckentrup , Peter Jantsch , Clayton G. Webster , Max Gunzburger

We propose a multilevel Markov chain Monte Carlo (MCMC) method for the Bayesian inference of random field parameters in PDEs using high-resolution data. Compared to existing multilevel MCMC methods, we additionally consider level-dependent…

Numerical Analysis · Mathematics 2025-08-19 Pieter Vanmechelen , Geert Lombaert , Giovanni Samaey

The loss and the norm of its gradient separate the healthy and the pathological regimes of neural-network training only weakly, whilst the curvature of the empirical risk differs qualitatively between them but is inaccessible explicitly at…

Machine Learning · Computer Science 2026-05-26 Maxim Bolshim , Alexander Kugaevskikh

We develop randomized matrix-free algorithms for estimating partial traces, a generalization of the trace arising in quantum physics and chemistry. Our algorithm improves on the typicality-based approach used in [T. Chen and Y-C. Cheng,…

Numerical Analysis · Mathematics 2024-12-02 Tyler Chen , Robert Chen , Kevin Li , Skai Nzeuton , Yilu Pan , Yixin Wang

We develop a multilevel approach to compute approximate solutions to backward differential equations (BSDEs). The fully implementable algorithm of our multilevel scheme constructs sequential martingale control variates along a sequence of…

Probability · Mathematics 2014-12-11 Dirk Becherer , Plamen Turkedjiev

This article considers the sequential Monte Carlo (SMC) approximation of ratios of normalizing constants associated to posterior distributions which in principle rely on continuum models. Therefore, the Monte Carlo estimation error and the…

Computation · Statistics 2016-03-04 Pierre Del Moral , Ajay Jasra , Kody Law , Yan Zhou

We analyse a multilevel Monte Carlo method for the approximation of distribution functions of univariate random variables. Since, by assumption, the target distribution is not known explicitly, approximations have to be used. We provide an…

Probability · Mathematics 2017-06-22 Mike B. Giles , Tigran Nagapetyan , Klaus Ritter

In recent years, randomized methods for numerical linear algebra have received growing interest as a general approach to large-scale problems. Typically, the essential ingredient of these methods is some form of randomized dimension…

Machine Learning · Statistics 2019-04-05 Miles E. Lopes , Shusen Wang , Michael W. Mahoney

The trace $\tr(q(\ma{L} + q\ma{I})^{-1})$, where $\ma{L}$ is a symmetric diagonally dominant matrix, is the quantity of interest in some machine learning problems. However, its direct computation is impractical if the matrix size is large.…

Signal Processing · Electrical Eng. & Systems 2022-09-14 Yusuf Yigit Pilavci , Pierre-Olivier Amblard , Simon Barthelme , Nicolas Tremblay

Multilevel linear models allow flexible statistical modelling of complex data with different levels of stratification. Identifying the most appropriate model from the large set of possible candidates is a challenging problem. In the…

Methodology · Statistics 2022-11-15 Tom Edinburgh , Ari Ercole , Stephen J. Eglen

We consider the problem of numerically estimating expectations of solutions to stochastic differential equations driven by Brownian motions in the commonly occurring small noise regime. We consider (i) standard Monte Carlo methods combined…

Numerical Analysis · Mathematics 2015-06-08 David F. Anderson , Desmond J. Higham , Yu Sun

Stochastic sampling methods are arguably the most direct and least intrusive means of incorporating parametric uncertainty into numerical simulations of partial differential equations with random inputs. However, to achieve an overall error…

Numerical Analysis · Mathematics 2014-04-09 Hans-Werner van Wyk

In this paper, we consider the implementation of multi-level Monte Carlo method to a stochastic optimal control problem with log-normal coefficients and its surrogate model problem. From the perspective of two optimization problems, i.e.,…

Optimization and Control · Mathematics 2016-01-19 Qi Sun , Ju Ming

We propose a multi-level method to increase the accuracy of machine learning algorithms for approximating observables in scientific computing, particularly those that arise in systems modeled by differential equations. The algorithm relies…

Numerical Analysis · Mathematics 2020-07-06 Kjetil O. Lye , Siddhartha Mishra , Roberto Molinaro