English
Related papers

Related papers: Randomized sketching of nonlinear eigenvalue probl…

200 papers

Singularly-perturbed ordinary differential equations often exhibit Stokes' phenomenon, which describes the appearance and disappearance of oscillating exponentially small terms across curves in the complex plane known as Stokes curves.…

Numerical Analysis · Mathematics 2024-05-15 Christopher J. Lustri , Samuel C. Crew , S. Jonathan Chapman

In this article a fast and parallelizable algorithm for rational approximation is presented. The method, called (P)QR-AAA, is a (parallel) set-valued variant of the AAA algorithm for scalar functions. It builds on the set-valued AAA…

Numerical Analysis · Mathematics 2024-12-04 Simon Dirckx , Karl Meerbergen , Daan Huybrechs

The AAA algorithm, introduced in 2018, computes best or near-best rational approximations to functions or data on subsets of the real line or the complex plane. It is much faster and more robust than previous algorithms for such problems…

Numerical Analysis · Mathematics 2023-12-07 Yuji Nakatsukasa , Olivier Sete , Lloyd N. Trefethen

Several applications of the QR-AAA algorithm, a greedy scheme for vector-valued rational approximation, are presented. The focus is on demonstrating the flexibility and practical effectiveness of QR-AAA in a variety of computational…

Numerical Analysis · Mathematics 2026-02-02 Simon Dirckx

AAA rational approximation has normally been carried out on a discrete set, typically hundreds or thousands of points in a real interval or complex domain. Here we introduce a continuum AAA algorithm that discretizes a domain adaptively as…

Numerical Analysis · Mathematics 2023-05-08 Toby Driscoll , Yuji Nakatsukasa , Lloyd N. Trefethen

We present adaptive sequential SAA (sample average approximation) algorithms to solve large-scale two-stage stochastic linear programs. The iterative algorithm framework we propose is organized into \emph{outer} and \emph{inner} iterations…

Optimization and Control · Mathematics 2020-12-08 Raghu Pasupathy , Yongjia Song

We provide rigorous theoretical bounds for Anderson acceleration (AA) that allow for approximate calculations when applied to solve linear problems. We show that, when the approximate calculations satisfy the provided error bounds, the…

Numerical Analysis · Mathematics 2024-04-30 Massimiliano Lupo Pasini , M. Paul Laiu

This paper develops a new class of algorithms for general linear systems and eigenvalue problems. These algorithms apply fast randomized sketching to accelerate subspace projection methods, such as GMRES and Rayleigh--Ritz. This approach…

Numerical Analysis · Mathematics 2022-02-17 Yuji Nakatsukasa , Joel A. Tropp

A methodology for using random sketching in the context of model order reduction for high-dimensional parameter-dependent systems of equations was introduced in [Balabanov and Nouy 2019, Part I]. Following this framework, we here construct…

Numerical Analysis · Mathematics 2022-03-25 Oleg Balabanov , Anthony Nouy

We present a novel approach for black-box VI that bypasses the difficulties of stochastic gradient ascent, including the task of selecting step-sizes. Our approach involves using a sequence of sample average approximation (SAA) problems.…

Machine Learning · Computer Science 2023-05-18 Javier Burroni , Justin Domke , Daniel Sheldon

Numerical solution of nonlinear eigenvalue problems (NEPs) is frequently encountered in computational science and engineering. The applicability of most existing methods is limited by matrix structures, property of eigen-solutions, size of…

Numerical Analysis · Mathematics 2016-05-26 Jinyou Xiao , Chuanzeng Zhang , Tsung-Ming Huang , Tetsuya Sakurai

We propose a randomized algorithm with quadratic convergence rate for convex optimization problems with a self-concordant, composite, strongly convex objective function. Our method is based on performing an approximate Newton step using a…

Optimization and Control · Mathematics 2021-05-18 Jonathan Lacotte , Yifei Wang , Mert Pilanci

Iterative Hessian sketch (IHS) is an effective sketching method for modeling large-scale data. It was originally proposed by Pilanci and Wainwright (2016; JMLR) based on randomized sketching matrices. However, it is computationally…

Machine Learning · Statistics 2020-03-10 Aijun Zhang , Hengtao Zhang , Guosheng Yin

This paper describes a suite of algorithms for constructing low-rank approximations of an input matrix from a random linear image of the matrix, called a sketch. These methods can preserve structural properties of the input matrix, such as…

Numerical Analysis · Computer Science 2018-01-03 Joel A. Tropp , Alp Yurtsever , Madeleine Udell , Volkan Cevher

Sketch-and-solve (SAS) is a very successful method to efficiently estimate the solution of heavily overdetermined large linear least squares problems. It uses random sketching to reduce the size of the problem, hence reducing the…

Numerical Analysis · Mathematics 2026-05-26 Irina-Beatrice Haas , Michael B. Giles , Yuji Nakatsukasa

Randomized sketching accelerates large-scale numerical linear algebra by reducing computational complexity. While the traditional sketch-and-solve approach reduces the problem size directly through sketching, the sketch-and-precondition…

Numerical Analysis · Mathematics 2025-05-23 Ruihan Xu , Yiping Lu

Algorithms from Randomized Numerical Linear Algebra (RandNLA) are known to be effective in handling high-dimensional computational problems, providing high-quality empirical performance as well as strong probabilistic guarantees. However,…

Machine Learning · Computer Science 2025-01-13 Younghyun Cho , James W. Demmel , Michał Dereziński , Haoyun Li , Hengrui Luo , Michael W. Mahoney , Riley J. Murray

We revisit the sample average approximation (SAA) approach for non-convex stochastic programming. We show that applying the SAA approach to problems with expected value equality constraints does not necessarily result in asymptotic…

Optimization and Control · Mathematics 2024-07-16 Thomas Lew , Riccardo Bonalli , Marco Pavone

We present two new methods for multivariate exponential analysis. In [7], we developed a new algorithm for reconstruction of univariate exponential sums by exploiting the rational structure of their Fourier coefficients and reconstructing…

Numerical Analysis · Mathematics 2025-04-29 Nadiia Derevianko , Lennart Aljoscha Hübner

Rational minimax approximation of real functions on real intervals is an established topic, but when it comes to complex functions or domains, there appear to be no algorithms currently in use. Such a method is introduced here, the {\em…

Numerical Analysis · Mathematics 2019-08-19 Yuji Nakatsukasa , Lloyd N. Trefethen