English
Related papers

Related papers: A refined nonlinear least-squares method for the r…

200 papers

A matrix algorithm runs superfast (aka at sublinear cost) if it involves much fewer flops and memory cells than an input matrix has entries. Big Data are frequently represented by matrices of immense sizes that cannot be handled directly…

Numerical Analysis · Mathematics 2025-11-11 Qi Luan , Victor Y. Pan

We present a method for solving nonlinear eigenvalue problems using rational approximation. The method uses the AAA method by Nakatsukasa, S\`{e}te, and Trefethen to approximate the nonlinear eigenvalue problem by a rational eigenvalue…

Numerical Analysis · Mathematics 2018-02-05 Pieter Lietaert , Javier Pérez , Bart Vandereycken , Karl Meerbergen

We present an extension of the AAA (adaptive Antoulas--Anderson) algorithm for periodic functions, called 'AAAtrig'. The algorithm uses the key steps of AAA approximation by (i) representing the approximant in (trigonometric) barycentric…

Numerical Analysis · Mathematics 2020-08-13 Peter J. Baddoo

Singularly-perturbed ordinary differential equations often exhibit Stokes' phenomenon, which describes the appearance and disappearance of oscillating exponentially small terms across curves in the complex plane known as Stokes curves.…

Numerical Analysis · Mathematics 2024-05-15 Christopher J. Lustri , Samuel C. Crew , S. Jonathan Chapman

We present adaptive sequential SAA (sample average approximation) algorithms to solve large-scale two-stage stochastic linear programs. The iterative algorithm framework we propose is organized into \emph{outer} and \emph{inner} iterations…

Optimization and Control · Mathematics 2020-12-08 Raghu Pasupathy , Yongjia Song

The AAA algorithm, introduced in 2018, computes best or near-best rational approximations to functions or data on subsets of the real line or the complex plane. It is much faster and more robust than previous algorithms for such problems…

Numerical Analysis · Mathematics 2023-12-07 Yuji Nakatsukasa , Olivier Sete , Lloyd N. Trefethen

This paper introduces the Adaptive Gradient Least Squares Progressive iterative Approximation (AdagradLSPIA), an accelerated version of the Least Squares Progressive Iterative Approximation (LSPIA) method, enhanced with adaptive…

Numerical Analysis · Mathematics 2025-05-08 Svajūnas Sajavičius

Anderson Acceleration (AA) is a method to accelerate the convergence of fixed point iterations for nonlinear, algebraic systems of equations. Due to the requirement of solving a least squares problem at each iteration and a reliance on…

Numerical Analysis · Mathematics 2023-05-08 Shelby Lockhart , David J. Gardner , Carol S. Woodward , Stephen Thomas , Luke N. Olson

Potential theory for rational approximation is reviewed by means of examples computed with the AAA algorithm.

Numerical Analysis · Mathematics 2025-01-03 Lloyd N. Trefethen

This paper proposes a new framework for computing low-rank solutions to nonlinear matrix equations arising from spatial discretization of nonlinear partial differential equations: low-rank Anderson acceleration (lrAA). lrAA is an adaptation…

Numerical Analysis · Mathematics 2025-03-25 Daniel Appelo , Yingda Cheng

Affine projection algorithm (APA) is a well-known algorithm in adaptive filtering applications such as audio echo cancellation. APA relies on three parameters: $P$ (projection order), $\mu$ (step size) and $\delta$ (regularization…

Information Theory · Computer Science 2023-10-16 Shirin Jalali , Carl Nuzman , Yue Sun

We investigate the proximal point algorithm (PPA) and its inexact extensions under an error bound condition, which guarantees a global linear convergence if the proximal regularization parameter is larger than the error bound condition…

Optimization and Control · Mathematics 2021-02-26 Meng Lu , Zheng Qu

In this article a fast and parallelizable algorithm for rational approximation is presented. The method, called (P)QR-AAA, is a (parallel) set-valued variant of the AAA algorithm for scalar functions. It builds on the set-valued AAA…

Numerical Analysis · Mathematics 2024-12-04 Simon Dirckx , Karl Meerbergen , Daan Huybrechs

In this work, we propose an extensive numerical study on approximating the absolute value function. The methods presented in this paper compute approximants in the form of rational functions and have been proposed relatively recently, e.g.,…

Numerical Analysis · Mathematics 2020-05-07 Ion Victor Gosea , Athanasios C. Antoulas

This paper considers the robust phase retrieval, which can be cast as a nonsmooth and nonconvex composite optimization problem. We propose two first-order algorithms with adaptive step sizes: the subgradient algorithm (AdaSubGrad) and the…

Optimization and Control · Mathematics 2026-02-10 Zhong Zheng , Necdet Serhat Aybat , Shiqian Ma , Lingzhou Xue

When data is collected in an adaptive manner, even simple methods like ordinary least squares can exhibit non-normal asymptotic behavior. As an undesirable consequence, hypothesis tests and confidence intervals based on asymptotic normality…

Statistics Theory · Mathematics 2023-03-23 Koulik Khamaru , Yash Deshpande , Tor Lattimore , Lester Mackey , Martin J. Wainwright

Computing rational minimax approximations can be very challenging when there are singularities on or near the interval of approximation - precisely the case where rational functions outperform polynomials by a landslide. We show that far…

Numerical Analysis · Mathematics 2018-05-14 Silviu-Ioan Filip , Yuji Nakatsukasa , Lloyd N. Trefethen , Bernhard Beckermann

We consider a framework for the construction of iterative schemes for operator equations that combine low-rank approximation in tensor formats and adaptive approximation in a basis. Under fairly general assumptions, we obtain a rigorous…

Numerical Analysis · Mathematics 2014-03-17 Markus Bachmayr , Wolfgang Dahmen

Many modern computer vision and machine learning applications rely on solving difficult optimization problems that involve non-differentiable objective functions and constraints. The alternating direction method of multipliers (ADMM) is a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Zheng Xu , Mario A. T. Figueiredo , Xiaoming Yuan , Christoph Studer , Tom Goldstein

Adaptive regularized framework using cubics has emerged as an alternative to line-search and trust-region algorithms for smooth nonconvex optimization, with an optimal complexity amongst second-order methods. In this paper, we propose and…

Optimization and Control · Mathematics 2018-05-30 El houcine Bergou , Youssef Diouane , Serge Gratton