English
Related papers

Related papers: Anderson Acceleration for Reinforcement Learning

200 papers

The expectation-maximization (EM) algorithm is a well-known iterative method for computing maximum likelihood estimates from incomplete data. Despite its numerous advantages, a main drawback of the EM algorithm is its frequently observed…

Computation · Statistics 2018-08-14 Nicholas C. Henderson , Ravi Varadhan

The alternating direction multiplier method (ADMM) is widely used in computer graphics for solving optimization problems that can be nonsmooth and nonconvex. It converges quickly to an approximate solution, but can take a long time to…

Optimization and Control · Mathematics 2020-06-29 Wenqing Ouyang , Yue Peng , Yuxin Yao , Juyong Zhang , Bailin Deng

In this work, we propose a generalized alternating Anderson acceleration method, a periodic scheme composed of $t$ fixed-point iteration steps, interleaved with $s$ steps of Anderson acceleration with window size $m$, to solve linear and…

Numerical Analysis · Mathematics 2026-02-02 Yunhui He , Santolo Leveque

In this report, we present a versatile and efficient preconditioned Anderson acceleration (PAA) method for fixed-point iterations. The proposed framework offers flexibility in balancing convergence rates (linear, super-linear, or quadratic)…

Numerical Analysis · Mathematics 2023-10-09 Kewang Chen , Ye Ji , Matthias Möller , Cornelis Vuik

Anderson mixing (AM) is an acceleration method for fixed-point iterations. Despite its success and wide usage in scientific computing, the convergence theory of AM remains unclear, and its applications to machine learning problems are not…

Machine Learning · Computer Science 2021-10-05 Fuchao Wei , Chenglong Bao , Yang Liu

We provide rigorous theoretical bounds for Anderson acceleration (AA) that allow for approximate calculations when applied to solve linear problems. We show that, when the approximate calculations satisfy the provided error bounds, the…

Numerical Analysis · Mathematics 2024-04-30 Massimiliano Lupo Pasini , M. Paul Laiu

We consider the application of the type-I Anderson acceleration to solving general non-smooth fixed-point problems. By interleaving with safe-guarding steps, and employing a Powell-type regularization and a re-start checking for strong…

Optimization and Control · Mathematics 2018-08-14 Junzi Zhang , Brendan O'Donoghue , Stephen Boyd

Acceleration of first order methods is mainly obtained via inertial techniques \`a la Nesterov, or via nonlinear extrapolation. The latter has known a recent surge of interest, with successful applications to gradient and proximal gradient…

Machine Learning · Statistics 2021-10-29 Quentin Bertrand , Mathurin Massias

Anderson mixing (AM) is a classical method that can accelerate fixed-point iterations by exploring historical information. Despite the successful application of AM in scientific computing, the theoretical properties of AM are still under…

Numerical Analysis · Mathematics 2023-07-06 Fuchao Wei , Chenglong Bao , Yang Liu , Guangwen Yang

Iterative methods are ubiquitous in large-scale scientific computing applications, and a number of approaches based on meta-learning have been recently proposed to accelerate them. However, a systematic study of these approaches and how…

Numerical Analysis · Mathematics 2023-01-31 Sohei Arisaka , Qianxiao Li

The state-of-art seismic imaging techniques treat inversion tasks such as FWI and LSRTM as PDE-constrained optimization problems. Due to the large-scale nature, gradient-based optimization algorithms are preferred in practice to update the…

Numerical Analysis · Mathematics 2020-11-16 Yunan Yang

Anderson Acceleration (AA) is a popular algorithm designed to enhance the convergence of fixed-point iterations. In this paper, we introduce a variant of AA based on a Truncated Gram-Schmidt process (AATGS) which has a few advantages over…

Numerical Analysis · Mathematics 2024-07-17 Ziyuan Tang , Tianshi Xu , Huan He , Yousef Saad , Yuanzhe Xi

Iterative Closest Point (ICP) is a widely used method for performing scan-matching and registration. Being simple and robust method, it is still computationally expensive and may be challenging to use in real-time applications with limited…

Robotics · Computer Science 2017-09-19 A. L. Pavlov , G. V. Ovchinnikov , D. Yu. Derbyshev , D. Tsetserukou , I. V. Oseledets

A pervasive approach in scientific computing is to express the solution to a given problem as the limit of a sequence of vectors or other mathematical objects. In many situations these sequences are generated by slowly converging iterative…

Numerical Analysis · Mathematics 2025-07-17 Yousef Saad

Anderson acceleration (AA) is widely used for accelerating the convergence of an underlying fixed-point iteration $\bm{x}_{k+1} = \bm{q}( \bm{x}_{k} )$, $k = 0, 1, \ldots$, with $\bm{x}_k \in \mathbb{R}^n$, $\bm{q} \colon \mathbb{R}^n \to…

Numerical Analysis · Mathematics 2025-05-14 Oliver A. Krzysik , Hans De Sterck , Adam Smith

Multilinear systems play an important role in scientific calculations of practical problems. In this paper, we consider a tensor splitting method with a relaxed Anderson acceleration for solving multilinear systems. The new method preserves…

Numerical Analysis · Mathematics 2024-10-18 Dongdong Liu Ting Hua nd Xifu Liu

Anderson acceleration (AA) has a long history of use and a strong recent interest due to its potential ability to dramatically improve the linear convergence of the fixed-point iteration. Most authors are simply using and analyzing the…

Numerical Analysis · Mathematics 2022-02-14 Kewang Chen , Cornelis Vuik

We give a complete characterization of the behavior of the Anderson acceleration (with arbitrary nonzero mixing parameters) on linear problems. Let n be the grade of the residual at the starting point with respect to the matrix defining the…

Numerical Analysis · Mathematics 2011-02-07 Florian Potra , Hans Engler

In this paper, we propose a novel Anderson's acceleration method to solve nonlinear equations, which does \emph{not} require a restart strategy to achieve numerical stability. We propose the greedy and random versions of our algorithm.…

Optimization and Control · Mathematics 2024-03-26 Haishan Ye , Dachao Lin , Xiangyu Chang , Zhihua Zhang

This paper investigates the use of fixed-point Anderson acceleration method (AA) to a recently proposed hierarchical control framework. Due to its model-free property, the AA-based resulting hierarchical framework becomes more generic since…

Systems and Control · Electrical Eng. & Systems 2021-12-09 Xuan-Huy Pham , Mazen Alamir , François Bonne , Patrick Bonnay