English
Related papers

Related papers: Damped Anderson Mixing for Deep Reinforcement Lear…

200 papers

Model-free deep reinforcement learning (RL) algorithms have been widely used for a range of complex control tasks. However, slow convergence and sample inefficiency remain challenging problems in RL, especially when handling continuous and…

Machine Learning · Computer Science 2021-12-07 Wenjie Shi , Shiji Song , Hui Wu , Ya-Chu Hsu , Cheng Wu , Gao Huang

Anderson mixing (AM) is an acceleration method for fixed-point iterations. Despite its success and wide usage in scientific computing, the convergence theory of AM remains unclear, and its applications to machine learning problems are not…

Machine Learning · Computer Science 2021-10-05 Fuchao Wei , Chenglong Bao , Yang Liu

Anderson acceleration is an old and simple method for accelerating the computation of a fixed point. However, as far as we know and quite surprisingly, it has never been applied to dynamic programming or reinforcement learning. In this…

Machine Learning · Computer Science 2018-09-26 Matthieu Geist , Bruno Scherrer

Anderson acceleration is a well-established and simple technique for speeding up fixed-point computations with countless applications. Previous studies of Anderson acceleration in optimization have only been able to provide convergence…

Optimization and Control · Mathematics 2020-06-16 Vien V. Mai , Mikael Johansson

Two adaptive relaxation strategies are proposed for Anderson acceleration. They are specifically designed for applications in which mappings converge to a fixed point. Their superiority over alternative Anderson acceleration is demonstrated…

Numerical Analysis · Mathematics 2024-09-02 Nicolas Lepage-Saucier

The expectation-maximization (EM) algorithm is a well-known iterative method for computing maximum likelihood estimates from incomplete data. Despite its numerous advantages, a main drawback of the EM algorithm is its frequently observed…

Computation · Statistics 2018-08-14 Nicholas C. Henderson , Ravi Varadhan

Anderson acceleration (AA) as an efficient technique for speeding up the convergence of fixed-point iterations may be designed for accelerating an optimization method. We propose a novel optimization algorithm by adapting Anderson…

Optimization and Control · Mathematics 2022-11-17 Hailiang Liu , Jia-Hao He , Xuping Tian

Anderson acceleration is an effective technique for enhancing the efficiency of fixed-point iterations; however, analyzing its convergence in nonsmooth settings presents significant challenges. In this paper, we investigate a class of…

Optimization and Control · Mathematics 2024-10-16 Kexin Li , Luwei Bai , Xiao Wang , Hao Wang

Anderson acceleration (AA) is an extrapolation technique designed to speed-up fixed-point iterations like those arising from the iterative training of DL models. Training DL models requires large datasets processed in randomly sampled…

Machine Learning · Computer Science 2021-10-29 Massimiliano Lupo Pasini , Junqi Yin , Viktor Reshniak , Miroslav Stoyanov

Anderson mixing (AM) is a classical method that can accelerate fixed-point iterations by exploring historical information. Despite the successful application of AM in scientific computing, the theoretical properties of AM are still under…

Numerical Analysis · Mathematics 2023-07-06 Fuchao Wei , Chenglong Bao , Yang Liu , Guangwen Yang

The purpose of this paper is to study the influence of relaxation and acceleration techniques on the convergence behavior of the non-overlapping Schwarz algorithm with alternating Dirichlet-Neumann transmission conditions in the context of…

Numerical Analysis · Mathematics 2026-03-19 Giulia Sambataro , Irina Tezaur

Many computer graphics problems require computing geometric shapes subject to certain constraints. This often results in non-linear and non-convex optimization problems with globally coupled variables, which pose great challenge for…

Graphics · Computer Science 2018-05-16 Yue Peng , Bailin Deng , Juyong Zhang , Fanyu Geng , Wenjie Qin , Ligang Liu

The Anderson Mixing (AM) method is a popular approach for accelerating fixed-point iterations by leveraging historical information from previous steps. In this paper, we introduce the Riemannian Anderson Mixing (RAM) method, an extension of…

Optimization and Control · Mathematics 2023-09-13 Zanyu Li , Chenglong Bao

Anderson acceleration (or Anderson mixing) is an efficient acceleration method for fixed point iterations $x_{t+1}=G(x_t)$, e.g., gradient descent can be viewed as iteratively applying the operation $G(x) \triangleq x-\alpha\nabla f(x)$. It…

Optimization and Control · Mathematics 2020-03-03 Zhize Li , Jian Li

This paper provides the first proof that Anderson acceleration (AA) improves the convergence rate of general fixed point iterations. AA has been used for decades to speed up nonlinear solvers in many applications, however a rigorous…

Numerical Analysis · Mathematics 2019-02-22 Claire Evans , Sara Pollock , Leo G. Rebholz , Mengying Xiao

Anderson Acceleration is a well-established method that allows to speed up or encourage convergence of fixed-point iterations. It has been successfully used in a variety of applications, in particular within the Self-Consistent Field (SCF)…

Numerical Analysis · Mathematics 2024-10-08 Ning Wan , Agnieszka Międlar

This work proposes a general strategy for solving possibly nonlinear problems arising from implicit time discretizations as a sequence of explicit solutions. The resulting sequence may exhibit instabilities similar to those of the base…

Numerical Analysis · Mathematics 2025-10-21 Nicolas A. Barnafi , Felipe Galarce , Pablo Brubeck

Despite their frequent slow convergence, proximal gradient schemes are widely used in large-scale optimization tasks due to their tremendous stability, scalability, and ease of computation. In this paper, we develop and investigate a…

Computation · Statistics 2025-08-19 Nicholas C. Henderson , Ravi Varadhan

In this paper, we study the robust linearization of nonlinear poromechanics of unsaturated materials. The model of interest couples the Richards equation with linear elasticity equations, employing the equivalent pore pressure. In practice…

Numerical Analysis · Mathematics 2021-05-24 Jakub Wiktor Both , Kundan Kumar , Jan Martin Nordbotten , Florin Adrian Radu

Iteratively reweighted L1 (IRL1) algorithm is a common algorithm for solving sparse optimization problems with nonconvex and nonsmooth regularization. The development of its acceleration algorithm, often employing Nesterov acceleration, has…

Optimization and Control · Mathematics 2024-03-13 Kexin Li
‹ Prev 1 2 3 10 Next ›