English
Related papers

Related papers: Acceleration of nonlinear solvers for natural conv…

200 papers

In this paper, we study the robust linearization of nonlinear poromechanics of unsaturated materials. The model of interest couples the Richards equation with linear elasticity equations, employing the equivalent pore pressure. In practice…

Numerical Analysis · Mathematics 2021-05-24 Jakub Wiktor Both , Kundan Kumar , Jan Martin Nordbotten , Florin Adrian Radu

Many computer graphics problems require computing geometric shapes subject to certain constraints. This often results in non-linear and non-convex optimization problems with globally coupled variables, which pose great challenge for…

Graphics · Computer Science 2018-05-16 Yue Peng , Bailin Deng , Juyong Zhang , Fanyu Geng , Wenjie Qin , Ligang Liu

We give a complete characterization of the behavior of the Anderson acceleration (with arbitrary nonzero mixing parameters) on linear problems. Let n be the grade of the residual at the starting point with respect to the matrix defining the…

Numerical Analysis · Mathematics 2011-02-07 Florian Potra , Hans Engler

This work investigates the local convergence behavior of Anderson acceleration in solving nonlinear systems. We establish local R-linear convergence results for Anderson acceleration with general depth $m$ under the assumptions that the…

Numerical Analysis · Mathematics 2025-07-22 Yonghui Ling , Zikang Xiong , Juan Liang

Multilinear systems play an important role in scientific calculations of practical problems. In this paper, we consider a tensor splitting method with a relaxed Anderson acceleration for solving multilinear systems. The new method preserves…

Numerical Analysis · Mathematics 2024-10-18 Dongdong Liu Ting Hua nd Xifu Liu

Anderson acceleration (AA) is a technique for accelerating the convergence of fixed-point iterations. In this paper, we apply AA to a sequence of functions and modify the norm in its internal optimization problem to the $\mathcal{H}^{-s}$…

Numerical Analysis · Mathematics 2021-09-14 Yunan Yang , Alex Townsend , Daniel Appelö

Anderson acceleration (AA) as an efficient technique for speeding up the convergence of fixed-point iterations may be designed for accelerating an optimization method. We propose a novel optimization algorithm by adapting Anderson…

Optimization and Control · Mathematics 2022-11-17 Hailiang Liu , Jia-Hao He , Xuping Tian

In this paper, we consider the Anderson acceleration method for solving the contractive fixed point problem, which is nonsmooth in general. We define a class of smoothing functions for the original nonsmooth fixed point mapping, which can…

Optimization and Control · Mathematics 2024-12-11 Zekai Li , Wei Bian

Nonlinearity continuation method, applied to boundary value problems for steady-state Richards equation, gradually approaches the solution through a series of intermediate problems. Originally, the Newton method with simple line search…

Numerical Analysis · Mathematics 2021-05-27 Denis Anuprienko

The alternating direction multiplier method (ADMM) is widely used in computer graphics for solving optimization problems that can be nonsmooth and nonconvex. It converges quickly to an approximate solution, but can take a long time to…

Optimization and Control · Mathematics 2020-06-29 Wenqing Ouyang , Yue Peng , Yuxin Yao , Juyong Zhang , Bailin Deng

Anderson acceleration (AA) is an extrapolation technique designed to speed-up fixed-point iterations like those arising from the iterative training of DL models. Training DL models requires large datasets processed in randomly sampled…

Machine Learning · Computer Science 2021-10-29 Massimiliano Lupo Pasini , Junqi Yin , Viktor Reshniak , Miroslav Stoyanov

Anderson Acceleration is a well-established method that allows to speed up or encourage convergence of fixed-point iterations. It has been successfully used in a variety of applications, in particular within the Self-Consistent Field (SCF)…

Numerical Analysis · Mathematics 2024-10-08 Ning Wan , Agnieszka Międlar

The Uzawa algorithm is an iterative method for the solution of saddle-point problems, which arise in many applications, including fluid dynamics. Viewing the Uzawa algorithm as a fixed- point iteration, we explore the use of Anderson…

Numerical Analysis · Mathematics 2016-05-24 Nguyenho Ho , Sarah D. Olson , Homer F. Walker

The convergence of Boltzmann Fokker Planck solution can become arbitrarily slow with iterative procedures like source iteration. This paper derives and investigates a nonlinear diffusion acceleration scheme for the solution of the Boltzmann…

Numerical Analysis · Mathematics 2023-12-06 Japan K. Patel , Barry D. Ganapol , Martha M. Matuszak

When used to accelerate the convergence of fixed-point iterative methods, such as the Picard method, which is a kind of nonlinear fixed-point iteration, polynomial extrapolation techniques can be very effective. The numerical solution of…

Numerical Analysis · Mathematics 2025-01-07 Abdellatif Mouhssine , Ahmed Ratnani , Hassane Sadok

We study a Boussinesq system in a bounded domain with an outlet boundary portion where fluid can leave or re-enter. On this boundary part, we consider a do-nothing condition for the fluid flow, and a new artificial condition for the heat…

Analysis of PDEs · Mathematics 2020-05-25 Rafael Arndt , Andrea N. Ceretani , Carlos N. Rautenberg

We describe a convergence acceleration technique for unconstrained optimization problems. Our scheme computes estimates of the optimum from a nonlinear average of the iterates produced by any optimization method. The weights in this average…

Optimization and Control · Mathematics 2019-04-16 Damien Scieur , Alexandre d'Aspremont , Francis Bach

This short note provides explicit solutions to the linearized Boussinesq equations around the stably stratified Couette flow posed on $\mathbb{T}\times\mathbb{R}$. We consider the long-time behavior of such solutions and prove inviscid…

Analysis of PDEs · Mathematics 2023-09-20 Michele Coti Zelati , Marc Nualart

The alternating direction method of multipliers (ADMM) is a popular approach for solving optimization problems that are potentially non-smooth and with hard constraints. It has been applied to various computer graphics applications,…

Graphics · Computer Science 2019-09-04 Juyong Zhang , Yue Peng , Wenqing Ouyang , Bailin Deng

Iteratively reweighted L1 (IRL1) algorithm is a common algorithm for solving sparse optimization problems with nonconvex and nonsmooth regularization. The development of its acceleration algorithm, often employing Nesterov acceleration, has…

Optimization and Control · Mathematics 2024-03-13 Kexin Li