English
Related papers

Related papers: Shanks and Anderson-type acceleration techniques f…

200 papers

We present abstract acceleration techniques for computing loop invariants for numerical programs with linear assignments and conditionals. Whereas abstract interpretation techniques typically over-approximate the set of reachable states…

Programming Languages · Computer Science 2014-01-07 Bertrand Jeannet , Peter Schrammel , Sriram Sankaranarayanan

We study acceleration and preconditioning strategies for a class of Douglas-Rachford methods aiming at the solution of convex-concave saddle-point problems associated with Fenchel-Rockafellar duality. While the basic iteration converges…

Optimization and Control · Mathematics 2016-04-22 Kristian Bredies , Hongpeng Sun

This article develops a general framework for continuous deterministic data assimilation for semilinear parabolic equations by means of evolution equations. Introducing a nudged model driven by partial observations, the global…

Analysis of PDEs · Mathematics 2026-02-25 Gianmarco Del Sarto , Matthias Hieber , Filippo Palma , Tarek Zöchling

An adaptive regularization strategy for stabilizing Newton-like iterations on a coarse mesh is developed in the context of adaptive finite element methods for nonlinear PDE. Existence, uniqueness and approximation properties are known for…

Numerical Analysis · Mathematics 2015-01-27 Sara Pollock

Following the first part of our project, this paper comprehensively studies two types of extragradient-based methods: anchored extragradient and Nesterov's accelerated extragradient for solving [non]linear inclusions (and, in particular,…

Optimization and Control · Mathematics 2025-03-11 Quoc Tran-Dinh , Nghia Nguyen-Trung

This work is concerned with the computation of $\ell^p$-eigenvalues and eigenvectors of square tensors with $d$ modes. In the first part we propose two possible shifted variants of the popular (higher-order) power method %for the…

Numerical Analysis · Mathematics 2019-12-05 Stefano Cipolla , Michela Redivo-Zaglia , Francesco Tudisco

In [19], a general, inexact, efficient proximal quasi-Newton algorithm for composite optimization problems has been proposed and a sublinear global convergence rate has been established. In this paper, we analyze the convergence properties…

Numerical Analysis · Computer Science 2017-10-18 Hiva Ghanbari , Katya Scheinberg

This paper introduces an extended tensor decomposition (XTD) method for model reduction. The proposed method is based on a sparse non-separated enrichment to the conventional tensor decomposition, which is expected to improve the…

Numerical Analysis · Mathematics 2023-11-07 Ye Lu , Satyajit Mojumder , Jiachen Guo , Yangfan Li , Wing Kam Liu

We develop new adaptive algorithms for temporal integration of nonlinear evolution equations on tensor manifolds. These algorithms, which we call step-truncation methods, are based on performing one time step with a conventional…

Numerical Analysis · Mathematics 2022-03-09 Abram Rodgers , Alec Dektor , Daniele Venturi

This article introduces new acceleration methods for fixed-point iterations. Extrapolations are computed using two or three mappings alternately and a new type of step length is proposed with good properties for nonlinear applications. The…

Optimization and Control · Mathematics 2021-08-17 Nicolas Lepage-Saucier

The branching methods developed are effective methods to solve some semi linear PDEs and are shown numerically to be able to solve some full non linear PDEs. These methods are however restricted to some small coefficients in the PDE and…

Probability · Mathematics 2017-01-27 Xavier Warin

In this paper we develop an adaptive procedure for the numerical solution of general, semilinear elliptic problems with possible singular perturbations. Our approach combines both a prediction-type adaptive Newton method and an adaptive…

Numerical Analysis · Mathematics 2014-08-27 Mario Amrein , Thomas P. Wihler

In this paper, we propose new methods to efficiently solve convex optimization problems encountered in sparse estimation, which include a new quasi-Newton method that avoids computing the Hessian matrix and improves efficiency, and we prove…

Optimization and Control · Mathematics 2023-09-06 Ryosuke Shimmura , Joe Suzuki

Convex-nonconvex (CNC) regularization is a novel paradigm that employs a nonconvex penalty function while maintaining the convexity of the entire objective function. It has been successfully applied to problems in signal processing,…

Optimization and Control · Mathematics 2025-02-21 Qiang Heng , Xiaoqian Liu , Eric C. Chi

Nonlinear acceleration methods are powerful techniques to speed up fixed-point iterations. However, many acceleration methods require storing a large number of previous iterates and this can become impractical if computational resources are…

Machine Learning · Computer Science 2022-10-25 Huan He , Shifan Zhao , Ziyuan Tang , Joyce C Ho , Yousef Saad , Yuanzhe Xi

This paper proposes a new framework for computing low-rank solutions to nonlinear matrix equations arising from spatial discretization of nonlinear partial differential equations: low-rank Anderson acceleration (lrAA). lrAA is an adaptation…

Numerical Analysis · Mathematics 2025-03-25 Daniel Appelo , Yingda Cheng

Some of recent developments, including recent results, ideas, techniques, and approaches, in the study of degenerate partial differential equations are surveyed and analyzed. Several examples of nonlinear degenerate, even mixed, partial…

Analysis of PDEs · Mathematics 2015-03-17 Gui-Qiang G. Chen

In this work, we study the application the classical Richardson extrapolation (RE) technique to accelerate the convergence of sequences resulting from linear multistep methods (LMMs) for solving initial-value problems of systems of ordinary…

Numerical Analysis · Mathematics 2022-06-22 Imre Fekete , Lajos Lóczi

Optimization plays a key role in machine learning. Recently, stochastic second-order methods have attracted much attention due to their low computational cost in each iteration. However, these algorithms might perform poorly especially if…

Machine Learning · Computer Science 2017-10-25 Haishan Ye , Zhihua Zhang

Spingarn's method of partial inverses and the progressive decoupling algorithm address inclusion problems involving the sum of an operator and the normal cone of a linear subspace, known as linkage problems. Despite their success, existing…

Optimization and Control · Mathematics 2025-04-02 Brecht Evens , Puya Latafat , Panagiotis Patrinos