English
Related papers

Related papers: Polynomial Preconditioners for Regularized Linear …

200 papers

Bernstein polynomials, long a staple of approximation theory and computational geometry, have also increasingly become of interest in finite element methods. Many fundamental problems in interpolation and approximation give rise to…

Numerical Analysis · Mathematics 2019-07-15 Larray Allen , Robert C. Kirby

Kernel methods are a popular class of nonlinear predictive models in machine learning. Scalable algorithms for learning kernel models need to be iterative in nature, but convergence can be slow due to poor conditioning. Spectral…

Machine Learning · Statistics 2024-01-26 Amirhesam Abedsoltan , Parthe Pandit , Luis Rademacher , Mikhail Belkin

Despite hundreds of papers on preconditioned linear systems of equations, there remains a significant lack of comprehensive performance benchmarks comparing various preconditioners for solving symmetric positive definite (SPD) systems. In…

Numerical Analysis · Mathematics 2025-05-28 Marc A. Tunnell , David F. Gleich

We propose a new approach to solving bilevel optimization problems, intermediate between solving full-system optimality conditions with a Newton-type approach, and treating the inner problem as an implicit function. The overall idea is to…

Optimization and Control · Mathematics 2024-05-08 Ensio Suonperä , Tuomo Valkonen

In recent years, deep learning techniques have shown great success in various tasks related to inverse problems, where a target quantity of interest can only be observed through indirect measurements by a forward operator. Common approaches…

Numerical Analysis · Mathematics 2024-03-18 Matthias Beckmann , Nick Heilenkötter

In this paper, we focus on solving a sequence of linear systems with an identical (or similar) coefficient matrix. For this type of problems, we investigate the subspace correction and deflation methods, which use an auxiliary matrix…

Numerical Analysis · Mathematics 2022-03-17 Takeshi Iwashita , Kota Ikehara , Takeshi Fukaya , Takeshi Mifune

This paper presents an iterative method suitable for inverting semilinear problems which are important kernels in many numerical applications. The primary idea is to employ a parametrization that is able to reduce semilinear problems into…

Numerical Analysis · Mathematics 2019-08-02 Prosper Torsu

Model-based optimization methods and discriminative learning methods have been the two dominant strategies for solving various inverse problems in low-level vision. Typically, those two kinds of methods have their respective merits and…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Kai Zhang , Wangmeng Zuo , Shuhang Gu , Lei Zhang

We introduce a neural-preconditioned iterative solver for Poisson equations with mixed boundary conditions. Typical Poisson discretizations yield large, ill-conditioned linear systems. Iterative solvers can be effective for these problems,…

Numerical Analysis · Mathematics 2025-12-16 Kai Weixian Lan , Elias Gueidon , Ayano Kaneda , Julian Panetta , Joseph Teran

Solving the indefinite Helmholtz equation is not only crucial for the understanding of many physical phenomena but also represents an outstandingly-difficult benchmark problem for the successful application of numerical methods. Here we…

Numerical Analysis · Mathematics 2022-04-29 Jonas Schmitt , Harald Köstler

We establish a new iterative method for solving a class of large and sparse linear systems of equations with three-by-three block coefficient matrices having saddle point structure. Convergence properties of the proposed method are studied…

Numerical Analysis · Mathematics 2021-09-13 Hamed Aslani , Davod Khojasteh Salkuyeh , Fatemeh Panjeh Ali Beik

We propose an extended primal-dual algorithm framework for solving a general nonconvex optimization model. This work is motivated by image reconstruction problems in a class of nonlinear imaging, where the forward operator can be formulated…

Optimization and Control · Mathematics 2024-08-28 Yu Gao , Xiaochuan Pan , Chong Chen

Learning-based methods have demonstrated remarkable performance in solving inverse problems, particularly in image reconstruction tasks. Despite their success, these approaches often lack theoretical guarantees, which are crucial in…

Numerical Analysis · Mathematics 2025-10-21 Clemens Arndt , Judith Nickel

The numerical solution of partial differential equations on high-dimensional domains gives rise to computationally challenging linear systems. When using standard discretization techniques, the size of the linear system grows exponentially…

Numerical Analysis · Mathematics 2015-08-13 Daniel Kressner , Michael Steinlechner , Bart Vandereycken

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function,…

Optimization and Control · Mathematics 2021-06-08 Yong Sheng Soh , Venkat Chandrasekaran

This study investigates the iterative refinement method applied to the solution of linear discrete inverse problems by considering its application to the Tikhonov problem in mixed precision. Previous works on mixed precision iterative…

Numerical Analysis · Mathematics 2025-10-22 James G. Nagy , Lucas Onisk

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

Several recent works have developed a new, probabilistic interpretation for numerical algorithms solving linear systems in which the solution is inferred in a Bayesian framework, either directly or by inferring the unknown action of the…

Computation · Statistics 2018-10-18 Simon Bartels , Jon Cockayne , Ilse C. F. Ipsen , Philipp Hennig

Many challenging image processing tasks can be described by an ill-posed linear inverse problem: deblurring, deconvolution, inpainting, compressed sensing, and superresolution all lie in this framework. Traditional inverse problem solvers…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Davis Gilton , Greg Ongie , Rebecca Willett

Sparse linear system solvers are computationally expensive kernels that lie at the heart of numerous applications. This paper proposes a flexible preconditioning framework to substantially reduce the time and energy requirements of this…

Emerging Technologies · Computer Science 2021-07-16 Vasileios Kalantzis , Anshul Gupta , Lior Horesh , Tomasz Nowicki , Mark S. Squillante , Chai Wah Wu