English
Related papers

Related papers: General-purpose preconditioning for regularized in…

200 papers

This article presents a method for solving large-scale linear inverse problems regular- ized with a nonlinear, edge-preserving penalty term such as the total variation or Perona-Malik. In the proposed scheme, the nonlinearity is handled…

Numerical Analysis · Mathematics 2013-09-02 Simon R. Arridge , Marta M. Betcke , Lauri Harhanen

In linear optimization, matrix structure can often be exploited algorithmically. However, beneficial presolving reductions sometimes destroy the special structure of a given problem. In this article, we discuss structure-aware…

Optimization and Control · Mathematics 2019-08-05 Ambros Gleixner , Nils-Christian Kempke , Thorsten Koch , Daniel Rehfeldt , Svenja Uslu

In various scientific and engineering applications, there is typically an approximate model of the underlying complex system, even though it contains both aleatoric and epistemic uncertainties. In this paper, we present a principled method…

Machine Learning · Computer Science 2023-12-15 Frank Liu , Agniva Chowdhury

We aim to solve the incompressible Navier-Stokes equations within the complex microstructure of a porous material. Discretizing the equations on a fine grid using a staggered (e.g., marker-and-cell, mixed FEM) scheme results in a nonlinear…

Numerical Analysis · Mathematics 2025-10-28 Kangan Li , Yashar Mehmani

In this paper we theoretically show that interior-point methods based on self-concordant barriers possess favorable global complexity beyond their standard application area of convex optimization. To do that we propose first- and…

Optimization and Control · Mathematics 2024-04-30 Pavel Dvurechensky , Mathias Staudigl

In this paper, we consider the solution of ill-conditioned systems of linear algebraic equations that can be determined imprecisely. To improve the stability of the solution process, we "immerse" the original imprecise linear system in an…

Numerical Analysis · Mathematics 2018-10-04 Sergey P. Shary

This paper introduces the Nystr\"om PCG algorithm for solving a symmetric positive-definite linear system. The algorithm applies the randomized Nystr\"om method to form a low-rank approximation of the matrix, which leads to an efficient…

Numerical Analysis · Mathematics 2021-12-20 Zachary Frangella , Joel A. Tropp , Madeleine Udell

We study the solution of large symmetric positive-definite linear systems in a matrix-free setting with a limited iteration budget. We focus on the preconditioned conjugate gradient (PCG) method with spectral preconditioning. Spectral…

Numerical Analysis · Mathematics 2026-04-01 Youssef Diouane , Selime Gürol , Oussama Mouhtal , Dominique Orban

We propose a general proximal algorithm for the inversion of ill-conditioned matrices. This algorithm is based on a variational characterization of pseudo-inverses. We show that a particular instance of it (with constant regularization…

Numerical Analysis · Mathematics 2009-04-07 Pierre Maréchal , Aude Rondepierre

We consider the solution of saddle-point systems with a tree-based block structure, introducing a parallelizable direct method for their solution. As our key contribution, we then propose several structure-exploiting preconditioners to be…

Numerical Analysis · Mathematics 2024-11-01 Christoph Hansknecht , Bernhard Heinzelreiter , John W. Pearson , Andreas Potschka

Incomplete LU factorizations of sparse matrices are widely used as preconditioners in Krylov subspace methods to speed up solving linear systems. Unfortunately, computing the preconditioner itself can be time-consuming and sensitive to…

Machine Learning · Computer Science 2024-12-12 Paul Häusner , Aleix Nieto Juscafresa , Jens Sjölund

Solving the normal equations corresponding to large sparse linear least-squares problems is an important and challenging problem. For very large problems, an iterative solver is needed and, in general, a preconditioner is required to…

Numerical Analysis · Mathematics 2022-01-04 Hussam Al Daas , Pierre Jolivet , Jennifer Scott

Gaussian Processes (GPs) are a popular approach to predict the output of a parameterized experiment. They have many applications in the field of Computer Experiments, in particular to perform sensitivity analysis, adaptive design of…

Optimization and Control · Mathematics 2017-05-08 Hossein Mohammadi , Rodolphe Le Riche , Nicolas Durrande , Eric Touboul , Xavier Bay

Developing suitable approximate models for analyzing and simulating complex nonlinear systems is practically important. This paper aims at exploring the skill of a rich class of nonlinear stochastic models, known as the conditional Gaussian…

Numerical Analysis · Mathematics 2022-06-01 Nan Chen , Yingda Li , Honghu Liu

We propose a general convex optimization problem for computing regularized geodesic distances. We show that under mild conditions on the regularizer the problem is well posed. We propose three different regularizers and provide analytical…

Graphics · Computer Science 2023-05-23 Michal Edelstein , Nestor Guillen , Justin Solomon , Mirela Ben-Chen

An abstract construction of coarse spaces for non-Hermitian problems and non-Hermitian domain decomposition preconditioners based on extended generalized eigenproblems was proposed in [Nataf and Parolin, arXiv:2404.02758] and analyzed on…

Numerical Analysis · Mathematics 2025-12-30 Emile Parolin , Frédéric Nataf

For some typical and widely used non-convex half-quadratic regularization models and the Ambrosio-Tortorelli approximate Mumford-Shah model, based on the Kurdyka-\L ojasiewicz analysis and the recent nonconvex proximal algorithms, we…

Optimization and Control · Mathematics 2021-07-30 Shengxiang Deng , Ismail Ben Ayed , Hongpeng Sun

We propose a two-level iterative scheme for solving general sparse linear systems. The proposed scheme consists of a sparse preconditioner that increases the skew-symmetric part and makes the main diagonal of the coefficient matrix as close…

Numerical Analysis · Mathematics 2020-09-16 Murat Manguoglu , Volker Mehrmann

We consider high-dimensional generalized linear models when the covariates are contaminated by measurement error. Estimates from errors-in-variables regression models are well-known to be biased in traditional low-dimensional settings if…

Computation · Statistics 2020-01-06 Michael Byrd , Monnie McGee

In polynomial optimization problems, nonnegativity constraints are typically handled using the sum of squares condition. This can be efficiently enforced using semidefinite programming formulations, or as more recently proposed by Papp and…

Optimization and Control · Mathematics 2022-06-14 Lea Kapelevich , Chris Coey , Juan Pablo Vielma