English
Related papers

Related papers: Sharpened PCG Iteration Bound for High-Contrast He…

200 papers

In this paper we study convergence estimates for a multigrid algorithm with smoothers of successive subspace correction (SSC) type, applied to symmetric elliptic PDEs. First, we revisit a general convergence analysis on a class of multigrid…

Numerical Analysis · Mathematics 2018-05-09 Eugenio Aulisa , Giorgio Bornia , Sara Calandrini , Giacomo Capodaglio

In this paper we study the performance of the Projected Gradient Descent(PGD) algorithm for $\ell_{p}$-constrained least squares problems that arise in the framework of Compressed Sensing. Relying on the Restricted Isometry Property, we…

Numerical Analysis · Mathematics 2013-03-05 Sohail Bahmani , Bhiksha Raj

The efficient solution of large-scale multiterm linear matrix equations is a challenging task in numerical linear algebra, and it is a largely open problem. We propose a new iterative scheme for symmetric and positive definite operators,…

Numerical Analysis · Mathematics 2025-05-27 Davide Palitta , Martina Iannacito , Valeria Simoncini

We propose a preconditioner to accelerate the convergence of the GMRES iterative method for solving the system of linear equations obtained from discretize-then-optimize approach applied to optimal control problems constrained by a partial…

Numerical Analysis · Mathematics 2019-11-15 Hamid Mirchi , Davod Khojasteh Salkuyeh

It is common practice to apply gradient-based optimization algorithms to numerically solve large-scale ODE constrained optimal control problems. Gradients of the objective function are most efficiently computed by approximate adjoint…

Optimization and Control · Mathematics 2024-07-03 Jens Lang , Bernhard A. Schmitt

This paper presents a posteriori error estimates for conforming numerical approximations of eigenvalue clusters of second-order self-adjoint elliptic linear operators with compact resolvent. Given a cluster of eigenvalues, we estimate the…

Numerical Analysis · Mathematics 2020-08-11 Eric Cancès , Geneviève Dusson , Yvon Maday , Benjamin Stamm , Martin Vohralík

We present a deep learning-based iterative approach to solve the discrete heterogeneous Helmholtz equation for high wavenumbers. Combining classical iterative multigrid solvers and convolutional neural networks (CNNs) via preconditioning,…

Machine Learning · Computer Science 2024-06-07 Bar Lerer , Ido Ben-Yair , Eran Treister

We propose a gradient-based method for quadratic programming problems with a single linear constraint and bounds on the variables. Inspired by the GPCG algorithm for bound-constrained convex quadratic programming [J.J. Mor\'e and G.…

Optimization and Control · Mathematics 2019-02-19 Daniela di Serafino , Gerardo Toraldo , Marco Viola , Jesse Barlow

The conic bundle implementation of the spectral bundle method for large scale semidefinite programming solves in each iteration a semidefinite quadratic subproblem by an interior point approach. For larger cutting model sizes the limiting…

Optimization and Control · Mathematics 2023-08-25 Christoph Helmberg

Gaussian process hyperparameter optimization requires linear solves with, and log-determinants of, large kernel matrices. Iterative numerical techniques are becoming popular to scale to larger datasets, relying on the conjugate gradient…

Machine Learning · Computer Science 2022-06-22 Jonathan Wenger , Geoff Pleiss , Philipp Hennig , John P. Cunningham , Jacob R. Gardner

We introduce a perturbed preconditioned gradient descent (PPGD) method for the unconstrained minimization of a strongly convex objective $G$ with a locally Lipschitz continuous gradient. We assume that $G(v)=E(v)+F(v)$ and that the gradient…

Optimization and Control · Mathematics 2025-12-23 Jea-Hyun Park , Abner J. Salgado , Steven M. Wise

Solving sparse linear systems from discretized PDEs is challenging. Direct solvers have in many cases quadratic complexity (depending on geometry), while iterative solvers require problem dependent preconditioners to be robust and…

Numerical Analysis · Mathematics 2017-03-14 Kai Yang , Hadi Pouransari , Eric Darve

Linear differential equations and recurrences reveal many properties about their solutions. Therefore, these equations are well-suited for representing solutions and computing with special functions. We identify a large class of existing…

Symbolic Computation · Computer Science 2026-01-14 Louis Gaillard

This paper considers the multi-agent distributed linear least-squares problem. The system comprises multiple agents, each agent with a locally observed set of data points, and a common server with whom the agents can interact. The agents'…

Optimization and Control · Mathematics 2020-12-01 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

A novel and highly efficient computational framework for reconstructing binary-type images suitable for models of various complexity seen in diverse biomedical applications is developed and validated. Efficiency in computational speed and…

Optimization and Control · Mathematics 2024-02-09 Paul R. Arbic , Vladislav Bukshtynov

We present a robust and scalable preconditioner for the solution of large-scale linear systems that arise from the discretization of elliptic PDEs amenable to rank compression. The preconditioner is based on hierarchical low-rank…

Numerical Analysis · Mathematics 2017-12-27 Gustavo Chávez , George Turkiyyah , Stefano Zampini , David Keyes

This paper presents an efficient high-order sharp-interface method for solving the three-dimensional (3D) Poisson equation with Dirichlet boundary conditions on a nonuniform Cartesian grid with irregular domain boundaries. The new approach…

Computational Physics · Physics 2024-12-20 Shirzad Hosseinverdi , Hermann F. Fasel

In this study, we propose the lopsided HSS (LHSS) iteration method for solving a class of complex symmetric indefinite systems of linear equations. This method employs an alternating iterative scheme, where each iteration entails solving…

Numerical Analysis · Mathematics 2025-11-27 Yusong Zhang , Zeng-Qi Wang

We study a general class of bilevel problems, consisting in the minimization of an upper-level objective which depends on the solution to a parametric fixed-point equation. Important instances arising in machine learning include…

Machine Learning · Statistics 2020-07-13 Riccardo Grazzi , Luca Franceschi , Massimiliano Pontil , Saverio Salzo

Elliptic partial differential equations (PDEs) frequently arise in continuum descriptions of physical processes relevant to science and engineering. Multilevel preconditioners represent a family of scalable techniques for solving discrete…

Mathematical Software · Computer Science 2016-04-26 Dave A. May , Patrick Sanan , Karl Rupp , Matthew G. Knepley , Barry F. Smith