English
Related papers

Related papers: Learning Preconditioner for Conjugate Gradient PDE…

200 papers

Polynomial preconditioning is an important tool in solving large linear systems and eigenvalue problems. A polynomial from GMRES can be used to precondition restarted GMRES and restarted Arnoldi. Here we give methods for indefinite matrices…

Numerical Analysis · Mathematics 2025-10-17 Hayden Henson , Ronald B. Morgan

PDE-constrained optimization aims at finding optimal setups for partial differential equations so that relevant quantities are minimized. Including sparsity promoting terms in the formulation of such problems results in more practically…

Numerical Analysis · Mathematics 2016-11-23 Margherita Porcelli , Valeria Simoncini , Martin Stoll

Contingency analysis (CA) plays a critical role to guarantee operation security in the modern power systems. With the high penetration of renewable energy, a real-time and comprehensive N-1 CA is needed as a power system analysis tool to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-12 Yiting Zhao , Chen Yuan , Guangyi Liu , Ilya Grinberg

Accuracy in neural PDE solvers often breaks down not because of limited expressivity, but due to poor optimisation caused by ill-conditioning, especially in multi-fidelity and stiff problems. We study this issue in Physics-Informed Extreme…

Machine Learning · Computer Science 2025-08-11 Siddharth Rout

We apply preconditioning, which is widely used in classical solvers for linear systems $A\textbf{x}=\textbf{b}$, to the variational quantum linear solver. By utilizing incomplete LU factorization as a preconditioner for linear equations…

We propose a novel preconditioned inexact primal-dual interior point method for constrained convex quadratic programming problems. The algorithm we describe invokes the preconditioned conjugate gradient method on a new reduced Schur…

Numerical Analysis · Mathematics 2021-12-28 Samah Karim , Edgar Solomonik

Pretraining for partial differential equation (PDE) modeling has recently shown promise in scaling neural operators across datasets to improve generalizability and performance. Despite these advances, our understanding of how pretraining…

Machine Learning · Computer Science 2024-10-03 Anthony Zhou , Cooper Lorsung , AmirPouya Hemmasian , Amir Barati Farimani

We present a scalable approach to solve a class of elliptic partial differential equation (PDE)-constrained optimization problems with bound constraints. This approach utilizes a robust full-space interior-point (IP)-Gauss-Newton…

Optimization and Control · Mathematics 2024-10-22 Tucker Hartland , Cosmin G. Petra , Noemi Petra , Jingyi Wang

An estimation of the sky signal from streams of Time Ordered Data (TOD) acquired by Cosmic Microwave Background (\cmb) experiments is one of the most important steps in the context of \cmb data analysis referred to as the map-making…

Cosmology and Nongalactic Astrophysics · Physics 2018-10-17 Giuseppe Puglisi , Davide Poletti , Giulio Fabbian , Carlo Baccigalupi , Luca Heltai , Radek Stompor

This paper introduces PDEformer, a neural solver for partial differential equations (PDEs) capable of simultaneously addressing various types of PDEs. We propose to represent the PDE in the form of a computational graph, facilitating the…

Numerical Analysis · Mathematics 2025-01-28 Zhanhong Ye , Xiang Huang , Leheng Chen , Hongsheng Liu , Zidong Wang , Bin Dong

Latent variable models are powerful tools for modeling complex phenomena involving in particular partially observed data, unobserved variables or underlying complex unknown structures. Inference is often difficult due to the latent…

Statistics Theory · Mathematics 2023-06-23 Charlotte Baey , Maud Delattre , Estelle Kuhn , Jean-Benoist Leger , Sarah Lemler

Recently, there has been a lot of interest in using neural networks for solving partial differential equations. A number of neural network-based partial differential equation solvers have been formulated which provide performances…

Machine Learning · Computer Science 2020-04-21 Shehryar Malik , Usman Anwar , Ali Ahmed , Alireza Aghasi

We propose $\textsf{ScaledGD($\lambda$)}$, a preconditioned gradient descent method to tackle the low-rank matrix sensing problem when the true rank is unknown, and when the matrix is possibly ill-conditioned. Using overparametrized factor…

Machine Learning · Computer Science 2026-01-01 Xingyu Xu , Yandi Shen , Yuejie Chi , Cong Ma

Finding accurate solutions to partial differential equations (PDEs) is a crucial task in all scientific and engineering disciplines. It has recently been shown that machine learning methods can improve the solution accuracy by correcting…

Computational Physics · Physics 2021-01-06 Kiwon Um , Robert Brand , Yun , Fei , Philipp Holl , Nils Thuerey

Prior to the parallel solution of a large linear system, it is required to perform a partitioning of its equations/unknowns. Standard partitioning algorithms are designed using the considerations of the efficiency of the parallel…

Numerical Analysis · Mathematics 2013-11-19 Eugene Vecharynski , Yousef Saad , Masha Sosonkina

Neural preconditioners for real-time physics simulation offer promising data-driven priors, but they often fail to capture long-range couplings efficiently because they inherit local message passing or sparse-operator access patterns. We…

Graphics · Computer Science 2026-05-15 Carl Osborne , Minghao Guo , Crystal Owens , Wojciech Matusik

In this paper we describe a systematic procedure to analyze the convergence of degenerate preconditioned proximal point algorithms. We establish weak convergence results under mild assumptions that can be easily employed in the context of…

Optimization and Control · Mathematics 2021-09-24 Kristian Bredies , Enis Chenchene , Dirk A. Lorenz , Emanuele Naldi

Fast and accurate solution of time-dependent partial differential equations (PDEs) is of key interest in many research fields including physics, engineering, and biology. Generally, implicit schemes are preferred over the explicit ones for…

Numerical Analysis · Mathematics 2019-11-28 Suprosanna Shit , Abinav Ravi Venkatakrishnan , Ivan Ezhov , Jana Lipkova , Marie Piraud , Bjoern Menze

We propose an adaptive multigrid preconditioning technology for solving linear systems arising from Discontinuous Petrov-Galerkin (DPG) discretizations. Unlike standard multigrid techniques, this preconditioner involves only trace spaces…

Numerical Analysis · Mathematics 2020-10-15 Socratis Petrides , Leszek Demkowicz

Data driven discovery of partial differential equations (PDEs) is a promising approach for uncovering the underlying laws governing complex systems. However, purely data driven techniques face the dilemma of balancing search space with…

Machine Learning · Computer Science 2025-05-12 Hao Xu , Yuntian Chen , Rui Cao , Tianning Tang , Mengge Du , Jian Li , Adrian H. Callaghan , Dongxiao Zhang