English
Related papers

Related papers: A Neural-Operator Preconditioned Newton Method for…

200 papers

In this paper, we propose Neumann Series Neural Operator (NSNO) to learn the solution operator of Helmholtz equation from inhomogeneity coefficients and source terms to solutions. Helmholtz equation is a crucial partial differential…

Numerical Analysis · Mathematics 2024-01-25 Fukai Chen , Ziyang Liu , Guochang Lin , Junqing Chen , Zuoqiang Shi

In this paper, we propose a descent method for composite optimization problems with linear operators. Specifically, we first design a structure-exploiting preconditioner tailored to the linear operator so that the resulting preconditioned…

Optimization and Control · Mathematics 2026-03-20 Jian Chen , Xinmin Yang

Neural operators serve as fast, data-driven surrogates for scientific modeling but typically rely on a monolithic, single-pass inference procedure that struggles to resolve high-frequency details, a limitation known as spectral bias. We…

Machine Learning · Computer Science 2026-05-27 Xiaotian Liu , Shuyuan Shang , Xiaopeng Wang , Pu Ren , Yaoqing Yang

The neural operator has emerged as a powerful tool in learning mappings between function spaces in PDEs. However, when faced with real-world physical data, which are often highly non-uniformly distributed, it is challenging to use…

Machine Learning · Computer Science 2023-06-01 Songming Liu , Zhongkai Hao , Chengyang Ying , Hang Su , Ze Cheng , Jun Zhu

Over the last few years, neural networks have started penetrating safety critical systems to take decisions in robots, rockets, autonomous driving car, etc. A problem is that these critical systems often have limited computing resources.…

Software Engineering · Computer Science 2022-02-24 Hanane Benmaghnia , Matthieu Martel , Yassamine Seladji

Sequential implicit (SI) formulations are gaining increasing interest due to their ability to decouple reservoir simulation problems into distinct flow and transport subproblems, allowing for the use of specialized solvers tailored to each.…

Numerical Analysis · Mathematics 2025-04-29 Omar Chaabi , Mohammed Al-Kobaisi

At the heart of Newton based optimization methods is a sequence of symmetric linear systems. Each consecutive system in this sequence is similar to the next, so solving them separately is a waste of computational effort. Here we describe…

Optimization and Control · Mathematics 2014-12-30 Robert Mansel Gower , Jacek Gondzio

Neural operators effectively solve PDE problems from data without knowing the explicit equations, which learn the map from the input sequences of observed samples to the predicted values. Most existing works build the model in the original…

Machine Learning · Computer Science 2024-12-23 Tian Wang , Chuang Wang

A nonlinear operator equation $F(x)=0$, $F:H\to H,$ in a Hilbert space is considered. Continuous Newton's-type procedures based on a construction of a dynamical system with the trajectory starting at some initial point $x_0$ and becoming…

Numerical Analysis · Mathematics 2025-10-20 A. G. Ramm , A. B. Smirnova , A. Favini

When considering an unconstrained minimization problem, a standard approach is to solve the optimality system with a Newton method possibly preconditioned by, e.g., nonlinear elimination. In this contribution, we argue that nonlinear…

Numerical Analysis · Mathematics 2024-09-04 Gabriele Ciaremalla , Tommaso Vanzan

An all-at-once linear system arising from the nonlinear tempered fractional diffusion equation with variable coefficients is studied. Firstly, the nonlinear and linearized implicit schemes are proposed to approximate such the nonlinear…

Numerical Analysis · Mathematics 2024-12-20 Yong-Liang Zhao , Pei-Yong Zhu , Xian-Ming Gu , Xi-Le Zhao , Huan-Yan Jian

Neural Operators (NOs) provide a powerful framework for computations involving physical laws that can be modelled by (integro-) partial differential equations (PDEs), directly learning maps between infinite-dimensional function spaces that…

Machine Learning · Computer Science 2025-09-18 Gianluca Fabiani , Hannes Vandecasteele , Somdatta Goswami , Constantinos Siettos , Ioannis G. Kevrekidis

We introduce a neural network (NN) strictly governed by Newton's Law, with the nature required basis functions derived from the fundamental classic mechanics. Then, by classifying the training model as a quick procedure of 'force pattern'…

Machine Learning · Computer Science 2018-10-18 Junqing Qiu , Guoren Zhong , Yihua Lu , Kun Xin , Huihuan Qian , Xi Zhu

Newton's method is a fundamental technique in optimization with quadratic convergence within a neighborhood around the optimum. However reaching this neighborhood is often slow and dominates the computational costs. We exploit two…

Machine Learning · Computer Science 2016-05-24 Hadi Daneshmand , Aurelien Lucchi , Thomas Hofmann

Topological solitons, which are stable, localized solutions of nonlinear differential equations, are crucial in various fields of physics and mathematics, including particle physics and cosmology. However, solving these solitons presents…

High Energy Physics - Theory · Physics 2024-11-25 Koji Hashimoto , Koshiro Matsuo , Masaki Murata , Gakuto Ogiwara

We propose the Factorized Fourier Neural Operator (F-FNO), a learning-based approach for simulating partial differential equations (PDEs). Starting from a recently proposed Fourier representation of flow fields, the F-FNO bridges the…

Machine Learning · Computer Science 2023-03-03 Alasdair Tran , Alexander Mathews , Lexing Xie , Cheng Soon Ong

Discretization of non-linear Poisson-Boltzmann Equation equations results in a system of non-linear equations with symmetric Jacobian. The Newton algorithm is the most useful tool for solving non-linear equations. It consists of solving a…

Mathematical Physics · Physics 2007-05-23 Sanjay Kumar Khattri

Finding roots of equations is at the heart of most computational science. A well-known and widely used iterative algorithm is the Newton's method. However, its convergence depends heavily on the initial guess, with poor choices often…

Numerical Analysis · Mathematics 2020-04-09 Ankush Aggarwal , Sanjay Pant

We introduce a new class of hybrid preconditioners for solving parametric linear systems of equations. The proposed preconditioners are constructed by hybridizing the deep operator network, namely DeepONet, with standard iterative methods.…

Numerical Analysis · Mathematics 2024-01-11 Alena Kopaničáková , George Em Karniadakis

The computational overhead of traditional numerical solvers for partial differential equations (PDEs) remains a critical bottleneck for large-scale parametric studies and design optimization. We introduce a Minimal-Data Parametric Neural…

Machine Learning · Computer Science 2026-05-15 Qiyun Cheng , Md Hossain Sahadath , Huihua Yang , Shaowu Pan , Wei Ji