English
Related papers

Related papers: Accelerating the convergence of Newton's method fo…

200 papers

This paper concerns the inclusion of Newton's method into an adaptive finite element method (FEM) for the solution of nonlinear partial differential equations (PDEs). It features an adaptive choice of the damping parameter in the Newton…

Numerical Analysis · Mathematics 2025-12-23 Philipp Bringmann , Maximilian Brunner , Dirk Praetorius

Finding roots of equations is at the heart of most computational science. A well-known and widely used iterative algorithm is the Newton's method. However, its convergence depends heavily on the initial guess, with poor choices often…

Numerical Analysis · Mathematics 2020-04-09 Ankush Aggarwal , Sanjay Pant

We propose a Newton-based scheme, initialized by neural operator predictions, to accelerate the parametric solution of nonlinear problems in computational solid mechanics. First, a physics informed conditional neural field is trained to…

Machine Learning · Computer Science 2025-11-11 Kianoosh Taghikhani , Yusuke Yamazaki , Jerry Paul Varghese , Markus Apel , Reza Najian Asl , Shahed Rezaei

In this work we present an adaptive Newton-type method to solve nonlinear constrained optimization problems in which the constraint is a system of partial differential equations discretized by the finite element method. The adaptive…

Optimization and Control · Mathematics 2017-06-05 Thomas Carraro , Simon Dörsam , Stefan Frei , Daniel Schwarz

Neural operators improve conventional neural networks by expanding their capabilities of functional mappings between different function spaces to solve partial differential equations (PDEs). One of the most notable methods is the Fourier…

Machine Learning · Computer Science 2024-07-29 Xuanle Zhao , Yue Sun , Tielin Zhang , Bo Xu

This work investigates the application of the Newton's method for the numerical solution of a nonlinear boundary value problem formulated through an ordinary differential equation (ODE). Nonlinear ODEs arise in various mathematical modeling…

Deep learning surrogate models have shown promise in solving partial differential equations (PDEs). Among them, the Fourier neural operator (FNO) achieves good accuracy, and is significantly faster compared to numerical solvers, on a…

Machine Learning · Computer Science 2024-05-03 Zongyi Li , Daniel Zhengyu Huang , Burigede Liu , Anima Anandkumar

Nonlinear systems of partial differential equations (PDEs) may permit several distinct solutions. The typical current approach to finding distinct solutions is to start Newton's method with many different initial guesses, hoping to find…

Numerical Analysis · Mathematics 2015-07-03 Patrick E. Farrell , Ásgeir Birkisson , Simon W. Funke

In this paper, we propose a way to solve partial differential equations (PDEs) by combining machine learning techniques and the finite element method called Phi-FEM. For that, we use the Fourier Neural Operator (FNO), a learning mapping…

Numerical Analysis · Mathematics 2025-03-05 Michel Duprez , Vanessa Lleras , Alexei Lozinski , Vincent Vigon , Killian Vuillemot

The initialization of equation-based differential-algebraic system models, and more in general the solution of many engineering and scientific problems, require the solution of systems of nonlinear equations. Newton-Raphson's method is…

Numerical Analysis · Mathematics 2021-02-22 Francesco Casella , Bernhard Bachmann

We develop a randomized Newton's method for solving differential equations, based on a fully connected neural network discretization. In particular, the randomized Newton's method randomly chooses equations from the overdetermined nonlinear…

Numerical Analysis · Mathematics 2019-12-09 Qipin Chen , Wenrui Hao

Self consistent transfer operators arise naturally in the study of mean-field coupled dynamical systems and are closely related to kinetic PDEs such as the Vlasov equation. Despite substantial progress on existence and uniqueness of fixed…

Dynamical Systems · Mathematics 2026-05-12 Wael Bahsoun , Gary Froyland , Maxence Phalempin

We propose the Factorized Fourier Neural Operator (F-FNO), a learning-based approach for simulating partial differential equations (PDEs). Starting from a recently proposed Fourier representation of flow fields, the F-FNO bridges the…

Machine Learning · Computer Science 2023-03-03 Alasdair Tran , Alexander Mathews , Lexing Xie , Cheng Soon Ong

Solving nonlinear partial differential equations (PDEs) with multiple solutions using neural networks has found widespread applications in various fields such as physics, biology, and engineering. However, classical neural network methods…

Machine Learning · Computer Science 2024-05-24 Wenrui Hao , Xinliang Liu , Yahong Yang

A zero-finding technique for solving nonlinear equations more efficiently than they usually are with traditional iterative methods in which the order of convergence is improved is presented. The key idea in deriving this procedure is to…

Numerical Analysis · Mathematics 2011-06-07 Miquel Grau-Sánchez , José Luis Díaz-Barrero

We propose a novel neural preconditioned Newton (NP-Newton) method for solving parametric nonlinear systems of equations. To overcome the stagnation or instability of Newton iterations caused by unbalanced nonlinearities, we introduce a…

Numerical Analysis · Mathematics 2025-11-13 Youngkyu Lee , Shanqing Liu , Jerome Darbon , George Em Karniadakis

Despite the impressive numerical performance of the quasi-Newton and Anderson/nonlinear acceleration methods, their global convergence rates have remained elusive for over 50 years. This study addresses this long-standing issue by…

Optimization and Control · Mathematics 2023-11-16 Damien Scieur

This paper focuses on proposing a deep learning initialized iterative method (Int-Deep) for low-dimensional nonlinear partial differential equations (PDEs). The corresponding framework consists of two phases. In the first phase, an…

Numerical Analysis · Mathematics 2020-08-26 Jianguo Huang , Haoqin Wang , Haizhao Yang

This work proposes an $r$-adaptive finite element method (FEM) using neural networks (NNs). The method employs the Ritz energy functional as the loss function, currently limiting its applicability to symmetric and coercive problems, such as…

There is growing interest in applying distributed machine learning to edge computing, forming federated edge learning. Federated edge learning faces non-i.i.d. and heterogeneous data, and the communication between edge workers, possibly…

Machine Learning · Computer Science 2022-01-27 Canh T. Dinh , Nguyen H. Tran , Tuan Dung Nguyen , Wei Bao , Amir Rezaei Balef , Bing B. Zhou , Albert Y. Zomaya
‹ Prev 1 2 3 10 Next ›