English
Related papers

Related papers: Newton's method and its hybrid with machine learni…

200 papers

In this work we introduce and analyze a novel Hybrid High-Order method for the steady incompressible Navier-Stokes equations. The proposed method is inf-sup stable on general polyhedral meshes, supports arbitrary approximation orders, and…

Numerical Analysis · Mathematics 2018-02-26 Daniele A. Di Pietro , Stella Krell

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

Finding roots of equations is at the heart of most computational science. A well-known and widely used iterative algorithm is the Newton's method. However, its convergence depends heavily on the initial guess, with poor choices often…

Numerical Analysis · Mathematics 2020-04-09 Ankush Aggarwal , Sanjay Pant

Newton method is one of the most powerful methods for finding solutions of nonlinear equations and for proving their existence. In its "pure" form it has fast convergence near the solution, but small convergence domain. On the other hand…

Optimization and Control · Mathematics 2019-08-27 Boris Polyak , Andrey Tremba

This paper is concerned with fully discrete mixed finite element approximations of the time-dependent stochastic Stokes equations with multiplicative noise. A prototypical method, which comprises of the Euler-Maruyama scheme for time…

Numerical Analysis · Mathematics 2020-04-28 Xiaobing Feng , Hailong Qiu

We consider implementational aspects of the mixed finite element method for a special class of nonlinear problems. We establish the equivalence of the hybridized formulation of the mixed finite element method to a nonconforming finite…

Numerical Analysis · Mathematics 2016-10-19 Peter Knabner , Gerhard Summ

When combining the numerical concept of variational discretization and semi-smooth Newton methods for the numerical solution of pde constrained optimization with control constraints, special emphasis has to be taken on the implementation,…

Optimization and Control · Mathematics 2009-12-03 Michael Hinze , Morten Vierling

We propose a DC proximal Newton algorithm for solving nonconvex regularized sparse learning problems in high dimensions. Our proposed algorithm integrates the proximal Newton algorithm with multi-stage convex relaxation based on the…

Machine Learning · Statistics 2018-02-16 Xingguo Li , Lin F. Yang , Jason Ge , Jarvis Haupt , Tong Zhang , Tuo Zhao

We extend and analyze the deep neural network multigrid solver (DNN-MG) for the Navier-Stokes equations in three dimensions. The idea of the method is to augment a finite element simulation on coarse grids with fine scale information…

Numerical Analysis · Mathematics 2023-12-22 Nils Margenberg , Robert Jendersie , Christian Lessig , Thomas Richter

The paper develops a Newton multigrid (MG) method for one- and two-dimensional steady-state shallow water equations (SWEs) with topography and dry areas.It solves the nonlinear system arising from the well-balanced finite volume…

Numerical Analysis · Mathematics 2017-09-20 Kailiang Wu , Huazhong Tang

We analyze a hybrid method that enriches coarse grid finite element solutions with fine scale fluctuations obtained from a neural network. The idea stems from the Deep Neural Network Multigrid Solver (DNN-MG), (Margenberg et al., J Comput…

Numerical Analysis · Mathematics 2023-10-18 Uladzislau Kapustsin , Utku Kaya , Thomas Richter

In this paper, by combining the algorithm New Q-Newton's method - developed in previous joint work of the author - with Armijo's Backtracking line search, we resolve convergence issues encountered by Newton's method (e.g. convergence to a…

Optimization and Control · Mathematics 2022-09-13 Tuyen Trung Truong

We present an algorithm for the numerical solution of the equations governing combustion in porous inert media. The discretization of the flow problem is performed by the mixed finite element method, the transport problems are discretized…

Numerical Analysis · Mathematics 2016-09-01 Peter Knabner , Gerhard Summ

We study stochastic Cubic Newton methods for solving general possibly non-convex minimization problems. We propose a new framework, which we call the helper framework, that provides a unified view of the stochastic and variance-reduced…

Optimization and Control · Mathematics 2025-12-19 El Mahdi Chayti , Nikita Doikov , Martin Jaggi

In this work, we develop and analyse a novel Hybrid High-Order discretisation of the Brinkman problem. The method hinges on hybrid discrete velocity unknowns at faces and elements and on discontinuous pressures. Based on the discrete…

Numerical Analysis · Mathematics 2018-10-09 Lorenzo Botti , Daniele A. Di Pietro , Jérôme Droniou

Small-scale plasticity problems are often characterised by different patterning behaviours ranging from macroscopic down to the atomistic scale. In successful models of such complex behaviour, its origin lies within non-convexity of the…

Computational Physics · Physics 2018-11-01 F. Bormann , R. H. J. Peerlings , M. G. D. Geers

The following paper compares a consistent Newton-Raphson and fixed-point iteration based solution strategy for a variational multiscale finite element formulation for incompressible Navier-Stokes. The main contributions of this work include…

Numerical Analysis · Computer Science 2008-06-24 D. Z. Turner , K. B. Nakshatrala , K. D. Hjelmstad

The traditional Newton method for solving nonlinear operator equations in Banach spaces is discussed within the context of the continuous Newton method. This setting makes it possible to interpret the Newton method as a discrete dynamical…

Numerical Analysis · Mathematics 2016-07-13 Mario Amrein , Thomas P. Wihler

This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and…

Optimization and Control · Mathematics 2026-03-03 Pham Duy Khanh , Boris S. Mordukhovich , Vo Thanh Phat

This paper concerns the inclusion of Newton's method into an adaptive finite element method (FEM) for the solution of nonlinear partial differential equations (PDEs). It features an adaptive choice of the damping parameter in the Newton…

Numerical Analysis · Mathematics 2025-12-23 Philipp Bringmann , Maximilian Brunner , Dirk Praetorius