English
Related papers

Related papers: Newton's method and its hybrid with machine learni…

200 papers

We present a novel Newton-type method for distributed optimization, which is particularly well suited for stochastic optimization and learning problems. For quadratic objectives, the method enjoys a linear rate of convergence which provably…

Machine Learning · Computer Science 2014-05-15 Ohad Shamir , Nathan Srebro , Tong Zhang

The modeling of electric machines and power transformers typically involves systems of nonlinear magnetostatics or -quasistatics, and their efficient and accurate simulation is required for the reliable design, control, and optimization of…

Numerical Analysis · Mathematics 2024-08-23 Herbert Egger , Felix Engertsberger , Bogdan Radu

In this paper, we investigate numerically a diffuse interface model for the Navier-Stokes equation with fluid-fluid interface when the fluids have different densities \cite{Lowengrub1998}. Under minor reformulation of the system, we show…

Mathematical Physics · Physics 2015-06-18 Zhenlin Guo , Ping Lin , John S. Lowengrub

A high-order Newton multigrid method is proposed for steady-state shallow water flows in open channels with regular and irregular geometries. The method integrates a finite volume discretization with third-order weighted essentially…

Numerical Analysis · Mathematics 2026-05-29 Zhicheng Hu , Guanghan Li , Chunwu Wang , Xiaowen Wang

The goal of this paper is to study approaches to bridge the gap between first-order and second-order type methods for composite convex programs. Our key observations are: i) Many well-known operator splitting methods, such as…

Optimization and Control · Mathematics 2016-09-27 Xiantao Xiao , Yongfeng Li , Zaiwen Wen , Liwei Zhang

This work investigates the application of the Newton's method for the numerical solution of a nonlinear boundary value problem formulated through an ordinary differential equation (ODE). Nonlinear ODEs arise in various mathematical modeling…

Many machine learning models depend on solving a large scale optimization problem. Recently, sub-sampled Newton methods have emerged to attract much attention for optimization due to their efficiency at each iteration, rectified a weakness…

Optimization and Control · Mathematics 2016-09-06 Haishan Ye , Luo Luo , Zhihua Zhang

We introduce a new dynamical system, at the interface between second-order dynamics with inertia and Newton's method. This system extends the class of inertial Newton-like dynamics by featuring a time-dependent parameter in front of the…

Optimization and Control · Mathematics 2024-02-13 Camille Castera , Hedy Attouch , Jalal Fadili , Peter Ochs

The paper proposes and develops new globally convergent algorithms of the generalized damped Newton type for solving important classes of nonsmooth optimization problems. These algorithms are based on the theory and calculations of…

Optimization and Control · Mathematics 2022-01-20 Pham Duy Khanh , Boris Mordukhovich , Vo Thanh Phat , Dat Ba Tran

We develop a Bayesian methodology for numerical solution of the incompressible Navier--Stokes equations with quantified uncertainty. The central idea is to treat discretized Navier--Stokes dynamics as a state-space model and to view…

Computation · Statistics 2026-02-04 Nicholas Polson , Vadim Sokolov

An efficient and accurate finite-element algorithm is described for the numerical solution of the incompressible Navier-Stokes (INS) equations. The new algorithm that solves the INS equations in a velocity-pressure reformulation is based on…

Numerical Analysis · Mathematics 2020-02-19 Longfei Li

In this work, we develop a fully implicit Hybrid High-Order algorithm for the Cahn-Hilliard problem in mixed form. The space discretization hinges on local reconstruction operators from hybrid polynomial unknowns at elements and faces. The…

Numerical Analysis · Mathematics 2016-07-01 Florent Chave , Daniele A. Di Pietro , Fabien Marche , Franck Pigeonneau

In design of optical systems based on LED (Light emitting diode) technology, a crucial task is to handle the unstructured data describing properties of optical elements in standard formats. This leads to the problem of data fitting within…

Other Computer Science · Computer Science 2016-04-27 David Kaljun , Joze Petrišič , Janez Žerovnik

Minimizing loss functions is central to machine-learning training. Although first-order methods dominate practical applications, higher-order techniques such as Newton's method can deliver greater accuracy and faster convergence, yet are…

Machine Learning · Computer Science 2025-11-25 Giuseppe Carrino , Elena Loli Piccolomini , Elisa Riccietti , Theo Mary

We present a new method to solve nonlinear Hammerstein equations with weakly singular kernels. The process to approximate the solution, followed usually, consists in adapting the discretization scheme from the linear case in order to obtain…

Numerical Analysis · Mathematics 2016-04-05 Laurence Grammont , Hanane Kaboul

We develop a cut finite element method for the Darcy problem on surfaces. The cut finite element method is based on embedding the surface in a three dimensional finite element mesh and using finite element spaces defined on the three…

Numerical Analysis · Mathematics 2017-10-11 Peter Hansbo , Mats G. Larson , Andre Massing

We present a method that employs physics-informed deep learning techniques for parametrically solving partial differential equations. The focus is on the steady-state heat equations within heterogeneous solids exhibiting significant phase…

Machine Learning · Computer Science 2024-01-05 Shahed Rezaei , Ahmad Moeineddin , Michael Kaliske , Markus Apel

The paper starts with a concise description of the recently developed semismooth* Newton method for the solution of general inclusions. This method is then applied to a class of variational inequalities of the second kind. As a result, one…

Optimization and Control · Mathematics 2020-07-23 Helmut Gfrerer , Jiri V. Outrata , Jan Valdman

We consider a coupled model of free-flow and porous medium flow, governed by stationary Stokes and Darcy flow, respectively. The coupling between the two systems is enforced by introducing a single variable representing the normal flux…

Numerical Analysis · Mathematics 2022-09-28 Wietse M. Boon

This paper deals with an implicit Newton-like inertial dynamical system governed by a maximally comonotone inclusion problem in a Hilbert space. Under suitable conditions, we establish not only pointwise estimates and integral estimates for…

Optimization and Control · Mathematics 2024-05-13 Z. Z. Tan , R. Hu , Y. P. Fang