English
Related papers

Related papers: Improving Newton's method performance by parametri…

200 papers

This paper proposes a novel method for designing finite-horizon discrete-valued switching signals in linear switched systems based on discreteness-promoting regularization. The inherent combinatorial optimization problem is reformulated as…

Optimization and Control · Mathematics 2025-05-06 Masaaki Nagahara , Takuya Ikeda , Ritsuki Hoshimoto

We propose a stochastic variance-reduced cubic regularized Newton method for non-convex optimization. At the core of our algorithm is a novel semi-stochastic gradient along with a semi-stochastic Hessian, which are specifically designed for…

Machine Learning · Computer Science 2018-02-14 Dongruo Zhou , Pan Xu , Quanquan Gu

We generalize Newton-type methods for minimizing smooth functions to handle a sum of two convex functions: a smooth function and a nonsmooth function with a simple proximal mapping. We show that the resulting proximal Newton-type methods…

Machine Learning · Statistics 2014-03-19 Jason D. Lee , Yuekai Sun , Michael A. Saunders

In this paper we the formulation of inverse problems as constrained minimization problems and their iterative solution by gradient or Newton type. We carry out a convergence analysis in the sense of regularization methods and discuss…

Numerical Analysis · Mathematics 2021-01-15 Barbara Kaltenbacher , Kha Van Huynh

In this paper, we propose a third-order Newton's method which in each iteration solves a semidefinite program as a subproblem. Our approach is based on moving to the local minimum of the third-order Taylor expansion at each iteration,…

Optimization and Control · Mathematics 2023-06-08 Olha Silina , Jeffrey Zhang

In this paper, we revisit the chaotic number of iterations needed by Newton's method to converge to a root. Here, we consider a simple modified Newton method depending on a parameter. It is demonstrated using polynomiography that even in…

Numerical Analysis · Mathematics 2017-08-10 H. Susanto , N. Karjanto

This paper develops validated computational methods for studying infinite dimensional stable manifolds at equilibrium solutions of parabolic PDEs, synthesizing disparate errors resulting from numerical approximation. To construct our…

Dynamical Systems · Mathematics 2021-07-08 Jan Bouwe van den Berg , Jonathan Jaquette , J. D. Mireles James

For shape optimization problems, governed by elliptic equations with Dirichlet boundary condition and random coefficients, we utilize a penalization technique to get the approximate problem. We consider that uncertainties exists in the…

Optimization and Control · Mathematics 2025-08-26 Xiaowei Pang

This work concerns the local convergence theory of Newton and quasi-Newton methods for convex-composite optimization: minimize f(x):=h(c(x)), where h is an infinite-valued proper convex function and c is C^2-smooth. We focus on the case…

Optimization and Control · Mathematics 2018-06-19 James V. Burke , Abraham Engle

We develop adaptive discretization algorithms for locally optimal experimental design of nonlinear prediction models. With these algorithms, we refine and improve a pertinent state-of-the-art algorithm in various respects. We establish…

Optimization and Control · Mathematics 2024-06-04 Jochen Schmid , Philipp Seufert , Michael Bortz

The focus in this work is on interior-point methods for inequality-constrained quadratic programs, and particularly on the system of nonlinear equations to be solved for each value of the barrier parameter. Newton iterations give high…

Optimization and Control · Mathematics 2024-01-24 David Ek , Anders Forsgren

In recent publications, the author and his coworkers have proposed a multigrid method for solving linear systems arizing from the discretization of partial differential equations in isogeometric analysis and have proven that the convergence…

Numerical Analysis · Mathematics 2021-03-05 Stefan Takacs

Nonlinear systems of partial differential equations (PDEs) may permit several distinct solutions. The typical current approach to finding distinct solutions is to start Newton's method with many different initial guesses, hoping to find…

Numerical Analysis · Mathematics 2015-07-03 Patrick E. Farrell , Ásgeir Birkisson , Simon W. Funke

We study a one dimensional model for two-phase flows in heterogeneous media, in which the capillary pressure functions can be discontinuous with respect to space. We first give a model, leading to a system of degenerated non-linear…

Analysis of PDEs · Mathematics 2009-09-08 Clément Cancès

Although persistent excitation is often acknowledged as a sufficient condition to exponentially converge in the field of adaptive parameter estimation, it must be noted that in practical applications this may be unguaranteed. Recently, more…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Siyu Chen , Jing Na , Yingbo Huang

Numerical analysis is conducted for a generalized particle method for a Poisson equation. Unique solvability is derived for the discretized Poisson equation by introducing a connectivity condition for particle distributions. Moreover, by…

Numerical Analysis · Mathematics 2019-07-03 Y. Imoto

Matrix functions are utilized to rewrite smooth spectral constrained matrix optimization problems as smooth unconstrained problems over the set of symmetric matrices which are then solved via the cubic-regularized Newton method. A…

Optimization and Control · Mathematics 2022-09-07 Casey Garner , Gilad Lerman , Shuzhong Zhang

In this paper we propose a new method to stabilise non-symmetric indefinite problems. The idea is to solve a forward and an adjoint problem simultaneously using a suitable stabilised finite element method. Both stabilisation of the element…

Numerical Analysis · Mathematics 2013-08-05 Erik Burman

Stochastic optimal principle leads to the resolution of a partial differential equation (PDE), namely the Hamilton-Jacobi-Bellman (HJB) equation. In general, this equation cannot be solved analytically, thus numerical algorithms are the…

Numerical Analysis · Mathematics 2021-09-14 Christelle Dleuna Nyoumbi , Antoine Tambue

We propose finite difference methods for degenerate fully nonlinear elliptic equations and prove the convergence of the schemes. Our focus is on the pure equation and a related free boundary problem of transmission type. The cornerstone of…

Numerical Analysis · Mathematics 2025-06-04 Edgard A. Pimentel , Ercília Sousa
‹ Prev 1 8 9 10 Next ›