English
Related papers

Related papers: Continuous analog of Gauss-Newton method

200 papers

We investigate the use of piecewise linear systems, whose coefficient matrix is a piecewise constant function of the solution itself. Such systems arise, for example, from the numerical solution of linear complementarity problems and in the…

Numerical Analysis · Mathematics 2012-06-21 Luigi Brugnano , Alessandra Sestini

In this manuscript we propose and analyze an implicit two-point type method (or inertial method) for obtaining stable approximate solutions to linear ill-posed operator equations. The method is based on the iterated Tikhonov (iT) scheme. We…

Numerical Analysis · Mathematics 2024-01-30 Joel C. Rabelo , Antonio Leitão , Alexandre L. Madureira

This work focuses on developing and motivating a stochastic version of a wellknown inverse problem methodology. Specifically, we consider the iteratively regularized Gauss-Newton method, originally proposed by Bakushinskii for…

Numerical Analysis · Mathematics 2024-09-20 El Houcine Bergou , Neil K. Chada , Youssef Diouane

In this article we combine the projective Landweber method, recently proposed by the authors, with Kaczmarz's method for solving systems of non-linear ill-posed equations. The underlying assumption used in this work is the tangential cone…

Numerical Analysis · Mathematics 2020-11-12 A. Leitao , B. F. Svaiter

This paper deals with investigating numerical methods for solving coupled system of nonlinear parabolic problems. We utilize block monotone iterative methods based on Jacobi and Gauss--Seidel methods to solve difference schemes which…

Numerical Analysis · Mathematics 2019-05-10 Mohamed Al-Sultani

A general class of Newton algorithms on Gra{\ss}mann and Lagrange-Gra{\ss}mann manifolds is introduced, that depends on an arbitrary pair of local coordinates. Local quadratic convergence of the algorithm is shown under a suitable condition…

Optimization and Control · Mathematics 2011-11-10 Uwe Helmke , Knut Hüper , Jochen Trumpf

A zero-finding technique for solving nonlinear equations more efficiently than they usually are with traditional iterative methods in which the order of convergence is improved is presented. The key idea in deriving this procedure is to…

Numerical Analysis · Mathematics 2011-06-07 Miquel Grau-Sánchez , José Luis Díaz-Barrero

We obtain estimates of the multiplicative constants appearing in local convergence results of the Riemannian Gauss-Newton method for least squares problems on manifolds and relate them to the geometric condition number of [P. B\"urgisser…

Numerical Analysis · Mathematics 2022-09-02 Paul Breiding , Nick Vannieuwenhoven

Non linear regression models are a standard tool for modeling real phenomena, with several applications in machine learning, ecology, econometry... Estimating the parameters of the model has garnered a lot of attention during many years. We…

Statistics Theory · Mathematics 2020-09-17 Peggy Cénac , Antoine Godichon-Baggioni , Bruno Portier

This paper proposes a Newton-type method to solve numerically the eigenproblem of several diagonalizable matrices, which pairwise commute. A classical result states that these matrices are simultaneously diagonalizable. From a suitable…

Numerical Analysis · Mathematics 2022-11-07 Rima Khouja , Bernard Mourrain , Jean-Claude Yakoubsohn

The secant method, as an important approach for solving nonlinear equations, is introduced in nearly all numerical analysis textbooks. However, most textbooks only briefly address the Q-order of convergence of this method, with few…

Numerical Analysis · Mathematics 2025-10-16 Yan Tan , Chenhao Ye , Qinghai Zhang , Shubo Zhao

We propose an implicit iterative algorithm for an exact penalty method arising from inequality constrained optimization problems. A rapidly convergent fixed point method is developed for a regularized penalty functional. The applicability…

Optimization and Control · Mathematics 2012-10-05 Kazufumi Ito , Tomoya Takeuchi

A class of abstract nonlinear time-periodic evolution problems is considered which arise in electrical engineering and other scientific disciplines. An efficient solver is proposed for the systems arising after discretization in time based…

Numerical Analysis · Mathematics 2025-03-03 Herbert Egger , Andreas Schafelner

Based the homogeneous balance method, a general method is suggested to obtain several kinds of exact solutions for some kinds of nonlinear equations. The validity and reliability of the method are tested by applying it to the Bousseneq…

Chaotic Dynamics · Physics 2007-05-23 Yang lei , Zhu zhengang , Wang yinghai

Uniformly regular equilibrium problems are natural generalizations of abstract equilibrium prob lems and they are defined over the uniformly prox-regular nonconvex sets. Some new efficient implicit methods for solving uniformly regular…

Optimization and Control · Mathematics 2025-02-11 Oday Hazaimah

We consider the extension of the method of Gauss-Newton from complex floating-point arithmetic to the field of truncated power series with complex floating-point coefficients. With linearization we formulate a linear system where the…

Numerical Analysis · Mathematics 2017-10-27 Nathan Bliss , Jan Verschelde

This paper addresses a class of general nonsmooth and nonconvex composite optimization problems subject to nonlinear equality constraints. We assume that a part of the objective function and the functional constraints exhibit local…

Optimization and Control · Mathematics 2025-03-04 Lahcen El Bourkhissi , Ion Necoara , Panagiotis Patrinos , Quoc Tran-Dinh

In this paper, we consider Nesterov's Accelerated Gradient method for solving Nonlinear Inverse and Ill-Posed Problems. Known to be a fast gradient-based iterative method for solving well-posed convex optimization problems, this method also…

Numerical Analysis · Mathematics 2020-01-13 Simon Hubmer , Ronny Ramlau

We explore the use of the Gauss-Newton method for optimization in shape learning, including implicit neural surfaces and geometry-informed neural networks. The method addresses key challenges in shape learning, such as the ill-conditioning…

Machine Learning · Computer Science 2026-02-16 James King , Arturs Berzins , Siddhartha Mishra , Marius Zeinhofer

In this paper, we study a fast approximate inference method based on expectation propagation for exploring the posterior probability distribution arising from the Bayesian formulation of nonlinear inverse problems. It is capable of…

Numerical Analysis · Mathematics 2015-06-18 Matthias Gehre , Bangti Jin