English
Related papers

Related papers: Levenberg-Marquardt methods with inexact projectio…

200 papers

We propose a new randomized method for solving systems of nonlinear equations, which can find sparse solutions or solutions under certain simple constraints. The scheme only takes gradients of component functions and uses Bregman…

Optimization and Control · Mathematics 2024-02-26 Robert Gower , Dirk A. Lorenz , Maximilian Winkler

We consider the problem of robust matrix completion, which aims to recover a low rank matrix $L_*$ and a sparse matrix $S_*$ from incomplete observations of their sum $M=L_*+S_*\in\mathbb{R}^{m\times n}$. Algorithmically, the robust matrix…

Machine Learning · Statistics 2020-03-25 Yunfeng Cai , Ping Li

In this paper, we introduce an iterative numerical method to solve systems of nonlinear equations. The third-order convergence of this method is analyzed. Several examples are given to illustrate the efficiency of the proposed method.

Dynamical Systems · Mathematics 2009-04-23 M. Eshaghi Gordji , A. Ebadian , M. B. Ghaemi , J. Shokri

The article proposes a Caputo fractional conjugate gradient (CFCG) method for unconstrained optimization problems which is applicable to smooth as well as non-smooth problmes. The proposed method uses a non-adaptive version of the Caputo…

Optimization and Control · Mathematics 2025-12-22 Barsha Shawa , Md Abu Talhamainuddin Ansary

We present a method of parameter estimation for large class of nonlinear systems, namely those in which the state consists of output derivatives and the flow is linear in the parameter. The method, which solves for the unknown parameter by…

Systems and Control · Electrical Eng. & Systems 2024-07-16 Simon Kuang , Xinfan Lin

We study the convergence of the gradient descent method for solving ill-posed problems where the solution is characterized as a global minimum of a differentiable functional in a Hilbert space. The classical least-squares functional for…

Numerical Analysis · Mathematics 2016-06-02 Stefan Kindermann

In this paper, we introduce two parabolic target-space interior-point algorithms for solving monotone linear complementarity problems. The first algorithm is based on a universal tangent direction, which has been recently proposed for…

Optimization and Control · Mathematics 2025-07-31 Marianna E. -Nagy , Tibor Illés , Yurii Nesterov , Petra Renáta Rigó

In this paper, we develop a new alternating projection method to compute nonnegative low rank matrix approximation for nonnegative matrices. In the nonnegative low rank matrix approximation method, the projection onto the manifold of fixed…

Machine Learning · Computer Science 2020-09-10 Guangjing Song , Michael K. Ng , Tai-Xiang Jiang

This paper deals with a modifed iterative projection method for approximating a solution of hierarchical fixed point problems for nearly nonexpansive mappings. Some strong convergence theorems for the proposed method are presented under…

Functional Analysis · Mathematics 2014-03-17 Ibrahim Karahan , Murat Ozdemir

Nonlinear convex problems arise in various areas of applied mathematics and engineering. Classical techniques such as the relaxed proximal point algorithm (PPA) and the prediction correction (PC) method were proposed for linearly…

Optimization and Control · Mathematics 2023-07-28 Sai Wang , Yi Gong

Under conditions that prevent tangential intersection, we prove quadratic convergence of a projection algorithm for the feasibility problem of finding a point in the intersection of a smooth curve and line in $\mathbb{R}^2$. This nonconvex…

Optimization and Control · Mathematics 2025-10-22 Jordan Collard , Scott B. Lindstrom

Projected Gradient Descent denotes a class of iterative methods for solving optimization programs. Its applicability to convex optimization programs has gained significant popularity for its intuitive implementation that involves only…

Optimization and Control · Mathematics 2016-10-24 Giampaolo Torrisi , Sergio Grammatico , Roy S. Smith , Manfred Morari

In this paper, we propose a new stochastic column-block gradient descent method for solving nonlinear systems of equations. It has a descent direction and holds an approximately optimal step size obtained through an optimization problem. We…

Numerical Analysis · Mathematics 2025-07-21 Naiyu Jiang , Wendi Bao , Lili Xing , Weiguo Li

A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear equality constrained optimization problems in which the objective function is defined by an expectation of a stochastic function. The algorithmic…

Optimization and Control · Mathematics 2023-03-17 Albert S. Berahas , Frank E. Curtis , Michael J. O'Neill , Daniel P. Robinson

The attempt to solve inverse scattering problems often leads to optimization and sampling problems that require handling moderate to large amounts of partial differential equations acting as constraints. We focus here on determining…

Numerical Analysis · Mathematics 2025-04-09 Carolina Abugattas , Ana Carpio , Elena Cebrián , Gerardo Oleaga

In this paper, we introduce a new method for solving variational inequality problems with monotone and Lipschitz-continuous mapping in Hilbert space. The iterative process is based on two well-known projection method and the hybrid (or…

Optimization and Control · Mathematics 2015-01-30 Yu. V. Malitsky , V. V. Semenov

This paper proposes a partially inexact alternating direction method of multipliers for computing approximate solution of a linearly constrained convex optimization problem. This method allows its first subproblem to be solved inexactly…

Optimization and Control · Mathematics 2018-05-21 Vando A. Adona , Max L. N. Goncalves , Jefferson G. Melo

A class of interior point methods using inexact directions is analysed. The linear system arising in interior point methods for linear programming is reformulated such that the solution is less sensitive to perturbations in the right-hand…

Optimization and Control · Mathematics 2016-08-02 Lukas Schork , Jacek Gondzio

We propose a linesearch projection algorithm for solving non-monotone and non-Lipschitzian equilibrium problems in Hilbert spaces. It is proved that the sequence generated by the proposed algorithm converges strongly to a solution of the…

Optimization and Control · Mathematics 2021-03-04 Lanmei Deng , Rong Hu , Yaping Fang

We develop a novel, fundamental and surprisingly simple randomized iterative method for solving consistent linear systems. Our method has six different but equivalent interpretations: sketch-and-project, constrain-and-approximate, random…

Numerical Analysis · Mathematics 2016-01-07 Robert M. Gower , Peter Richtárik