English
Related papers

Related papers: Extrapolated Sequential Constraint Method for Vari…

200 papers

In this paper, we introduce new implicit and explicit iterative schemes which converge strongly to a unique solution of variational inequality problems for strongly accretive operators over a common fixed point set of finite family of…

Functional Analysis · Mathematics 2010-07-07 Eric U. Ofoedu

This paper analyzes the iteration-complexity of a quadratic penalty accelerated inexact proximal point method for solving linearly constrained nonconvex composite programs. More specifically, the objective function is of the form $f + h$…

Optimization and Control · Mathematics 2019-07-17 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

This paper presents and investigates an inexact proximal gradient method for solving composite convex optimization problems characterized by an objective function composed of a sum of a full-domain differentiable convex function and a…

Optimization and Control · Mathematics 2025-04-16 Yunier Bello-Cruz , Max L. N. Gonçalves , Jefferson G. Melo , Cassandra Mohr

Incremental methods are widely utilized for solving finite-sum optimization problems in machine learning and signal processing. In this paper, we study a family of incremental methods -- including incremental subgradient, incremental…

Optimization and Control · Mathematics 2022-12-26 Xiao Li , Zhihui Zhu , Anthony Man-Cho So , Jason D Lee

In this article, a globally convergent sequential quadratic programming (SQP) method is developed for multi-objective optimization problems with inequality type constraints. A feasible descent direction is obtained using a linear…

Optimization and Control · Mathematics 2020-05-20 Md Abu Talhamainuddin Ansary , Geetanjali Panda

In this paper, we propose a novel extrapolation coefficient scheme within a new extrapolation term and develop an accelerated proximal gradient algorithm. We establish that the algorithm achieves a sublinear convergence rate. The proposed…

Optimization and Control · Mathematics 2025-10-17 Chengzhi Huang

This work considers the effect of averaging, and more generally extrapolation, of the iterates of gradient descent in smooth convex optimization. After running the method, rather than reporting the final iterate, one can report either a…

Optimization and Control · Mathematics 2025-05-29 Alan Luner , Benjamin Grimmer

Inverse problems are in many cases solved with optimization techniques. When the underlying model is linear, first-order gradient methods are usually sufficient. With nonlinear models, due to nonconvexity, one must often resort to…

Numerical Analysis · Mathematics 2023-05-15 Arttu Arjas , Mikko J. Sillanpää , Andreas Hauptmann

We develop a novel method for finding bifurcations for nonlinear systems of equations based on directly finding bifurcations through saddle points of extended quotients. The method is applied to find the saddle-node bifurcation point for…

Analysis of PDEs · Mathematics 2024-05-07 Yavdat Il'yasov

In this paper, we introduce a new method for solving variational inequality problems with monotone and Lipschitz-continuous mapping in Hilbert space. The iterative process is based on two well-known projection method and the hybrid (or…

Optimization and Control · Mathematics 2015-01-30 Yu. V. Malitsky , V. V. Semenov

In this paper, we propose a constraint-based modeling approach for the problem of discovering frequent gradual patterns in a numerical dataset. This SAT-based declarative approach offers an additional possibility to benefit from the recent…

Artificial Intelligence · Computer Science 2019-03-21 Jerry Lonlac , Saïdd Jabbour , Engelbert Mephu Nguifo , Lakhdar Saïs , Badran Raddaoui

Extrapolation methods use the last few iterates of an optimization algorithm to produce a better estimate of the optimum. They were shown to achieve optimal convergence rates in a deterministic setting using simple gradient iterates. Here,…

Optimization and Control · Mathematics 2017-08-04 Damien Scieur , Alexandre d'Aspremont , Francis Bach

We present some extensions to the limited memory steepest descent method based on spectral properties and cyclic iterations. Our aim is to show that it is possible to combine sweep and delayed strategies for improving the performance of…

Numerical Analysis · Mathematics 2019-12-10 Qinmeng Zou , Frederic Magoules

The classical convex feasibility problem in a finite dimensional Euclidean space is studied in the present paper. We are interested in two cases. First, we assume to know how to compute an exact project onto one of the sets involved and the…

Optimization and Control · Mathematics 2019-12-10 R. Díaz Millán , O. P. Ferreira , L. F. Prudente

In equality-constrained optimization, a standard regularity assumption is often associated with feasible point methods, namely the gradients of constraints are linearly independent. In practice, the regularity assumption may be violated. To…

Neural and Evolutionary Computing · Computer Science 2020-03-10 Quan Quan , Kai-Yuan Cai

This paper is concerned with the variational inequality problem (VIP) over the fixed point set of a quasi-nonexpansive operator. We propose, in particular, an algorithm which entails, at each step, projecting onto a suitably chosen…

Optimization and Control · Mathematics 2013-04-03 Andrzej Cegielski , Aviv Gibali , Simeon Reich , Rafał Zalas

We introduce an alternative approach for constrained mathematical programming problems. It rests on two main aspects: an efficient way to compute optimal solutions for unconstrained problems, and multipliers regarded as variables for a…

Optimization and Control · Mathematics 2015-10-27 Pablo Pedregal

In this paper, we adapt proximal incremental aggregated gradient methods to saddle point problems, which is motivated by decoupling linear transformations in regularized empirical risk minimization models. First, the Primal-Dual Proximal…

Optimization and Control · Mathematics 2019-11-14 Zhou Xianchen , Peng Wei , Wang Hongxia

In this paper, we study federated optimization for solving stochastic variational inequalities (VIs), a problem that has attracted growing attention in recent years. Despite substantial progress, a significant gap remains between existing…

Machine Learning · Computer Science 2026-02-11 Guanghui Wang , Satyen Kale

The extragradient (EG), introduced by G. M. Korpelevich in 1976, is a well-known method to approximate solutions of saddle-point problems and their extensions such as variational inequalities and monotone inclusions. Over the years,…

Optimization and Control · Mathematics 2023-03-31 Quoc Tran-Dinh