English
Related papers

Related papers: Regularized Extragradient Methods for Solving Equi…

200 papers

Although it is relatively easy to apply, the gradient method often displays a disappointingly slow rate of convergence. Its convergence is specially based on the structure of the matrix of the algebraic linear system, and on the choice of…

Numerical Analysis · Mathematics 2025-06-03 Ibrahima Dione

We describe novel subgradient methods for a broad class of matrix optimization problems involving nuclear norm regularization. Unlike existing approaches, our method executes very cheap iterations by combining low-rank stochastic…

Machine Learning · Computer Science 2012-07-03 Haim Avron , Satyen Kale , Shiva Kasiviswanathan , Vikas Sindhwani

We consider the extragradient method to minimize the sum of two functions, the first one being smooth and the second being convex. Under the Kurdyka-Lojasiewicz assumption, we prove that the sequence produced by the extragradient method…

Optimization and Control · Mathematics 2017-12-14 Trong Phong Nguyen , Edouard Pauwels , Emile Richard , Bruce W. Suter

We show that standard extragradient methods (i.e. mirror prox and dual extrapolation) recover optimal accelerated rates for first-order minimization of smooth convex functions. To obtain this result we provide a fine-grained…

Optimization and Control · Mathematics 2021-07-16 Michael B. Cohen , Aaron Sidford , Kevin Tian

This paper deals with speeding up the convergence of a class of two-step iterative methods for solving linear systems of equations. To implement the acceleration technique, the residual norm associated with computed approximations for each…

Numerical Analysis · Mathematics 2024-04-24 Fatemeh P. A. Beik , Michele Benzi , Mehdi Najafi-Kalyani

In this paper we propose a new method to stabilise non-symmetric indefinite problems. The idea is to solve a forward and an adjoint problem simultaneously using a suitable stabilised finite element method. Both stabilisation of the element…

Numerical Analysis · Mathematics 2013-08-05 Erik Burman

Two algorithms are proposed, analyzed, and tested for solving continuous optimization problems with nonlinear equality constraints. Each is an extension of a stochastic momentum-based method from the unconstrained setting to the setting of…

Optimization and Control · Mathematics 2026-01-21 Qi Wang , Christian Piermarini , Yunlang Zhu , Frank E. Curtis

The aim of this paper is to develop an efficient algorithm for solving a class of unconstrained nondifferentiable convex optimization problems in finite dimensional spaces. To this end we formulate first its Fenchel dual problem and…

Optimization and Control · Mathematics 2012-03-12 Radu Ioan Bot , Christopher Hendrich

We prove existence of strong solutions to a family of some semilinear parabolic free boundary problems by means of elliptic regularization. Existence of solutions is obtained in two steps: we first show some uniform energy estimates and…

Analysis of PDEs · Mathematics 2023-06-12 Alessandro Audrito , Tomás Sanz-Perela

Finding an $\epsilon$-stationary point of a nonconvex function with a Lipschitz continuous Hessian is a central problem in optimization. Regularized Newton methods are a classical tool and have been studied extensively, yet they still face…

Optimization and Control · Mathematics 2025-11-03 Yuhao Zhou , Jintao Xu , Bingrui Li , Chenglong Bao , Chao Ding , Jun Zhu

In this paper, we propose a general extra-gradient scheme for solving monotone variational inequalities (VI), referred to here as Approximation-based Regularized Extra-gradient method (ARE). The first step of ARE solves a VI subproblem with…

Optimization and Control · Mathematics 2022-10-11 Kevin Huang , Shuzhong Zhang

We use convex relaxation techniques to provide a sequence of solutions to the matrix completion problem. Using the nuclear norm as a regularizer, we provide simple and very efficient algorithms for minimizing the reconstruction error…

Machine Learning · Statistics 2009-06-12 Rahul Mazumder , Trevor Hastie , Rob Tibshirani

We study a bilevel variational inequality problem where the feasible set is itself the solution set of another variational inequality. Motivated by the difficulty of computing projections onto such sets, we consider a regularized…

Optimization and Control · Mathematics 2025-07-23 M. Marques Alves , Kangming Chen , Ellen H. Fukuda

Many inverse problems are concerned with the estimation of non-negative parameter functions. In this paper, in order to obtain non-negative stable approximate solutions to ill-posed linear operator equations in a Hilbert space setting, we…

Numerical Analysis · Mathematics 2020-02-21 Ye Zhang , Bernd Hofmann

Low rank approximation is a commonly occurring problem in many computer vision and machine learning applications. There are two common ways of optimizing the resulting models. Either the set of matrices with a given rank can be explicitly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Marcus Valtonen Örnhag , Carl Olsson , Anders Heyden

Discontinuity with respect to data perturbations is common in algebraic computation where solutions are often highly sensitive. Such problems can be modeled as solving systems of equations at given data parameters. By appending auxiliary…

Numerical Analysis · Mathematics 2021-02-17 Zhonggang Zeng

In this paper, is introduced a new proposal of resolvent for equilibrium problems in terms of the Busemann's function. A great advantage of this new proposal is that, in addition to be a natural extension of the proposal in the linear…

Optimization and Control · Mathematics 2021-11-09 G. C. Bento , J. X. Cruz Neto , I. D. L. Melo

In this paper, we introduce a new method for solving variational inequality problems with monotone and Lipschitz-continuous mapping in Hilbert space. The iterative process is based on two well-known projection method and the hybrid (or…

Optimization and Control · Mathematics 2015-01-30 Yu. V. Malitsky , V. V. Semenov

We present a novel method for mixed-integer optimization problems with multivariate and Lipschitz continuous nonlinearities. In particular, we do not assume that the nonlinear constraints are explicitly given but that we can only evaluate…

Optimization and Control · Mathematics 2023-03-22 Julia Grübel , Richard Krug , Martin Schmidt , Winnifried Wollner

This paper introduces a subgradient extragradient algorithm with a conjugate gradient-type direction to solve pseudomonotone variational inequality problems in Hilbert spaces. The algorithm features a self-adaptive strategy that eliminates…

Optimization and Control · Mathematics 2025-05-07 Ibrahim Arzuka , Parin Chaipunya , Poom Kumam
‹ Prev 1 3 4 5 6 7 10 Next ›