English
Related papers

Related papers: An Inexact Spingarn's Partial Inverse Method with …

200 papers

In this paper we propose accelerated gradient descent schemes for convex optimization problems in Hilbert space. We consider inexact oracle case.

Optimization and Control · Mathematics 2019-10-16 Alexander Gasnikov , Sergey Kabanikhin , Ahmed Mohammed , Maxim Shishlenin

A constrained optimization problem is primal infeasible if its constraints cannot be satisfied, and dual infeasible if the constraints of its dual problem cannot be satisfied. We propose a novel iterative method, named proportional-integral…

Optimization and Control · Mathematics 2021-09-14 Yue Yu , Ufuk Topcu

We propose a method for solving constrained fixed point problems involving compositions of Lipschitz pseudo contractive and firmly nonexpansive operators in Hilbert spaces. Each iteration of the method uses separate evaluations of these…

Optimization and Control · Mathematics 2011-01-10 Luis M. Briceño-Arias

Recently, Krukier et al. [Generalized skew-Hermitian triangular splitting iteration methods for saddle-point linear systems, Numer. Linear Algebra Appl. 21 (2014) 152-170] proposed an efficient generalized skew-Hermitian triangular…

Numerical Analysis · Mathematics 2014-02-25 Yan Dou , Ai-Li Yang , Yu-Jiang Wu

Solving inverse problems, such as parameter estimation and optimal control, is a vital part of science. Many experiments repeatedly collect data and rely on machine learning algorithms to quickly infer solutions to the associated inverse…

Machine Learning · Computer Science 2022-10-14 Philipp Holl , Vladlen Koltun , Nils Thuerey

This paper studies the iteration-complexity of a new primal-dual algorithm based on Rockafellar's proximal method of multipliers (PMM) for solving smooth convex programming problems with inequality constraints. In each step, either a step…

Optimization and Control · Mathematics 2016-02-23 M. Marques Alves , R. D. C. Monteiro , Benar F. Svaiter

In this paper we present a convergence rate analysis of inexact variants of several randomized iterative methods. Among the methods studied are: stochastic gradient descent, stochastic Newton, stochastic proximal point and stochastic…

Optimization and Control · Mathematics 2019-03-20 Nicolas Loizou , Peter Richtárik

The inverse of a large matrix can often be accurately approximated by a polynomial of degree significantly lower than the order of the matrix. The iteration polynomial generated by a run of the GMRES algorithm is a good candidate, and its…

Numerical Analysis · Mathematics 2025-02-26 Mark Embree , Joel A. Henningsen , Jordan Jackson , Ronald B. Morgan

This paper proposes a two-point inertial proximal point algorithm to find zero of maximal monotone operators in Hilbert spaces. We obtain weak convergence results and non-asymptotic $O(1/n)$ convergence rate of our proposed algorithm in…

Optimization and Control · Mathematics 2022-07-21 Olaniyi S. Iyiola , Yekini Shehu

Sparsity-constrained optimization underlies many problems in signal processing, statistics, and machine learning. State-of-the-art hard-thresholding (HT) algorithms rely on an appropriately selected continuous step-size parameter to ensure…

Machine Learning · Statistics 2026-05-13 Jin Zhu , Junxian Zhu , Zezhi Wang , Borui Tang , Hongmei Lin , Xueqin Wang

A cumbersome operation in numerical analysis and linear algebra, optimization, machine learning and engineering algorithms; is inverting large full-rank matrices which appears in various processes and applications. This has both numerical…

Numerical Analysis · Mathematics 2022-06-24 Neophytos Charalambides , Mert Pilanci , Alfred O. Hero

We consider an inertial primal-dual fixed point algorithm (IPDFP) to compute the minimizations of the following Problem (1.1). This is a full splitting approach, in the sense that the nonsmooth functions are processed individually via their…

Optimization and Control · Mathematics 2016-04-20 Meng Wen , Yu-Chao Tang , Jigen Peng

In this paper we analyze a class of nonconvex optimization problem from the viewpoint of abstract convexity. Using the respective generalizations of the subgradient we propose an abstract notion proximal operator and derive a number of…

Optimization and Control · Mathematics 2024-02-29 Ewa Bednarczuk , Dirk Lorenz , The Hung Tran

We introduce a new system of split variational inequality problems which is a natural extension of split variational inequality problem in semi-inner product spaces. We use the retraction technique to propose an iterative algorithm for…

Functional Analysis · Mathematics 2017-01-20 K. R. Kazmi , Mohd Furkan

In order to solve tasks like uncertainty quantification or hypothesis tests in Bayesian imaging inverse problems, we often have to draw samples from the arising posterior distribution. For the usually log-concave but high-dimensional…

Computation · Statistics 2025-01-23 Matthias J. Ehrhardt , Lorenz Kuger , Carola-Bibiane Schönlieb

Conic optimization is the minimization of a convex quadratic function subject to conic constraints. We introduce a novel first-order method for conic optimization, named \emph{extrapolated proportional-integral projected gradient method…

Optimization and Control · Mathematics 2022-06-27 Yue Yu , Purnanand Elango , Behçet Açıkmeşe , Ufuk Topcu

This paper establishes the iteration-complexity of an inner accelerated inexact proximal augmented Lagrangian (IAIPAL) method for solving linearly-constrained smooth nonconvex composite optimization problems that is based on the classical…

Optimization and Control · Mathematics 2022-06-15 Jefferson G. Melo , Renato D. C. Monteiro , Weiwei Kong

In this paper we study the pseudomonotone equilibrium problem. We consider a new inertial condition for the subgradient extragradient method with self-adaptive step size for approximating a solution of the equilibrium problem in a real…

Optimization and Control · Mathematics 2023-11-01 Chinedu Izuchukwu , Grace Ogwo , Bertin Zinsou

We show that the herding procedure of Welling (2009) takes exactly the form of a standard convex optimization algorithm--namely a conditional gradient algorithm minimizing a quadratic moment discrepancy. This link enables us to invoke…

Machine Learning · Computer Science 2012-09-12 Francis Bach , Simon Lacoste-Julien , Guillaume Obozinski

This paper is devoted to general nonconvex problems of multiobjective optimization in Hilbert spaces. Based on Mordukhovich's limiting subgradients, we define a new notion of Pareto critical points for such problems, establish necessary…

Optimization and Control · Mathematics 2024-03-18 G. C. Bento , J. X. Cruz Neto , J. O. Lopes , B. S. Mordukhovich , P. R. Silva Filho