English
Related papers

Related papers: A Simple proof for Imnang's algorithms

200 papers

We propose a relaxation-based approximate inference algorithm that samples near-MAP configurations of a binary pairwise Markov random field. We experiment on MAP inference tasks in several restricted Boltzmann machines. We also use our…

Machine Learning · Statistics 2014-01-03 Sida I. Wang , Roy Frostig , Percy Liang , Christopher D. Manning

While classic work in convex-concave min-max optimization relies on average-iterate convergence results, the emergence of nonconvex applications such as training Generative Adversarial Networks has led to renewed interest in last-iterate…

Optimization and Control · Mathematics 2019-10-29 Jacob Abernethy , Kevin A. Lai , Andre Wibisono

In this work, we state a general conjecture on the solvability of optimization problems via algorithms with linear convergence guarantees. We make a first step towards examining its correctness by fully characterizing the problems that are…

Optimization and Control · Mathematics 2024-06-27 Foivos Alimisis

In this paper, a strong convergence theorem for asymptotically nonexpansive mappings in a uniformly convex and smooth Banach space is proved by using metric projections. This theorem extends and improves the recent strong convergence…

Functional Analysis · Mathematics 2011-12-01 Hossein Dehghan

We use a unified framework to summarize sixteen randomized iterative methods including Kaczmarz method, coordinate descent method, etc. Some new iterative schemes are given as well. Some relationships with \textsc{mg} and \textsc{ddm} are…

Numerical Analysis · Mathematics 2017-09-01 Hua Xiang , Lin Zhang

Combining classical arguments for the analysis of the simulated annealing algorithm with the more recent hypocoercive method of distorted entropy, we prove the convergence for large time of the kinetic Langevin annealing with logarithmic…

Probability · Mathematics 2017-08-01 Pierre Monmarché

This paper discusses a special kind of convex constrained optimization problem, whose constraints consist of box inequalities and linear equalities. For this problem, in addition to general optimization algorithms such as exact penalty…

Optimization and Control · Mathematics 2020-04-21 Yue Sun

In this paper we propose a new iteration process, called the K iteration process, for approximation of fixed points. We show that our iteration process is faster than the existing leading iteration processes like Picard-S iteration process,…

Functional Analysis · Mathematics 2019-02-26 Nawab Hussain , Kifayat Ullah , Muhammad Arshad

We consider the exact continuous relaxation model of matrix rank minimization problem proposed by Yu and Zhang (Comput.Optim.Appl. 1-20, 2022). Motivated by the inertial techinique, we propose a general inertial smoothing proximal gradient…

Optimization and Control · Mathematics 2022-04-18 Jie Zhang , Xinmin Yang

A wide variety of different (fixed-point) iterative methods for the solution of nonlinear equations exists. In this work we will revisit a unified iteration scheme in Hilbert spaces from our previous work that covers some prominent…

Numerical Analysis · Mathematics 2019-05-17 Pascal Heid , Thomas P. Wihler

We shall first study summability of families in normed spaces indexed with well ordered sets of real numbers extended by infinity. Obtained results and a generalized iteration method are applied to derive necessary and sufficient conditions…

Classical Analysis and ODEs · Mathematics 2013-10-21 Seppo Heikkilä

In this paper we prove the weak and strong convergence of the implicit iterative process with errors to a common fixed point of a finite family $\{T_j\}_{i=1}^N$ of asymptotically quasi $I_j-$nonexpansive mappings as well as a family of…

Functional Analysis · Mathematics 2010-10-18 Farrukh Mukhamedov , Mansoor Saburov

We propose a novel continuous-time algorithm for inequality-constrained convex optimization inspired by proportional-integral control. Unlike the popular primal-dual gradient dynamics, our method includes a proportional term to control the…

Optimization and Control · Mathematics 2024-09-12 V. Cerone , S. M. Fosson , S. Pirrera , D. Regruto

In the iterative algorithm recently proposed by Waxman for solving eigenvalue problems, we point out that the convergence rate may be improved. For many non-singular symmetric potentials which vanish asymptotically, a simple analytical…

Quantum Physics · Physics 2009-11-13 W. A. Berger , H. G. Miller

In this paper, we explain a new Iterative Method-Fixed Point and develop its convergence theory for finding approximate solutions of nonlinear equations in the setting of Banach spaces. First, we discuss the convergence analysis of our…

General Mathematics · Mathematics 2022-05-10 Nikos Mantzakouras , Eteri Biragova

We develop a novel, fundamental and surprisingly simple randomized iterative method for solving consistent linear systems. Our method has six different but equivalent interpretations: sketch-and-project, constrain-and-approximate, random…

Numerical Analysis · Mathematics 2016-01-07 Robert M. Gower , Peter Richtárik

Variational inequality problems allow for capturing an expansive class of problems, including convex optimization problems, convex Nash games and economic equilibrium problems, amongst others. Yet in most practical settings, such problems…

Optimization and Control · Mathematics 2017-02-17 Uma V. Ravat , Uday V. Shanbhag

In this study, we introduce a new iterative processes to approximate common fixed points of an infinite family of quasi-nonexpansive mappings and obtain a strongly convergent iterative sequence to the common fixed points of these mappings…

Functional Analysis · Mathematics 2015-02-24 K. Dogan , V. Karakaya

The Past Extragradient (PEG) [Popov, 1980] method, also known as the Optimistic Gradient method, has known a recent gain in interest in the optimization community with the emergence of variational inequality formulations for machine…

Optimization and Control · Mathematics 2022-11-01 Eduard Gorbunov , Adrien Taylor , Gauthier Gidel

The article deals with gradient-like iterative methods for solving nonlinear operator equations on Hilbert and Banach spaces. The authors formulate a general principle of studying such methods. This principle allows to formulate simple…

Functional Analysis · Mathematics 2008-09-09 O. N. Evkhuta , P. P. Zabreiko