English
Related papers

Related papers: Finite Termination of a Generalized Perceptron Alg…

200 papers

The graduated optimization approach, also known as the continuation method, is a popular heuristic to solving non-convex problems that has received renewed interest over the last decade. Despite its popularity, very little is known in terms…

Machine Learning · Computer Science 2015-07-28 Elad Hazan , Kfir Y. Levy , Shai Shalev-Shwartz

Qualitative and quantitative aspects for variational inequalities governed by strongly pseudomonotone operators on Hilbert space are investigated in this paper. First, we establish a global error bound for the solution set of the given…

Optimization and Control · Mathematics 2020-10-07 Pham Tien Kha , Pham Duy Khanh

We prove minimax theorems for lower semicontinuous functions defined on a Hilbert space. The main tool is the theory of $\Phi$-convex functions and sufficient and necessary conditions for the minimax equality to hold for $\Phi$-convex…

Optimization and Control · Mathematics 2016-06-29 Ewa M. Bednarczuk , Monika Syga

We propose an implicit iterative algorithm for an exact penalty method arising from inequality constrained optimization problems. A rapidly convergent fixed point method is developed for a regularized penalty functional. The applicability…

Optimization and Control · Mathematics 2012-10-05 Kazufumi Ito , Tomoya Takeuchi

In the framework of abstract linear inverse problems in infinitedimensional Hilbert space we discuss generic convergence behaviours of approximate solutions determined by means of general projection methods, namely outside the standard…

Numerical Analysis · Mathematics 2021-02-22 Noe Caruso , Alessandro Michelangeli , Paolo Novati

In this paper we consider the computation of approximate solutions for inverse problems in Hilbert spaces. In order to capture the special feature of solutions, non-smooth convex functions are introduced as penalty terms. By exploiting the…

Numerical Analysis · Mathematics 2015-06-18 Qinian Jin , Xiliang Lu

While classic work in convex-concave min-max optimization relies on average-iterate convergence results, the emergence of nonconvex applications such as training Generative Adversarial Networks has led to renewed interest in last-iterate…

Optimization and Control · Mathematics 2019-10-29 Jacob Abernethy , Kevin A. Lai , Andre Wibisono

This paper combines two ingredients in order to get a rather surprising result on one of the most studied, elegant and powerful tools for solving convex feasibility problems, the method of alternating projections (MAP). Going back to names…

Optimization and Control · Mathematics 2021-11-11 Roger Behling , Yunier Bello-Cruz , Luiz-Rafael Santos

Large scale optimization problems are ubiquitous in machine learning and data analysis and there is a plethora of algorithms for solving such problems. Many of these algorithms employ sub-sampling, as a way to either speed up the…

Optimization and Control · Mathematics 2016-02-29 Farbod Roosta-Khorasani , Michael W. Mahoney

We revisit the classical dual ascent algorithm for minimization of convex functionals in the presence of linear constraints, and give convergence results which apply even for non-convex functionals. We describe limit points in terms of the…

Optimization and Control · Mathematics 2016-09-22 Fredrik Andersson , Marcus Carlsson , Carl Olsson

Machine learning approaches relying on such criteria as adversarial robustness or multi-agent settings have raised the need for solving game-theoretic equilibrium problems. Of particular relevance to these applications are methods targeting…

Machine Learning · Computer Science 2023-10-27 Xufeng Cai , Ahmet Alacaoglu , Jelena Diakonikolas

We give properties of strict pseudocontractions and demicontractions defined on a Hilbert space, which constitute wide classes of operators that arise in iterative methods for solving fixed point problems. In particular, we give necessary…

Optimization and Control · Mathematics 2023-07-17 Andrzej Cegielski

Composite optimization problems, where the sum of a smooth and a merely lower semicontinuous function has to be minimized, are often tackled numerically by means of proximal gradient methods as soon as the lower semicontinuous part of the…

Optimization and Control · Mathematics 2022-07-05 Christian Kanzow , Patrick Mehlitz

The classical convex feasibility problem in a finite dimensional Euclidean space is studied in the present paper. We are interested in two cases. First, we assume to know how to compute an exact project onto one of the sets involved and the…

Optimization and Control · Mathematics 2019-12-10 R. Díaz Millán , O. P. Ferreira , L. F. Prudente

In this paper, we design a new iterative algorithm for solving pseudomonotone equilibrium problems in real Hilbert spaces. The advantage of our algorithm is that it requires only one strongly convex programming problem at each iteration.…

Optimization and Control · Mathematics 2018-04-06 Nguyen The Vinh

The matrix rank minimization problem has applications in many fields such as system identification, optimal control, low-dimensional embedding, etc. As this problem is NP-hard in general, its convex relaxation, the nuclear norm minimization…

Optimization and Control · Mathematics 2011-01-04 Donald Goldfarb , Shiqian Ma

This paper presents an algorithm for approximately minimizing a convex function in simple, not necessarily bounded convex domains, assuming only that function values and subgradients are available. No global information about the objective…

Optimization and Control · Mathematics 2014-02-06 Arnold Neumaier

The objective of this research is to explore a convex feasibility problem, which consists of a monotone variational inequality problem and a fixed point problem. We introduce four inertial extragradient algorithms that are motivated by the…

Optimization and Control · Mathematics 2021-07-27 Bing Tan , Jingjing Fan , Xiaolong Qin

We introduce and analyze an abstract algorithm that aims to find the projection onto a closed convex subset of a Hilbert space. When specialized to the fixed point set of a quasi nonexpansive mapping, the required sufficient condition…

Functional Analysis · Mathematics 2012-11-08 Heinz H. Bauschke , Jiawei Chen , Xianfu Wang

We introduce a relaxed-projection splitting algorithm for solving variational inequalities in Hilbert spaces for the sum of nonsmooth maximal monotone operators, where the feasible set is defined by a nonlinear and nonsmooth continuous…

Optimization and Control · Mathematics 2015-12-31 J. Y. Bello Cruz , R. Diaz Millan