English
Related papers

Related papers: On The Behavior of Subgradient Projections Methods…

200 papers

In this paper, we present a new ellipsoid-type algorithm for solving nonsmooth problems with convex structure. Examples of such problems include nonsmooth convex minimization problems, convex-concave saddle-point problems and variational…

Optimization and Control · Mathematics 2021-06-28 Anton Rodomanov , Yurii Nesterov

Hyperbolic spaces have increasingly been recognized for their outstanding performance in handling data with inherent hierarchical structures compared to their Euclidean counterparts. However, learning in hyperbolic spaces poses significant…

Machine Learning · Computer Science 2024-05-28 Sheng Yang , Peihan Liu , Cengiz Pehlevan

The projected subgradient method for constrained minimization repeatedly interlaces subgradient steps for the objective function with projections onto the feasible region, which is the intersection of closed and convex constraints sets, to…

Optimization and Control · Mathematics 2013-08-21 Yair Censor , Ran Davidi , Gabor T. Herman , Reinhard W. Schulte , Luba Tetruashvili

Projection methods are popular algorithms for iteratively solving feasibility problems in Euclidean or even Hilbert spaces. They employ (selections of) nearest point mappings to generate sequences that are designed to approximate a point in…

Optimization and Control · Mathematics 2019-01-25 Heinz H. Bauschke , Sylvain Gretchko , Walaa M. Moursi

In this paper, we studied the equilibrium problem where the bi-function may be quasiconvex with respect to the second variable and the feasible set is the intersection of a finite number of convex sets. We propose a projection-algorithm,…

Optimization and Control · Mathematics 2020-10-02 Le Hai Yen , Le Dung Muu

Optimization models with non-convex constraints arise in many tasks in machine learning, e.g., learning with fairness constraints or Neyman-Pearson classification with non-convex loss. Although many efficient methods have been developed…

Optimization and Control · Mathematics 2023-03-24 Runchao Ma , Qihang Lin , Tianbao Yang

We present a subgradient method for minimizing non-smooth, non-Lipschitz convex optimization problems. The only structure assumed is that a strictly feasible point is known. We extend the work of Renegar [5] by taking a different…

Optimization and Control · Mathematics 2018-02-28 Benjamin Grimmer

A new exact projective penalty method is proposed for the equivalent reduction of constrained optimization problems to nonsmooth unconstrained ones. In the method, the original objective function is extended to infeasible points by summing…

Optimization and Control · Mathematics 2023-12-05 Vladimir Norkin

We introduce a relaxed-projection splitting algorithm for solving variational inequalities in Hilbert spaces for the sum of nonsmooth maximal monotone operators, where the feasible set is defined by a nonlinear and nonsmooth continuous…

Optimization and Control · Mathematics 2015-12-31 J. Y. Bello Cruz , R. Diaz Millan

In this paper we consider convex optimization problems with stochastic composite objective function subject to (possibly) infinite intersection of constraints. The objective function is expressed in terms of expectation operator over a sum…

Optimization and Control · Mathematics 2024-12-03 Ion Necoara , Nitesh Kumar Singh

We propose randomized subspace gradient methods for high-dimensional constrained optimization. While there have been similarly purposed studies on unconstrained optimization problems, there have been few on constrained optimization problems…

Optimization and Control · Mathematics 2023-07-10 Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

The Euclidean projection onto a convex set is an important problem that arises in numerous constrained optimization tasks. Unfortunately, in many cases, computing projections is computationally demanding. In this work, we focus on…

Optimization and Control · Mathematics 2021-09-22 Ilnura Usmanova , Maryam Kamgarpour , Andreas Krause , Kfir Yehuda Levy

We propose two novel conditional gradient-based methods for solving structured stochastic convex optimization problems with a large number of linear constraints. Instances of this template naturally arise from SDP-relaxations of…

Machine Learning · Computer Science 2020-07-09 Maria-Luiza Vladarean , Ahmet Alacaoglu , Ya-Ping Hsieh , Volkan Cevher

The article is devoted to the development of algorithmic methods ensuring efficient complexity bounds for strongly convex-concave saddle point problems in the case when one of the groups of variables is high-dimensional, and the other is…

Optimization and Control · Mathematics 2022-10-26 Egor Gladin , Ilya Kuruzov , Fedor Stonyakin , Dmitry Pasechnyuk , Mohammad Alkousa , Alexander Gasnikov

In this paper, we propose two algorithms for solving convex optimization problems with linear ascending constraints. When the objective function is separable, we propose a dual method which terminates in a finite number of iterations. In…

Optimization and Control · Mathematics 2014-09-26 Zizhuo Wang

In recent years, important progress has been made in applying methods and techniques of convex optimization to many fields of applications such as location science, engineering, computational statistics, and computer science. In this paper,…

Optimization and Control · Mathematics 2013-12-23 Nguyen Mau Nam , Nguyen Thai An , Han Le

We discuss non-Euclidean deterministic and stochastic algorithms for optimization problems with strongly and uniformly convex objectives. We provide accuracy bounds for the performance of these algorithms and design methods which are…

Optimization and Control · Mathematics 2014-01-09 Anatoli Iouditski , Yuri Nesterov

A common representation of a three dimensional object in computer applications, such as graphics and design, is in the form of a triangular mesh. In many instances, individual or groups of triangles in such representation need to satisfy…

Optimization and Control · Mathematics 2019-04-08 Valentin R. Koch , Hung M. Phan

In this paper, we introduce a stochastic projected subgradient method for weakly convex (i.e., uniformly prox-regular) nonsmooth, nonconvex functions---a wide class of functions which includes the additive and convex composite classes. At a…

Optimization and Control · Mathematics 2018-09-19 Damek Davis , Benjamin Grimmer

Finding a point in the intersection of a collection of closed convex sets, that is the convex feasibility problem, represents the main modeling strategy for many computational problems. In this paper we analyze new stochastic reformulations…

Optimization and Control · Mathematics 2018-01-16 Ion Necoara , Peter Richtarik , Andrei Patrascu