English
Related papers

Related papers: Randomized projection methods for convex feasibili…

200 papers

The convex feasibility problem asks to find a point in the intersection of a collection of nonempty closed convex sets. This problem is of basic importance in mathematics and the physical sciences, and projection (or splitting) methods…

Optimization and Control · Mathematics 2013-12-03 Heinz H. Bauschke , Francesco Iorio , Valentin R. Koch

The classical convex feasibility problem in a finite dimensional Euclidean space is studied in the present paper. We are interested in two cases. First, we assume to know how to compute an exact project onto one of the sets involved and the…

Optimization and Control · Mathematics 2019-12-10 R. Díaz Millán , O. P. Ferreira , L. F. Prudente

We develop a family of reformulations of an arbitrary consistent linear system into a stochastic problem. The reformulations are governed by two user-defined parameters: a positive definite matrix defining a norm, and an arbitrary discrete…

Numerical Analysis · Mathematics 2020-01-27 Peter Richtárik , Martin Takáč

Quasi-convex optimization acts a pivotal part in many fields including economics and finance; the subgradient method is an effective iterative algorithm for solving large-scale quasi-convex optimization problems. In this paper, we…

Optimization and Control · Mathematics 2019-10-25 Yaohua Hu , Jiawen Li , Carisa Kwok Wai Yu

Convex approximation sets for multiobjective optimization problems are a well-studied relaxation of the common notion of approximation sets. Instead of approximating each image of a feasible solution by the image of some solution in the…

Optimization and Control · Mathematics 2023-06-13 Stephan Helfrich , Stefan Ruzika , Clemens Thielen

Convergence of a projected stochastic gradient algorithm is demonstrated for convex objective functionals with convex constraint sets in Hilbert spaces. In the convex case, the sequence of iterates ${u_n}$ converges weakly to a point in the…

Optimization and Control · Mathematics 2019-10-01 Caroline Geiersbach , Georg Pflug

In this two-part paper, we propose a general algorithmic framework for the minimization of a nonconvex smooth function subject to nonconvex smooth constraints. The algorithm solves a sequence of (separable) strongly convex problems and…

Multiagent Systems · Computer Science 2016-01-18 Gesualdo Scutari , Francisco Facchinei , Lorenzo Lampariello , Peiran Song

In this paper we study the convex problem of optimizing the sum of a smooth function and a compactly supported non-smooth term with a specific separable form. We analyze the block version of the generalized conditional gradient method when…

Optimization and Control · Mathematics 2015-09-28 Amir Beck , Edouard Pauwels , Shoham Sabach

In this work, we consider a class of convex optimization problems in a real Hilbert space that can be solved by performing a single projection, i.e., by projecting an infeasible point onto the feasible set. Our results improve those…

Optimization and Control · Mathematics 2024-04-10 Hoa T. Bui , Regina S. Burachik , Evgeni A. Nurminski , Matthew K. Tam

The numerical properties of algorithms for finding the intersection of sets depend to some extent on the regularity of the sets, but even more importantly on the regularity of the intersection. The alternating projection algorithm of von…

Optimization and Control · Mathematics 2018-09-24 D. Russell Luke

Random projections offer an appealing and flexible approach to a wide range of large-scale statistical problems. They are particularly useful in high-dimensional settings, where we have many covariates recorded for each observation. In…

Methodology · Statistics 2019-11-26 Timothy I. Cannings

Random projection (RP) is a classical technique for reducing storage and computational costs. We analyze RP-based approximations of convex programs, in which the original optimization problem is approximated by the solution of a…

Information Theory · Computer Science 2014-04-30 Mert Pilanci , Martin J. Wainwright

This paper investigates projection-free algorithms for stochastic constrained multi-level optimization. In this context, the objective function is a nested composition of several smooth functions, and the decision set is closed and convex.…

Optimization and Control · Mathematics 2024-06-07 Wei Jiang , Sifan Yang , Wenhao Yang , Yibo Wang , Yuanyu Wan , Lijun Zhang

Approximations of optimization problems arise in computational procedures and sensitivity analysis. The resulting effect on solutions can be significant, with even small approximations of components of a problem translating into large…

Optimization and Control · Mathematics 2022-08-10 Johannes O. Royset

In this paper, we study the rate of convergence of the cyclic projection algorithm applied to finitely many basic semi-algebraic convex sets. We establish an explicit convergence rate estimate which relies on the maximum degree of the…

Functional Analysis · Mathematics 2013-11-20 Jonathan M. Borwein , Guoyin Li , Liangjin Yao

Chance constraints are a valuable tool for the design of safe decisions in uncertain environments; they are used to model satisfaction of a constraint with a target probability. However, because of possible non-convexity and non-smoothness,…

Optimization and Control · Mathematics 2021-03-22 Yassine Laguel , Jérôme Malick , Wim Ackooij

The idea of a finite collection of closed sets having "strongly regular intersection" at a given point is crucial in variational analysis. We show that this central theoretical tool also has striking algorithmic consequences. Specifically,…

Optimization and Control · Mathematics 2007-09-04 Adrian Lewis , Russell Luke , Jerome Malick

We propose two novel conditional gradient-based methods for solving structured stochastic convex optimization problems with a large number of linear constraints. Instances of this template naturally arise from SDP-relaxations of…

Machine Learning · Computer Science 2020-07-09 Maria-Luiza Vladarean , Ahmet Alacaoglu , Ya-Ping Hsieh , Volkan Cevher

Two optimization algorithms are proposed for solving a stochastic programming problem for which the objective function is given in the form of the expectation of convex functions and the constraint set is defined by the intersection of…

Optimization and Control · Mathematics 2017-10-09 Hideaki Iiduka

We propose a new asynchronous parallel block-descent algorithmic framework for the minimization of the sum of a smooth nonconvex function and a nonsmooth convex one, subject to both convex and nonconvex constraints. The proposed framework…

Optimization and Control · Mathematics 2018-04-02 Loris Cannelli , Francisco Facchinei , Vyacheslav Kungurtsev , Gesualdo Scutari