English
Related papers

Related papers: Replacing projection on finitely generated convex …

200 papers

We consider the problem of minimizing a convex function over the intersection of finitely many simple sets which are easy to project onto. This is an important problem arising in various domains such as machine learning. The main difficulty…

Optimization and Control · Mathematics 2017-10-19 Achintya Kundu , Francis Bach , Chiranjib Bhattacharyya

The problem of finding a vector with the fewest nonzero elements that satisfies an underdetermined system of linear equations is an NP-complete problem that is typically solved numerically via convex heuristics or nicely-behaved non convex…

Optimization and Control · Mathematics 2012-05-03 Heinz H. Bauschke , D. Russell Luke , Hung M. Phan , Xianfu Wang

We expand the basic geometric elements of the simplex method to linear programs in locally convex topological vector spaces and provide conditions under which the method converges in value to optimality. This setting generalizes many…

Optimization and Control · Mathematics 2026-04-13 Robert L Smith , Christopher Thomas Ryan

The subgradient projection iteration is a classical method for solving a convex inequality. Motivated by works of Polyak and of Crombez, we present and analyze a more general method for finding a fixed point of a cutter, provided that the…

Optimization and Control · Mathematics 2014-08-15 Heinz H. Bauschke , Caifang Wang , Xianfu Wang , Jia Xu

Two new optimization techniques based on projections onto convex space (POCS) framework for solving convex and some non-convex optimization problems are presented. The dimension of the minimization problem is lifted by one and sets…

Optimization and Control · Mathematics 2013-06-14 A. Enis Cetin , Alican Bozkurt , Osman Gunay , Y. Hakan Habiboglu , Kivanc Kose , Ibrahim Onaran , R. A. Sevimli

Parallel and cyclic projection algorithms are proposed for minimizing the sum of a finite family of convex functions over the intersection of a finite family of closed convex subsets of a Hilbert space. These algorithms are of…

Optimization and Control · Mathematics 2019-01-08 Hong-Kun Xu , Vera Roshchina

Generalizing both mixed-integer linear optimization and convex optimization, mixed-integer convex optimization possesses broad modeling power but has seen relatively few advances in general-purpose solvers in recent years. In this paper, we…

Optimization and Control · Mathematics 2017-09-18 Miles Lubin , Emre Yamangil , Russell Bent , Juan Pablo Vielma

Variable order structures model situations in which the comparison between two points depends on a point-to-cone map. In this paper, an inexact projected gradient method for solving smooth constrained vector optimization problems on…

Optimization and Control · Mathematics 2019-08-09 Jose Yunier Bello Cruz , Gemayqzel Bouza Allende

We consider the problem of approximating the solution of variational problems subject to the constraint that the admissible functions must be convex. This problem is at the interface between convex analysis, convex optimization, variational…

Numerical Analysis · Mathematics 2015-03-19 Adam M. Oberman

Optimal packing of objects in containers is a critical problem in various real-life and industrial applications. This paper investigates the two-dimensional packing of convex polygons without rotations, where only translations are allowed.…

Computational Geometry · Computer Science 2023-08-17 Adam Kurpisz , Silvan Suter

We consider the problem of projecting a vector onto the so-called k-capped simplex, which is a hyper-cube cut by a hyperplane. For an n-dimensional input vector with bounded elements, we found that a simple algorithm based on Newton's…

Optimization and Control · Mathematics 2025-02-25 Andersen Ang , Jianzhu Ma , Nianjun Liu , Kun Huang , Yijie Wang

We consider the problem of minimizing a linear function over an affine section of the cone of positive semidefinite matrices, with the additional constraint that the feasible matrix has prescribed rank. When the rank constraint is active,…

Systems and Control · Computer Science 2016-11-22 Simone Naldi

We describe an algorithm that, given any full-rank matrix A having fewer rows than columns, can rapidly compute the orthogonal projection of any vector onto the null space of A, as well as the orthogonal projection onto the row space of A,…

Numerical Analysis · Computer Science 2011-05-26 Vladimir Rokhlin , Mark Tygert

Smooth convex minimization over the unit trace-norm ball is an important optimization problem in machine learning, signal processing, statistics and other fields, that underlies many tasks in which one wishes to recover a low-rank matrix…

Optimization and Control · Mathematics 2020-12-01 Dan Garber

In this paper, we propose a systematic approach for extending first-order optimization algorithms, originally designed for unconstrained strongly convex problems, to handle closed and convex set constraints. We show that the resulting…

Optimization and Control · Mathematics 2026-01-05 Mengmou Li , Ioannis Lestas , Masaaki Nagahara

Projection methods aim to reduce the dimensionality of the optimization instance, thereby improving the scalability of high-dimensional problems. Recently, Sakaue and Oki proposed a data-driven approach for linear programs (LPs), where the…

Optimization and Control · Mathematics 2025-11-18 Anh Tuan Nguyen , Viet Anh Nguyen

We provide a simple and efficient algorithm for computing the Euclidean projection of a point onto the capped simplex---a simplex with an additional uniform bound on each coordinate---together with an elementary proof. Both the MATLAB and…

Machine Learning · Computer Science 2015-03-04 Weiran Wang , Canyi Lu

Approximating a function with a finite series, e.g., involving polynomials or trigonometric functions, is a critical tool in computing and data analysis. The construction of such approximations via now-standard approaches like least squares…

Optimization and Control · Mathematics 2021-08-30 Dihan Dai , Yekaterina Epshteyn , Akil Narayan

The paper considers the minimization of a separable convex function subject to linear ascending constraints. The problem arises as the core optimization in several resource allocation scenarios, and is a special case of an optimization of a…

Optimization and Control · Mathematics 2016-08-30 Akhil P T , Rajesh Sundaresan

Polytopes are the basic finite data structures for convex sets: they appear as feasible regions in linear optimization, as geometric summaries in algorithms, and as random objects in stochastic geometry. A natural geometric question is…

Metric Geometry · Mathematics 2026-03-10 Steven Hoehner