English
Related papers

Related papers: Projection Methods: An Annotated Bibliography of B…

200 papers

This paper considers a conceptual version of a convex optimization algorithm whic is based on replacing a convex optimization problem with the root-finding problem for the approximate sub-differential mapping which is solved by repeated…

Optimization and Control · Mathematics 2018-06-18 Evgeni Nurminski

In this work, we study a novel class of projection-based algorithms for linearly constrained problems (LCPs) which have a lot of applications in statistics, optimization, and machine learning. Conventional primal gradient-based methods for…

Optimization and Control · Mathematics 2021-01-06 Xiang Li , Zhihua Zhang

The projected subgradient method for constrained minimization repeatedly interlaces subgradient steps for the objective function with projections onto the feasible region, which is the intersection of closed and convex constraints sets, to…

Optimization and Control · Mathematics 2013-08-21 Yair Censor , Ran Davidi , Gabor T. Herman , Reinhard W. Schulte , Luba Tetruashvili

Iterative algorithms aimed at solving some problems are discussed. For certain problems, such as finding a common point in the intersection of a finite number of convex sets, there often exist iterative algorithms that impose very little…

Optimization and Control · Mathematics 2010-09-28 Y. Censor , R. Davidi , G. T. Herman

Beginning with the projectively invariant method for linear programming, interior point methods have led to powerful algorithms for many difficult computing problems, in combinatorial optimization, logic, number theory and non-convex…

Numerical Analysis · Computer Science 2014-12-11 Narendra Karmarkar

A new exact projective penalty method is proposed for the equivalent reduction of constrained optimization problems to nonsmooth unconstrained ones. In the method, the original objective function is extended to infeasible points by summing…

Optimization and Control · Mathematics 2023-12-05 Vladimir Norkin

Convex optimizers have known many applications as differentiable layers within deep neural architectures. One application of these convex layers is to project points into a convex set. However, both forward and backward passes of these…

Machine Learning · Computer Science 2020-11-16 Riad Akrour , Asma Atamna , Jan Peters

A new deconvolution algorithm based on orthogonal projections onto the epigraph set of a convex cost function is presented. In this algorithm, the dimension of the minimization problem is lifted by one and sets corresponding to the cost…

Data Structures and Algorithms · Computer Science 2014-02-25 Mohammad Tofighi , Alican Bozkurt , A. Enis Cetin

We consider applications involving a large set of instances of projecting points to polytopes. We develop an intuition guided by theoretical and empirical analysis to show that when these instances follow certain structures, a large…

Artificial Intelligence · Computer Science 2022-01-07 Rohan Ramanath , S. Sathiya Keerthi , Yao Pan , Konstantin Salomatin , Kinjal Basu

Variable projection solves structured optimization problems by completely minimizing over a subset of the variables while iterating over the remaining variables. Over the last 30 years, the technique has been widely used, with empirical and…

Optimization and Control · Mathematics 2020-11-23 Tristan van Leeuwen , Aleksandr Aravkin

Finding a point in the intersection of a collection of closed convex sets, that is the convex feasibility problem, represents the main modeling strategy for many computational problems. In this paper we analyze new stochastic reformulations…

Optimization and Control · Mathematics 2018-01-16 Ion Necoara , Peter Richtarik , Andrei Patrascu

Within the realm of industrial technology, optimization methods play a pivotal role and are extensively applied across various sectors, including transportation engineering, robotics, and machine learning. With the surge in data volumes,…

Optimization and Control · Mathematics 2024-04-25 Han Long

Methods for Projection Pursuit aim to facilitate the visual exploration of high-dimensional data by identifying interesting low-dimensional projections. A major challenge is the design of a suitable quality metric of projections, commonly…

Machine Learning · Computer Science 2015-11-30 Tijl De Bie , Jefrey Lijffijt , Raul Santos-Rodriguez , Bo Kang

We study the projection onto the set of feasible inputs and the set of feasible solutions of a polynomial optimisation problem (POP). Our motivation is increasing the robustness of solvers for POP: Without a priori guarantees of feasibility…

Optimization and Control · Mathematics 2019-09-18 Claudio Gambella , Jakub Marecek , Martin Mevissen

Projection methods aim to reduce the dimensionality of the optimization instance, thereby improving the scalability of high-dimensional problems. Recently, Sakaue and Oki proposed a data-driven approach for linear programs (LPs), where the…

Optimization and Control · Mathematics 2025-11-18 Anh Tuan Nguyen , Viet Anh Nguyen

Projecting a vector onto a simplex is a well-studied problem that arises in a wide range of optimization problems. Numerous algorithms have been proposed for determining the projection; however, the primary focus of the literature has been…

Optimization and Control · Mathematics 2023-10-11 Yongzheng Dai , Chen Chen

We propose algorithms and software for computing projections onto the intersection of multiple convex and non-convex constraint sets. The software package, called SetIntersectionProjection, is intended for the regularization of inverse…

Mathematical Software · Computer Science 2019-03-08 Bas Peters , Felix J. Herrmann

Traditional algorithms for stochastic optimization require projecting the solution at each iteration into a given domain to ensure its feasibility. When facing complex domains, such as positive semi-definite cones, the projection operation…

Machine Learning · Computer Science 2013-04-03 Lijun Zhang , Tianbao Yang , Rong Jin , Xiaofei He

The method of periodic projections consists in iterating projections onto $m$ closed convex subsets of a Hilbert space according to a periodic sweeping strategy. In the presence of $m\geq 3$ sets, a long-standing question going back to the…

Functional Analysis · Mathematics 2026-02-17 J. -B. Baillon , P. L. Combettes , R. Cominetti

Random projection (RP) is a classical technique for reducing storage and computational costs. We analyze RP-based approximations of convex programs, in which the original optimization problem is approximated by the solution of a…

Information Theory · Computer Science 2014-04-30 Mert Pilanci , Martin J. Wainwright