English
Related papers

Related papers: Linear Convergence of Projection Algorithms

200 papers

This paper introduces a new method of partitioning the solution space of a multi-objective optimisation problem for parallel processing, called Efficient Projection Partitioning. This method projects solutions down into a single dimension,…

Optimization and Control · Mathematics 2017-11-23 William Pettersson , Melih Ozlen

Structured prediction is used in areas such as computer vision and natural language processing to predict structured outputs such as segmentations or parse trees. In these settings, prediction is performed by MAP inference or, equivalently,…

Machine Learning · Statistics 2016-04-28 Ofer Meshi , Mehrdad Mahdavi , Adrian Weller , David Sontag

Matching pursuit algorithms are an important class of algorithms in signal processing and machine learning. We present a blended matching pursuit algorithm, combining coordinate descent-like steps with stronger gradient descent steps, for…

Optimization and Control · Mathematics 2019-11-21 Cyrille W. Combettes , Sebastian Pokutta

This paper addresses constrained smooth saddle-point problems in settings where projection onto the feasible sets is computationally expensive. We bridge the gap between projection-based and projection-free optimization by introducing a…

Optimization and Control · Mathematics 2026-04-02 Khanh-Hung Giang-Tran , Soroosh Shafiee , Nam Ho-Nguyen

Recent advancements in quantum computing and quantum-inspired algorithms have sparked renewed interest in binary optimization. These hardware and software innovations promise to revolutionize solution times for complex problems. In this…

In this paper, we studied the equilibrium problem where the bi-function may be quasiconvex with respect to the second variable and the feasible set is the intersection of a finite number of convex sets. We propose a projection-algorithm,…

Optimization and Control · Mathematics 2020-10-02 Le Hai Yen , Le Dung Muu

We discuss the application of random projections to conic programming: notably linear, second-order and semidefinite programs. We prove general approximation results on feasibility and optimality using the framework of formally real Jordan…

Optimization and Control · Mathematics 2021-01-13 Leo Liberti , Pierre-Louis Poirion , Ky Vu

Recent advances in cutting-plane strategies applied to robust optimization problems show that they are competitive with respect to problem reformulations and interior-point algorithms. However, although its application with polyhedral…

Optimization and Control · Mathematics 2019-04-03 Roberto Mínguez , Víctor Casero-Alonso

In this paper we present a new algorithmic realization of a projection-based scheme for general convex constrained optimization problem. The general idea is to transform the original optimization problem to a sequence of feasibility…

Optimization and Control · Mathematics 2019-11-12 Aviv Gibali , Karl-Heinz Küfer , Daniel Reem , Philipp Süss

A type of iterative orthogonally accumulated projection methods for solving linear system of equations are proposed in this paper. This type of methods are applications of accumulated projection(AP) technique proposed recently by authors.…

Numerical Analysis · Mathematics 2016-08-24 Wujian Peng , Shuhua Zhang

We develop two adaptive discretization algorithms for convex semi-infinite optimization, which terminate after finitely many iterations at approximate solutions of arbitrary precision. In particular, they terminate at a feasible point of…

Optimization and Control · Mathematics 2022-01-14 Jochen Schmid , Miltiadis Poursanidis

The projection algorithm is frequently used in adaptive control and this note presents a detailed analysis of its properties.

Adaptation and Self-Organizing Systems · Physics 2012-10-18 Eugene Lavretsky , Travis E. Gibson

We study a class of projective transformations of spectraplexes associated with self-dual cones and, on this basis, propose a polynomial-time algorithm for convex feasibility problems with positive definite constraints. At each iteration of…

Optimization and Control · Mathematics 2025-06-19 Sergei Chubanov

This thesis derives, tests and applies two linear projection algorithms for machine learning under non-stationarity. The first finds a direction in a linear space upon which a data set is maximally non-stationary. The second aims to…

Machine Learning · Computer Science 2011-10-05 Duncan A. J. Blythe

We propose iterative projection methods for solving square or rectangular consistent linear systems Ax = b. Existing projection methods use sketching matrices (possibly randomized) to generate a sequence of small projected subproblems, but…

Numerical Analysis · Mathematics 2023-12-13 Johannes J. Brust , Michael A. Saunders

Many clustering applications in machine learning and data mining rely on solving metric-constrained optimization problems. These problems are characterized by $O(n^3)$ constraints that enforce triangle inequalities on distance variables…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-30 Cameron Ruggles , Nate Veldt , David F. Gleich

Optimization problems, generalized equations, and the multitude of other variational problems invariably lead to the analysis of sets and set-valued mappings as well as their approximations. We review the central concept of set-convergence…

Optimization and Control · Mathematics 2020-02-25 Johannes O. Royset

Projective splitting is a family of methods for solving inclusions involving sums of maximal monotone operators. First introduced by Eckstein and Svaiter in 2008, these methods have enjoyed significant innovation in recent years, becoming…

Optimization and Control · Mathematics 2020-02-19 Patrick R. Johnstone , Jonathan Eckstein

Omnidirectional (360{\deg}) video has got quite popular because it provides a highly immersive viewing experience. For computer vision algorithms, it poses several challenges, like the special (equirectangular) projection commonly employed…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Hannes Fassold

It is well known that every Chebyshev linear approximation problem can be reduced to a linear program. In this paper we show that conversely every linear program can be reduced to a Chebyshev linear approximation problem.

Optimization and Control · Mathematics 2007-05-23 Leonid N. Vaserstein