English
Related papers

Related papers: Local Linear Convergence of Approximate Projection…

200 papers

We consider the method of alternating projections for finding a point in the intersection of two closed sets, possibly nonconvex. Assuming only the standard transversality condition (or a weaker version thereof), we prove local linear…

Optimization and Control · Mathematics 2016-08-12 D. Drusvyatskiy , A. D. Ioffe , A. S. Lewis

We consider the problem of minimizing a convex function over the intersection of finitely many simple sets which are easy to project onto. This is an important problem arising in various domains such as machine learning. The main difficulty…

Optimization and Control · Mathematics 2017-10-19 Achintya Kundu , Francis Bach , Chiranjib Bhattacharyya

We establish efficient approximate counting algorithms for several natural problems in local lemma regimes. In particular, we consider the probability of intersection of events and the dimension of intersection of subspaces. Our approach is…

Data Structures and Algorithms · Computer Science 2025-12-12 Ryan L. Mann , Gabriel Waite

Equivariance is a powerful inductive bias in neural networks, improving generalisation and physical consistency. Recently, however, non-equivariant models have regained attention, due to their better runtime performance and imperfect…

Machine Learning · Computer Science 2026-05-27 Torben Berndt , Jan Stühmer

Iterative algorithms aimed at solving some problems are discussed. For certain problems, such as finding a common point in the intersection of a finite number of convex sets, there often exist iterative algorithms that impose very little…

Optimization and Control · Mathematics 2010-09-28 Y. Censor , R. Davidi , G. T. Herman

Regularisation theory in Banach spaces, and non--norm-squared regularisation even in finite dimensions, generally relies upon Bregman divergences to replace norm convergence. This is comparable to the extension of first-order optimisation…

Optimization and Control · Mathematics 2021-03-19 Tuomo Valkonen

We consider a statistical inverse learning problem, where we observe the image of a function $f$ through a linear operator $A$ at i.i.d. random design points $X_i$, superposed with an additive noise. The distribution of the design points is…

Machine Learning · Statistics 2016-04-15 Gilles Blanchard , Nicole Mücke

This paper presents a fast spectral unmixing algorithm based on Dykstra's alternating projection. The proposed algorithm formulates the fully constrained least squares optimization problem associated with the spectral unmixing task as an…

Computer Vision and Pattern Recognition · Computer Science 2015-05-08 Qi Wei , Jose Bioucas-Dias , Nicolas Dobigeon , Jean-Yves Tourneret

In this paper we present a new iterative projection method for finding the closest point in the intersection of convex sets to any arbitrary point in a Hilbert space. This method, termed AAMR for averaged alternating modified reflections,…

Optimization and Control · Mathematics 2017-09-06 Francisco J. Aragón Artacho , Rubén Campoy

This paper considers a conceptual version of a convex optimization algorithm whic is based on replacing a convex optimization problem with the root-finding problem for the approximate sub-differential mapping which is solved by repeated…

Optimization and Control · Mathematics 2018-06-18 Evgeni Nurminski

We establish sufficient conditions for finite convergence of the alternating projections method for two non-intersecting and potentially nonconvex sets. Our results are based on a generalization of the concept of intrinsic transversality,…

Optimization and Control · Mathematics 2021-02-18 Hoa T. Bui , Ryan Loxton , Asghar Moeini

We study the alternating algorithm for the computation of the metric projection onto the closed sum of two closed subspaces in uniformly convex and uniformly smooth Banach spaces. For Banach spaces which are convex and smooth of power type,…

Functional Analysis · Mathematics 2020-10-09 Christian Bargetz , Emir Medjic

Many applications in vision require estimation of thin structures such as boundary edges, surfaces, roads, blood vessels, neurons, etc. Unlike most previous approaches, we simultaneously detect and delineate thin structures with sub-pixel…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Dmitrii Marin , Yuri Boykov , Yuchen Zhong

There exist efficient algorithms to project a point onto the intersection of a convex cone and an affine subspace. Those conic projections are in turn the work-horse of a range of algorithms in conic optimization, having a variety of…

Optimization and Control · Mathematics 2011-03-09 Didier Henrion , Jérôme Malick

Optimization on Riemannian manifolds widely arises in eigenvalue computation, density functional theory, Bose-Einstein condensates, low rank nearest correlation, image registration, and signal processing, etc. We propose an adaptive…

Optimization and Control · Mathematics 2017-08-08 Jiang Hu , Andre Milzarek , Zaiwen Wen , Yaxiang Yuan

We propose an adaptive regularization scheme in a variational framework where a convex composite energy functional is optimized. We consider a number of imaging problems including denoising, segmentation and motion estimation, which are…

Computer Vision and Pattern Recognition · Computer Science 2017-03-01 Byung-Woo Hong , Ja-Keoung Koo , Hendrik Dirks , Martin Burger

We tackle the problem of building adaptive estimation procedures for ill-posed inverse problems. For general regularization methods depending on tuning parameters, we construct a penalized method that selects the optimal smoothing sequence…

Statistics Theory · Mathematics 2008-07-31 Jean-Michel Loubes , Carenne Ludeña

This paper introduces a regularized projection matrix approximation framework designed to recover cluster information from the affinity matrix. The model is formulated as a projection approximation problem, incorporating an entry-wise…

Machine Learning · Computer Science 2024-11-08 Zheng Zhai , Jialu Xu , Mingxin Wu , Xiaohui Li

A regularization algorithm allowing random noise in derivatives and inexact function values is proposed for computing approximate local critical points of any order for smooth unconstrained optimization problems. For an objective function…

Optimization and Control · Mathematics 2021-04-07 S. Bellavia , G. Gurioli , B. Morini , Ph. L. Toint

In this paper, we proposed an alternating projection based algorithm to solve a class of distributed MIN-MAX convex optimization problems. We firstly transform this MINMAX problem into the problem of searching for the minimum distance…

Systems and Control · Computer Science 2014-06-11 Chunhe Hu , Zongji Chen