English
Related papers

Related papers: The circumcentered-reflection method achieves bett…

200 papers

In this paper, we present a variant of the circumcenter method for the Convex Feasibility Problem (CFP), ensuring finite convergence under a Slater assumption. The method replaces exact projections onto the convex sets with projections onto…

Optimization and Control · Mathematics 2024-10-10 Roger Behling , Yunier Bello-Cruz , Alfredo Iusem , Di Liu , Luiz-Rafael Santos

Generalized alternating projections is an algorithm that alternates relaxed projections onto a finite number of sets to find a point in their intersection. We consider the special case of two linear subspaces, for which the algorithm…

Optimization and Control · Mathematics 2017-03-31 Mattias Fält , Pontus Giselsson

We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function using proximal-gradient methods, where an error is present in the calculation of the gradient of the smooth term or in the proximity…

Machine Learning · Computer Science 2011-12-02 Mark Schmidt , Nicolas Le Roux , Francis Bach

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

The problem of finding a point in the intersection of closed sets can be solved by the method of alternating projections and its variants. It was shown in earlier papers that for convex sets, the strategy of using quadratic programming (QP)…

Optimization and Control · Mathematics 2015-06-30 C. H. Jeffrey Pang

In this paper, we consider the feasibility problem, which aims to find a feasible point for the constraint set $\{x \in \mathbb{R}^n: c(x) = 0\}$ over a possibly non-regular subset $\mathcal{X} \subset \mathbb{R}^n$. Under the constraint…

Optimization and Control · Mathematics 2025-12-01 Nachuan Xiao , Shiwei Wang , Tianyun Tang , Kim-Chuan Toh

We prove global convergence of classical projection algorithms for feasibility problems involving union convex sets, which refer to sets expressible as the union of a finite number of closed convex sets. We present a unified strategy for…

Optimization and Control · Mathematics 2023-07-18 Jan Harold Alcantara , Ching-pei Lee

Most approaches to cross-modal retrieval (CMR) focus either on object-centric datasets, meaning that each document depicts or describes a single object, or on scene-centric datasets, meaning that each image depicts or describes a complex…

Information Retrieval · Computer Science 2023-10-12 Mariya Hendriksen , Svitlana Vakulenko , Ernst Kuiper , Maarten de Rijke

We address the problem of solving mixed random linear equations. We have unlabeled observations coming from multiple linear regressions, and each observation corresponds to exactly one of the regression models. The goal is to learn the…

Machine Learning · Statistics 2020-08-13 Avishek Ghosh , Kannan Ramchandran

The alternating direction method of multipliers (ADMM) algorithm is a powerful and flexible tool for complex optimization problems of the form $\min\{f(x)+g(y) : Ax+By=c\}$. ADMM exhibits robust empirical performance across a range of…

Optimization and Control · Mathematics 2024-02-08 Rina Foygel Barber , Emil Y. Sidky

The idea of a finite collection of closed sets having "strongly regular intersection" at a given point is crucial in variational analysis. We show that this central theoretical tool also has striking algorithmic consequences. Specifically,…

Optimization and Control · Mathematics 2007-09-04 Adrian Lewis , Russell Luke , Jerome Malick

In this paper, we extend the previous convergence results for the generalized alternating projection method applied to subspaces in [arXiv:1703.10547] to hold also for smooth manifolds. We show that the algorithm locally behaves similarly…

Optimization and Control · Mathematics 2024-04-10 Mattias Fält , Pontus Giselsson

We study the robust matrix completion (RMC) problem subject to both sparse outliers and stochastic noise. A non-convex method termed Accelerated Robust Matrix Completion (ARMC) is proposed, which accelerates a prior non-convex approach by…

Information Theory · Computer Science 2026-05-15 Yichen Fu , Tianming Wang , Ke Wei

The convergence of the generalized alternating projection (GAP) algorithm is studied in this paper to solve the compressive sensing problem $\yv = \Amat \xv + \epsilonv$. By assuming that $\Amat\Amat\ts$ is invertible, we prove that GAP…

Information Theory · Computer Science 2015-09-22 Xin Yuan , Hong Jiang , Paul Wilford

Composite adaptive control (CAC) that integrates direct and indirect adaptive control techniques can achieve smaller tracking errors and faster parameter convergence compared with direct and indirect adaptive control techniques. However,…

Systems and Control · Computer Science 2022-07-08 Yongping Pan , Lin Pan , Haoyong Yu

Convergence rates are established for an inexact accelerated alternating direction method of multipliers (I-ADMM) for general separable convex optimization with a linear constraint. Both ergodic and non-ergodic iterates are analyzed.…

Numerical Analysis · Mathematics 2021-07-20 William W. Hager , Hongchao Zhang

Diffusion models have indeed shown great promise in solving inverse problems in image processing. In this paper, we propose a novel, problem-agnostic diffusion model called the maximum a posteriori (MAP)-based guided term estimation method…

Image and Video Processing · Electrical Eng. & Systems 2026-03-10 Pingping Tao , Haixia Liu , Jing Su

RBM-MPC is a computationally efficient variant of Model Predictive Control (MPC) in which the Random Batch Method (RBM) is used to speed up the finite-horizon optimal control problems at each iteration. In this paper, stability and…

Optimization and Control · Mathematics 2024-03-08 Daniël Veldman , Alexandra Borkowski , Enrique Zuazua

The importance of aggregated count data, which is calculated from the data of multiple individuals, continues to increase. Collective Graphical Model (CGM) is a probabilistic approach to the analysis of aggregated data. One of the most…

Machine Learning · Statistics 2021-02-19 Yasunori Akagi , Naoki Marumo , Hideaki Kim , Takeshi Kurashima , Hiroyuki Toda

We introduce and study a geometric modification of the Douglas-Rach\-ford method called the Circumcentered-Douglas-Rachford method. This method iterates by taking the intersection of bisectors of reflection steps for solving certain classes…

Optimization and Control · Mathematics 2020-08-11 Roger Behling , Jose Yunier Bello Cruz , Luiz-Rafael Santos