English
Related papers

Related papers: The Block-wise Circumcentered-Reflection Method

200 papers

In this paper, we consider nonconvex decentralised optimisation and learning over a network of distributed agents. We develop an ADMM algorithm based on the Randomised Block Coordinate Douglas-Rachford splitting method which enables agents…

Optimization and Control · Mathematics 2025-07-31 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

Deep learning-based models have demonstrated remarkable success in solving illposed inverse problems; however, many fail to strictly adhere to the physical constraints imposed by the measurement process. In this work, we introduce a…

Machine Learning · Computer Science 2025-05-22 Jorge Bacca

We consider projection algorithms for solving (nonconvex) feasibility problems in Euclidean spaces. Of special interest are the Method of Alternating Projections (MAP) and the Douglas-Rachford or Averaged Alternating Reflection Algorithm…

Optimization and Control · Mathematics 2014-03-17 Robert Hesse , D. Russell Luke

We discuss the problem of projecting a point onto an arbitrary hyperbolicity cone from both theoretical and numerical perspectives. While hyperbolicity cones are furnished with a generalization of the notion of eigenvalues, obtaining closed…

Optimization and Control · Mathematics 2026-03-04 Takayuki Nagano , Bruno F. Lourenço , Akiko Takeda

We report on progress in algorithms for iterative phase retrieval. The theory of convex optimization is used to develop and to gain insight into counterparts for the nonconvex problem of phase retrieval. We propose a relaxation of averaged…

Optimization and Control · Mathematics 2009-11-10 D. Russell Luke

The advent of neural and Gaussian-based radiance field methods have achieved great success in the field of novel view synthesis. However, specular reflection remains non-trivial, as the high frequency radiance field is notoriously difficult…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Keyang Ye , Qiming Hou , Kun Zhou

The Douglas--Rachford method is a splitting method frequently employed for finding zeroes of sums of maximally monotone operators. When the operators in question are normal cones operators, the iterated process may be used to solve…

Optimization and Control · Mathematics 2020-01-28 Scott B. Lindstrom , Brailey Sims

We introduce a new projection-free (Frank-Wolfe) method for optimizing structured nonconvex functions that are expressed as a difference of two convex functions. This problem class subsumes smooth nonconvex minimization, positioning our…

Optimization and Control · Mathematics 2025-12-01 Hoomaan Maskan , Yikun Hou , Suvrit Sra , Alp Yurtsever

We study the two-set feasibility problem of finding a point in the intersection $X\cap Y$ of closed convex sets in a Hilbert space. We propose a generalized composed alternating relaxed projection algorithm (gCARPA) that blends…

Optimization and Control · Mathematics 2026-04-21 Xinxin Li , Yudong Wei , Hao Zhang

We propose a theoretical framework for the image source method that generalizes to arbitrary reflecting boundaries, e.g. boundaries that are curved or even with certain openings. Furthermore, it can seamlessly incorporate boundary…

Signal Processing · Electrical Eng. & Systems 2019-07-01 Pierre Quinton , Pablo Martínez-Nuevo , Martin B. Møller

The basic optimization problem of road design is quite challenging due to a objective function that is the sum of nonsmooth functions and the presence of set constraints. In this paper, we model and solve this problem by employing the…

Optimization and Control · Mathematics 2014-09-30 Heinz H. Bauschke , Valentin R. Koch , Hung M. Phan

One of the most compelling features of global discrete diffusion language models is their global bidirectional contextual capability. However, existing block-based diffusion studies tend to introduce autoregressive priors, which, while…

Machine Learning · Computer Science 2026-01-22 Linrui Ma , Yufei Cui , Kai Han , Yunhe Wang

Spectral clustering is one of the most popular unsupervised machine learning methods. Constructing similarity matrix is crucial to this type of method. In most existing works, the similarity matrix is computed once for all or is updated…

Machine Learning · Computer Science 2023-06-30 Yongyan Guo , Gang Wu

We study some methods of subgradient projections for solving a convex feasibility problem with general (not necessarily hyperplanes or half-spaces) convex sets in the inconsistent case and propose a strategy that controls the relaxation…

Optimization and Control · Mathematics 2010-09-21 Dan Butnariu , Yair Censor , Pini Gurfil , Ethan Hadar

Covariance matrices are central to data assimilation and inverse methods derived from statistical estimation theory. Previous work has considered the application of an all-at-once diffusion-based representation of a covariance matrix…

Numerical Analysis · Mathematics 2026-05-11 Jemima M. Tabeart , Selime Gürol , John W. Pearson , Anthony T. Weaver

Transformer-based methods have improved hyperspectral image classification (HSIC) by modeling long-range spatial-spectral dependencies; however, their attention mechanisms typically rely on dot-product similarity, which mixes feature…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Muhammad Ahmad , Manuel Mazzara

Diffusion models have been increasingly used as strong generative priors for solving inverse problems such as super-resolution in medical imaging. However, these approaches typically utilize a diffusion prior trained at a single scale,…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Darshan Thaker , Mahmoud Mostapha , Radu Miron , Shihan Qiu , Mariappan Nadar

In this paper we present a novel randomized block coordinate descent method for the minimization of a convex composite objective function. The method uses (approximate) partial second-order (curvature) information, so that the algorithm…

Optimization and Control · Mathematics 2015-05-11 Kimon Fountoulakis , Rachael Tappenden

Demiclosedness principles are powerful tools in the study of convergence of iterative methods. For instance, a multi-operator demiclosedness principle for firmly nonexpansive mappings is useful in obtaining simple and transparent arguments…

Optimization and Control · Mathematics 2020-08-25 Sedi Bartz , Rubén Campoy , Hung M. Phan

Block coordinate descent (BCD) methods approach optimization problems by performing gradient steps along alternating subgroups of coordinates. This is in contrast to full gradient descent, where a gradient step updates all coordinates…

Numerical Analysis · Mathematics 2019-07-29 Simon Rabanser , Lukas Neumann , Markus Haltmeier