English
Related papers

Related papers: Constraint reduction reformulations for projection…

200 papers

Combinatorial problems stated as Constraint Satisfaction Problems (CSP) are examined. It is shown by example that any algorithm designed for the original CSP, and involving the AllDifferent constraint, has at least the same level of…

Artificial Intelligence · Computer Science 2020-12-15 Geoff Harris

Constrained non-convex optimization is fundamentally challenging, as global solutions are generally intractable and constraint qualifications may not hold. However, in many applications, including safe policy optimization in control and…

Optimization and Control · Mathematics 2025-11-14 Ilyas Fatkhullin , Niao He , Guanghui Lan , Florian Wolf

The Douglas-Rachford algorithm is one of the most prominent splitting algorithms for solving convex optimization problems. Recently, the method has been successful in finding a generalized solution (provided that one exists) for…

Optimization and Control · Mathematics 2022-06-16 Walaa M. Moursi

We provide a simple analysis of the Douglas-Rachford splitting algorithm in the context of $\ell^1$ minimization with linear constraints, and quantify the asymptotic linear convergence rate in terms of principal angles between relevant…

Numerical Analysis · Mathematics 2013-05-30 Laurent Demanet , Xiangxiong Zhang

The Euclidean projection onto a convex set is an important problem that arises in numerous constrained optimization tasks. Unfortunately, in many cases, computing projections is computationally demanding. In this work, we focus on…

Optimization and Control · Mathematics 2021-09-22 Ilnura Usmanova , Maryam Kamgarpour , Andreas Krause , Kfir Yehuda Levy

In this paper, we consider the problem of minimizing a smooth objective over multiple rank constraints on Hankel-structured matrices. This kind of problems arises in system identification, system theory and signal processing, where the rank…

Optimization and Control · Mathematics 2019-06-26 Tianxiang Liu , Ivan Markovsky , Ting Kei Pong , Akiko Takeda

We are interested in solving convex optimization problems with large numbers of constraints. Randomized algorithms, such as random constraint sampling, have been very successful in giving nearly optimal solutions to such problems. In this…

Optimization and Control · Mathematics 2016-11-29 William B. Haskell , Yu Pengqian

Circumcentered techniques have been shown to significantly accelerate projection-based methods for convex feasibility problems. Motivated by this success, we propose two direct methods with circumcenter acceleration for solving variational…

Optimization and Control · Mathematics 2026-02-10 Roger Behling , Yunier Bello-Cruz , Alfredo Iusem , Di Liu , Luiz-Rafael Santos

Recently, diffusion models have been used to solve various inverse problems in an unsupervised manner with appropriate modifications to the sampling process. However, the current solvers, which recursively apply a reverse diffusion step…

Machine Learning · Computer Science 2024-05-21 Hyungjin Chung , Byeongsu Sim , Dohoon Ryu , Jong Chul Ye

We consider the problem of projecting a convex set onto a subspace, or equivalently formulated, the problem of computing a set obtained by applying a linear mapping to a convex feasible set. This includes the problem of approximating convex…

Optimization and Control · Mathematics 2024-12-11 Gabriela Kováčová , Birgit Rudloff

For many problems, some of which are reviewed in the paper, popular algorithms like Douglas--Rachford (DR), ADMM, and FISTA produce approximating sequences that show signs of spiraling toward the solution. We present a meta-algorithm that…

Optimization and Control · Mathematics 2022-09-09 Scott B. Lindstrom

This paper addresses a class of (non-)convex optimization problems subject to general convex constraints, which pose significant challenges for traditional methods due to their inherent non-convexity and diversity. Conventional convex…

Systems and Control · Electrical Eng. & Systems 2025-02-04 Xiucheng Wang , Xuan Zhao , Nan Cheng

We construct an efficient numerical scheme for solving obstacle problems in divergence form. The numerical method is based on a reformulation of the obstacle in terms of an L1-like penalty on the variational problem. The reformulation is an…

Numerical Analysis · Mathematics 2014-04-08 Giang Tran , Hayden Schaeffer , William M. Feldman , Stanley J. Osher

In this work we propose a new splitting technique, namely Asymmetric Forward-Backward-Adjoint splitting, for solving monotone inclusions involving three terms, a maximally monotone, a cocoercive and a bounded linear operator. Classical…

Optimization and Control · Mathematics 2016-10-17 Puya Latafat , Panagiotis Patrinos

We introduce a relaxed-projection splitting algorithm for solving variational inequalities in Hilbert spaces for the sum of nonsmooth maximal monotone operators, where the feasible set is defined by a nonlinear and nonsmooth continuous…

Optimization and Control · Mathematics 2015-12-31 J. Y. Bello Cruz , R. Diaz Millan

Regularization approaches have demonstrated their effectiveness for solving ill-posed problems. However, in the context of variational restoration methods, a challenging question remains, which is how to find a good regularizer. While total…

Optimization and Control · Mathematics 2011-10-25 Nelly Pustelnik , Caroline Chaux , Jean-Christophe Pesquet

In this paper, we consider the feasibility problem, which aims to find a feasible point for the constraint set $\{x \in \mathbb{R}^n: c(x) = 0\}$ over a possibly non-regular subset $\mathcal{X} \subset \mathbb{R}^n$. Under the constraint…

Optimization and Control · Mathematics 2025-12-01 Nachuan Xiao , Shiwei Wang , Tianyun Tang , Kim-Chuan Toh

The unbounded knapsack problem with bounded weights is a variant of the well-studied variant of the traditional binary knapsack problem; key changes being the relaxation of the binary constraint and allowing the unit weights of each item to…

Data Structures and Algorithms · Computer Science 2021-09-29 Michael Beyer , Steven Mills

Generalized alternating projections is an algorithm that alternates relaxed projections onto a finite number of sets to find a point in their intersection. We consider the special case of two linear subspaces, for which the algorithm…

Optimization and Control · Mathematics 2017-03-31 Mattias Fält , Pontus Giselsson

We outline a new approach for solving optimization problems which enforce triangle inequalities on output variables. We refer to this as metric-constrained optimization, and give several examples where problems of this form arise in machine…

Numerical Analysis · Computer Science 2018-06-06 Nate Veldt , David Gleich , Anthony Wirth , James Saunderson