English
Related papers

Related papers: New Douglas-Rashford Splitting Algorithms for Gene…

200 papers

In this paper, we propose an optimization-based method for robust phase retrieval problem where the goal is to estimate an unknown signal from a quadratic measurement corrupted by outliers. To enhance the robustness of existing optimization…

Optimization and Control · Mathematics 2026-04-17 Kumataro Yazawa , Keita Kume , Isao Yamada

Nonconvex and nonsmooth optimization problems are frequently encountered in much of statistics, business, science and engineering, but they are not yet widely recognized as a technology in the sense of scalability. A reason for this…

Optimization and Control · Mathematics 2018-01-19 Bo Jiang , Tianyi Lin , Shiqian Ma , Shuzhong Zhang

The Douglas-Rachford (DR) method is a widely used method for finding a point in the intersection of two closed convex sets (feasibility problem). However, the method converges weakly and the associated rate of convergence is hard to analyze…

Optimization and Control · Mathematics 2024-01-10 Deren Han , Yansheng Su , Jiaxin Xie

In this paper, a stochastic alternating direction method of multipliers (ADMM) is proposed for a class of nonsmooth composite and stochastic convex optimization problems in Hilbert space, motivated by optimization problems constrained by…

Optimization and Control · Mathematics 2026-05-18 Weihua Deng , Haiming Song , Hao Wang , Jinda Yang

High dimensional and/or nonconvex optimization remains a challenging and important problem across a wide range of fields, such as machine learning, data assimilation, and partial differential equation (PDE) constrained optimization. Here we…

Optimization and Control · Mathematics 2025-08-29 Brian K. Tran , Ben S. Southworth , David B. Cavender , Sam Olivier , Syed A. Shah , Tommaso Buvoli

This paper provides necessary and sufficient optimality conditions for abstract constrained mathematical programming problems in locally convex spaces under new qualification conditions. Our approach exploits the geometrical properties of…

Optimization and Control · Mathematics 2023-02-10 Rafael Correa , Marco A. López , Pedro Pérez-Aros

The paper presents a new approach to solve multifacility location problems, which is based on mixed integer programming and algorithms for minimizing differences of convex (DC) functions. The main challenges for solving the multifacility…

Optimization and Control · Mathematics 2020-02-05 Anuj Bajaj , Boris Mordukhovich , Nguyen Mau Nam , Tuyen Tran

We introduce and study a geometric modification of the Douglas-Rach\-ford method called the Circumcentered-Douglas-Rachford method. This method iterates by taking the intersection of bisectors of reflection steps for solving certain classes…

Optimization and Control · Mathematics 2020-08-11 Roger Behling , Jose Yunier Bello Cruz , Luiz-Rafael Santos

The split feasibility problem is to find an element in the intersection of a closed set $C$ and the linear preimage of another closed set $D$, assuming the projections onto $C$ and $D$ are easy to compute. This class of problems arises…

Optimization and Control · Mathematics 2020-11-05 Chen Chen , Ting Kei Pong , Lulin Tan , Liaoyuan Zeng

The alternating direction method of multipliers (ADMM) is a powerful splitting algorithm for linearly constrained convex optimization problems. In view of its popularity and applicability, a growing attention is drawn towards the ADMM in…

Optimization and Control · Mathematics 2022-08-19 Sedi Bartz , Rubén Campoy , Hung M. Phan

For the inclusion problem involving two maximal monotone operators, under the metric subregularity of the composite operator, we derive the linear convergence of the generalized proximal point algorithm and several splitting algorithms,…

Optimization and Control · Mathematics 2016-09-28 Li Shen , Shaohua Pan

We shed light on the structure of the "three-operator" version of the forward-Douglas--Rachford splitting algorithm for finding a zero of a sum of maximally monotone operators $A + B + C$, where $B$ is cocoercive, involving only the…

Optimization and Control · Mathematics 2018-05-02 Hugo Raguet

In this paper, we propose a new algorithm combining the Douglas-Rachford (DR) algorithm and the Frank-Wolfe algorithm, also known as the conditional gradient (CondG) method, for solving the classic convex feasibility problem. Within the…

Optimization and Control · Mathematics 2021-06-09 R. Díaz Millán , O. P. Ferreira , J. Ugon

The primal-dual Douglas-Rachford method is a well-known algorithm to solve optimization problems written as convex-concave saddle-point problems. Each iteration involves solving a linear system involving a linear operator and its adjoint.…

Optimization and Control · Mathematics 2025-11-11 Emanuele Naldi , Felix Schneppe

We develop and analyze an asynchronous algorithm for distributed convex optimization when the objective writes a sum of smooth functions, local to each worker, and a non-smooth function. Unlike many existing methods, our distributed…

Optimization and Control · Mathematics 2019-12-13 Konstantin Mishchenko , Franck Iutzeler , Jérôme Malick

In the context of convex optimization problems in Hilbert spaces, we induce inertial effects into the classical ADMM numerical scheme and obtain in this way so-called inertial ADMM algorithms, the convergence properties of which we…

Optimization and Control · Mathematics 2014-04-18 Radu Ioan Bot , Ernö Robert Csetnek

We analyze stochastic algorithms for optimizing nonconvex, nonsmooth finite-sum problems, where the nonconvex part is smooth and the nonsmooth part is convex. Surprisingly, unlike the smooth case, our knowledge of this fundamental problem…

Optimization and Control · Mathematics 2016-05-24 Sashank J. Reddi , Suvrit Sra , Barnabas Poczos , Alex Smola

Online and stochastic learning has emerged as powerful tool in large scale optimization. In this work, we generalize the Douglas-Rachford splitting (DRs) method for minimizing composite functions to online and stochastic settings (to our…

Numerical Analysis · Computer Science 2016-12-22 Ziqiang Shi , Rujie Liu

Operator splitting methods have been successfully used in computational sciences, statistics, learning and vision areas to reduce complex problems into a series of simpler subproblems. However, prevalent splitting schemes are mostly…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Risheng Liu , Shichao Cheng , Yi He , Xin Fan , Zhongxuan Luo

Accelerated gradient-based methods are being extensively used for solving non-convex machine learning problems, especially when the data points are abundant or the available data is distributed across several agents. Two of the prominent…

Machine Learning · Computer Science 2021-10-04 Kushal Chakrabarti , Nikhil Chopra