English
Related papers

Related papers: A Random Block-Coordinate Douglas-Rachford Splitti…

200 papers

The Douglas-Rachford algorithm is a classical and powerful splitting method for minimizing the sum of two convex functions and, more generally, finding a zero of the sum of two maximally monotone operators. Although this algorithm is well…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

In recent years, a distributed Douglas-Rachford splitting method (DDRSM) has been proposed to tackle multi-block separable convex optimization problems. This algorithm offers relatively easier subproblems and greater efficiency for…

Optimization and Control · Mathematics 2024-11-19 Leyu Hu , Jiaxin Xie , Xingju Cai , Deren Han

This work proposes block-coordinate fixed point algorithms with applications to nonlinear analysis and optimization in Hilbert spaces. The asymptotic analysis relies on a notion of stochastic quasi-Fej\'er monotonicity, which is thoroughly…

Optimization and Control · Mathematics 2015-04-20 Patrick L. Combettes , Jean-Christophe Pesquet

We present a Markov-chain analysis of blockwise-stochastic algorithms for solving partially block-separable optimization problems. Our main contributions to the extensive literature on these methods are statements about the Markov operators…

Optimization and Control · Mathematics 2023-11-01 D. Russell Luke

The Douglas Rachford algorithm is an algorithm that converges to a minimizer of a sum of two convex functions. The algorithm consists in fixed point iterations involving computations of the proximity operators of the two functions…

Optimization and Control · Mathematics 2018-04-04 Adil Salim , Pascal Bianchi , Walid Hachem

In this paper, we present a Douglas-Rachford splitting algorithm within a Hilbert space framework that yields a projected solution for a quasi-variational inequality. This is achieved under the conditions that the operator associated with…

Optimization and Control · Mathematics 2024-07-19 Maede Ramazannejad

Douglas-Rachford method is a splitting algorithm for finding a zero of the sum of two maximal monotone operators. Each of its iterations requires the sequential solution of two proximal subproblems. The aim of this work is to present a…

Optimization and Control · Mathematics 2018-09-10 Benar F. Svaiter

Online and stochastic learning has emerged as powerful tool in large scale optimization. In this work, we generalize the Douglas-Rachford splitting (DRs) method for minimizing composite functions to online and stochastic settings (to our…

Numerical Analysis · Computer Science 2016-12-22 Ziqiang Shi , Rujie Liu

The Douglas-Rachford method is a popular splitting technique for finding a zero of the sum of two subdifferential operators of proper closed convex functions; more generally two maximally monotone operators. Recent results concerned with…

Optimization and Control · Mathematics 2018-05-25 Walaa M. Moursi , Lieven Vandenberghe

In statistics and machine learning, logistic regression is a widely-used supervised learning technique primarily employed for binary classification tasks. When the number of observations greatly exceeds the number of predictor variables, we…

Machine Learning · Statistics 2024-04-02 Agniva Chowdhury , Pradeep Ramuhalli

In this paper, we study a parameterized Douglas-Rachford splitting method for a class of nonconvex optimization problem. A new merit function is constructed to establish the convergence of the whole sequence generated by the parameterized…

Optimization and Control · Mathematics 2020-06-17 Fengmiao Bian , Xiaoqun Zhang

This paper derives new inexact variants of the Douglas-Rachford splitting method for maximal monotone operators and the alternating direction method of multipliers (ADMM) for convex optimization. The analysis is based on a new inexact…

Optimization and Control · Mathematics 2019-04-25 M. Marques Alves , Jonathan Eckstein , Marina Geremia , Jefferson Melo

The basic optimization problem of road design is quite challenging due to a objective function that is the sum of nonsmooth functions and the presence of set constraints. In this paper, we model and solve this problem by employing the…

Optimization and Control · Mathematics 2014-09-30 Heinz H. Bauschke , Valentin R. Koch , Hung M. Phan

In this article, we propose and study a stochastic and relaxed preconditioned Douglas--Rachford splitting method to solve saddle-point problems that have separable dual variables. We prove the almost sure convergence of the iteration…

Optimization and Control · Mathematics 2024-10-01 Yakun Dong , Kristian Bredies , Hongpeng Sun

In this paper we introduce a class of novel distributed algorithms for solving stochastic big-data convex optimization problems over directed graphs. In the addressed set-up, the dimension of the decision variable can be extremely high and…

Optimization and Control · Mathematics 2020-10-06 Francesco Farina , Giuseppe Notarstefano

The Douglas--Rachford algorithm is a classic splitting method for finding a zero of the sum of two maximal monotone operators. It has also been applied to settings that involve one weakly and one strongly monotone operator. In this work, we…

Optimization and Control · Mathematics 2025-11-07 Jan Harold Alcantara , Akiko Takeda

The Douglas-Rachford splitting method is a classical and widely used algorithm for solving monotone inclusions involving the sum of two maximally monotone operators. It was recently shown to be the unique frugal, no-lifting…

Optimization and Control · Mathematics 2025-12-12 Max Nilsson , Anton Åkerman , Pontus Giselsson

Linear discriminant analysis (LDA) is a classical method for dimensionality reduction, where discriminant vectors are sought to project data to a lower dimensional space for optimal separability of classes. Several recent papers have…

Computation · Statistics 2022-03-04 Summer Atkins , Gudmundur Einarsson , Brendan Ames , Line Clemmensen

In this paper, we introduce the concept of sparse bilinear logistic regression for decision problems involving explanatory variables that are two-dimensional matrices. Such problems are common in computer vision, brain-computer interfaces,…

Optimization and Control · Mathematics 2014-04-17 Jianing V. Shi , Yangyang Xu , Richard G. Baraniuk

This paper proposes a distributed stochastic projection-free algorithm for large-scale constrained finite-sum optimization whose constraint set is complicated such that the projection onto the constraint set can be expensive. The global…

Optimization and Control · Mathematics 2022-04-25 Xia Jiang , Xianlin Zeng , Lihua Xie , Jian Sun , Jie Chen
‹ Prev 1 2 3 10 Next ›