English
Related papers

Related papers: A Linearly Convergent Douglas-Rachford Splitting S…

200 papers

Differentially private federated learning (DP-FL) enables clients to collaboratively train machine learning models while preserving the privacy of their local data. However, most existing DP-FL approaches assume that all clients share a…

Machine Learning · Computer Science 2026-02-27 Ruichen Xu , Ying-Jun Angela Zhang , Jianwei Huang

We analyze a novel multi-level version of a recently introduced compressed sensing (CS) Petrov-Galerkin (PG) method from [H. Rauhut and Ch. Schwab: Compressive Sensing Petrov-Galerkin approximation of high-dimensional parametric operator…

Numerical Analysis · Mathematics 2017-12-19 Jean-Luc Bouchot , Holger Rauhut , Christoph Schwab

Iterative algorithms are instrumental in modern numerical simulation for solving systems arising from the discretization of PDEs. They face however significant challenges in industrial applications, such as slow convergence, limit cycle…

Numerical Analysis · Mathematics 2026-05-05 Jeremy Kalfoun , Guillaume Pierrot , John Cagnol

We present a class of reduced basis (RB) methods for the iterative solution of parametrized symmetric positive-definite (SPD) linear systems. The essential ingredients are a Galerkin projection of the underlying parametrized system onto a…

Numerical Analysis · Mathematics 2018-04-18 Ngoc-Cuong Nguyen , Yanlai Chen

In this paper, we propose several graph-based extensions of the Douglas-Rachford splitting (DRS) method to solve monotone inclusion problems involving the sum of $N$ maximal monotone operators. Our construction is based on a two-layer…

Optimization and Control · Mathematics 2022-11-10 Kristian Bredies , Enis Chenchene , Emanuele Naldi

Over the past years, operator splitting methods have become ubiquitous for non-smooth optimization owing to their simplicity and efficiency. In this paper, we consider the Forward--Douglas--Rachford splitting method (FDR) [10,40], and study…

Optimization and Control · Mathematics 2018-01-04 Cesare Molinari , Jingwei Liang , Jalal Fadili

The problem of finding a vector with the fewest nonzero elements that satisfies an underdetermined system of linear equations is an NP-complete problem that is typically solved numerically via convex heuristics or nicely-behaved nonconvex…

Optimization and Control · Mathematics 2018-02-07 Robert Hesse , D. Russell Luke , Patrick Neumann

Motivated by nonconvex, inconsistent feasibility problems in imaging, the relaxed alternating averaged reflections algorithm, or relaxed Douglas-Rachford algorithm (DR$\lambda$), was first proposed over a decade ago. Convergence results for…

Optimization and Control · Mathematics 2020-03-26 D. Russell Luke , Anna-Lena Martins

This paper proposes and develops new linesearch methods with inexact gradient information for finding stationary points of nonconvex continuously differentiable functions on finite-dimensional spaces. Some abstract convergence results for a…

Optimization and Control · Mathematics 2023-01-03 Pham Duy Khanh , Boris S. Mordukhovich , Dat Ba Tran

Variational dimensionality reduction methods are widely used for their accuracy, generative capabilities, and robustness. We introduce a unifying framework that generalizes both such as traditional and state-of-the-art methods. The…

Machine Learning · Computer Science 2025-09-04 Eslam Abdelaleem , Ilya Nemenman , K. Michael Martini

The information bottleneck (IB) approach to clustering takes a joint distribution $P\!\left(X,Y\right)$ and maps the data $X$ to cluster labels $T$ which retain maximal information about $Y$ (Tishby et al., 1999). This objective results in…

Machine Learning · Statistics 2020-06-02 DJ Strouse , David J Schwab

The growing public concerns on data privacy in face recognition can be greatly addressed by the federated learning (FL) paradigm. However, conventional FL methods perform poorly due to the uniqueness of the task: broadcasting class centers…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Qiang Meng , Feng Zhou , Hainan Ren , Tianshu Feng , Guochao Liu , Yuanqing Lin

This paper introduces the distributed Halpern Peaceman--Rachford (dHPR) method, an efficient algorithm for solving distributed convex composite optimization problems with non-smooth objectives, which achieves a non-ergodic $O(1/k)$…

Optimization and Control · Mathematics 2025-11-14 Zhangcheng Feng , Defeng Sun , Yancheng Yuan , Guojun Zhang

In the era of big data, the need to expand the amount of data through data sharing to improve model performance has become increasingly compelling. As a result, effective collaborative learning models need to be developed with respect to…

Machine Learning · Computer Science 2020-11-17 Huiwen Wu , Cen Chen , Li Wang

We investigate the problem of maximizing the sum-rate performance of a beyond-diagonal reconfigurable intelligent surface (BD-RIS)-aided multi-user (MU)-multiple-input single-output (MISO) system using fractional programming (FP)…

With the proliferation of smart devices having built-in sensors, Internet connectivity, and programmable computation capability in the era of Internet of things (IoT), tremendous data is being generated at the network edge. Federated…

Machine Learning · Computer Science 2020-03-31 Rui Hu , Yuanxiong Guo , E. Paul. Ratazzi , Yanmin Gong

Recently, several authors have shown local and global convergence rate results for Douglas-Rachford splitting under strong monotonicity, Lipschitz continuity, and cocoercivity assumptions. Most of these focus on the convex optimization…

Optimization and Control · Mathematics 2017-04-05 Pontus Giselsson

Recent results in Compressive Sensing have shown that, under certain conditions, the solution to an underdetermined system of linear equations with sparsity-based regularization can be accurately recovered by solving convex relaxations of…

Computer Vision and Pattern Recognition · Computer Science 2012-01-19 Dheeraj Singaraju , Ehsan Elhamifar , Roberto Tron , Allen Y. Yang , S. Shankar Sastry

Differential privacy (DP) techniques can be applied to the federated learning model to protect data privacy against inference attacks to communication among the learning agents. The DP techniques, however, hinder achieving a greater…

Machine Learning · Computer Science 2021-10-08 Minseok Ryu , Kibaek Kim

The Douglas-Rachford method has been employed successfully to solve many kinds of non-convex feasibility problems. In particular, recent research has shown surprising stability for the method when it is applied to finding the intersections…

Numerical Analysis · Mathematics 2018-09-21 Bishnu P. Lamichhane , Scott B. Lindstrom , Brailey Sims