English
Related papers

Related papers: Proximal Splitting Methods in Signal Processing

200 papers

The difference-of-convex (DC) program is an important model in nonconvex optimization due to its structure, which encompasses a wide range of practical applications. In this paper, we aim to tackle a generalized class of DC programs, where…

Optimization and Control · Mathematics 2025-05-29 Tan Nhat Pham , Minh N. Dao , Nima Amjady , Rakibuzzaman Shah

Recent work has shown a variety of ways in which machine learning can be used to accelerate the solution of constrained optimization problems. Increasing demand for real-time decision-making capabilities in applications such as artificial…

Machine Learning · Computer Science 2024-04-02 Ethan King , James Kotary , Ferdinando Fioretto , Jan Drgona

In this short survey, I revisit the role of the proximal point method in large scale optimization. I focus on three recent examples: a proximally guided subgradient method for weakly convex stochastic approximation, the prox-linear…

Optimization and Control · Mathematics 2017-12-19 Dmitriy Drusvyatskiy

The forward-backward operator splitting algorithm is one of the most important methods for solving the optimization problem of the sum of two convex functions, where one is differentiable with a Lipschitz continuous gradient and the other…

Optimization and Control · Mathematics 2019-08-30 Yu-Chao Tang , Guo-Rong Wu , Chuan-Xi Zhu

We introduce and investigate a new generalized convexity notion for functions called prox-convexity. The proximity operator of such a function is single-valued and firmly nonexpansive. We provide examples of (strongly) quasiconvex, weakly…

Optimization and Control · Mathematics 2021-11-30 Sorin-Mihai Grad , Felipe Lara

This work investigates the properties of the proximity operator for quasar-convex functions and establishes the convergence of the proximal point algorithm to a global minimizer with a particular focus on its convergence rate. In…

Optimization and Control · Mathematics 2026-04-16 José de Brito , Felipe Lara , Di Liu

In their recent evaluation of time-frequency representations and structured sparsity approaches to audio inpainting, Lieb and Stark (2018) have used a particular mapping as a proximal operator. This operator serves as the fundamental part…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-15 Ondřej Mokrý , Pavel Rajmic

We consider the well-studied problem of decomposing a vector time series signal into components with different characteristics, such as smooth, periodic, nonnegative, or sparse. We describe a simple and general framework in which the…

Machine Learning · Computer Science 2022-09-21 Bennet E. Meyers , Stephen P. Boyd

We consider minimization of functions that are compositions of convex or prox-regular functions (possibly extended-valued) with smooth vector functions. A wide variety of important optimization problems fall into this framework. We describe…

Optimization and Control · Mathematics 2015-04-24 A. S. Lewis , S. J. Wright

Proximal splitting algorithms are well suited to solving large-scale nonsmooth optimization problems, in particular those arising in machine learning. We propose a new primal-dual algorithm, in which the dual update is randomized;…

Optimization and Control · Mathematics 2023-03-08 Laurent Condat , Peter Richtárik

The proximal gradient method is a generic technique introduced to tackle the non-smoothness in optimization problems, wherein the objective function is expressed as the sum of a differentiable convex part and a non-differentiable…

Numerical Analysis · Mathematics 2024-01-19 Abdeslem Hafid Bentbib , Khalide Jbilou , Ridwane Tahiri

Many applications using large datasets require efficient methods for minimizing a proximable convex function subject to satisfying a set of linear constraints within a specified tolerance. For this task, we present a proximal projection…

Optimization and Control · Mathematics 2024-12-10 Howard Heaton

The three operator splitting scheme was recently proposed by [Davis and Yin, 2015] as a method to optimize composite objective functions with one convex smooth term and two convex (possibly non-smooth) terms for which we have access to…

Machine Learning · Statistics 2021-06-29 Fabian Pedregosa

This paper focuses on a class of inclusion problems of maximal monotone operators in a multi-agent network, where each agent is characterized by an operator that is not available to any other agents, but the agents can cooperate by…

Optimization and Control · Mathematics 2023-10-25 Kai Gong , Liwei Zhang

In this paper, we consider solving a class of convex optimization problem which minimizes the sum of three convex functions $f(x)+g(x)+h(Bx)$, where $f(x)$ is differentiable with a Lipschitz continuous gradient, $g(x)$ and $h(x)$ have a…

Optimization and Control · Mathematics 2019-04-30 Yu-Chao Tang , Guo-Rong Wu , Chuan-Xi Zhu

This paper proposes an accelerated proximal point method for maximally monotone operators. The proof is computer-assisted via the performance estimation problem approach. The proximal point method includes various well-known convex…

Optimization and Control · Mathematics 2021-03-25 Donghwan Kim

We present two approximate versions of the proximal subgradient method for minimizing the sum of two convex functions (not necessarily differentiable). The algorithms involve, at each iteration, inexact evaluations of the proximal operator…

Optimization and Control · Mathematics 2019-07-12 Reinier Díaz Millán , Majela Pentón Machado

In this paper we investigate the applicability of a recently introduced primal-dual splitting method in the context of solving portfolio optimization problems which assume the minimization of risk measures associated to different convex…

Optimization and Control · Mathematics 2013-04-30 Radu Ioan Bot , Christopher Hendrich

The breakthrough ideas in the modern proximal splitting methodologies allow us to express the set of all minimizers of a superposition of multiple nonsmooth convex functions as the fixed point set of computable nonexpansive operators. In…

Optimization and Control · Mathematics 2022-07-01 Isao Yamada , Masao Yamagishi

Proper splittings of operators are commonly used to study the convergence of iterative processes. In order to approximate solutions of operator equations, in this article we deal with proper splittings of closed range bounded linear…

Functional Analysis · Mathematics 2024-03-18 Guillermina Fongi , María Celeste Gonzalez