English
Related papers

Related papers: Calculus rules for proximal {\epsilon}-subdifferen…

200 papers

Proximal operations are among the most common primitives appearing in both practical and theoretical (or high-level) optimization methods. This basic operation typically consists in solving an intermediary (hopefully simpler) optimization…

Optimization and Control · Mathematics 2021-06-30 Mathieu Barré , Adrien Taylor , Francis Bach

This work investigates the properties of the proximity operator for quasar-convex functions and establishes the convergence of the proximal point algorithm to a global minimizer with a particular focus on its convergence rate. In…

Optimization and Control · Mathematics 2026-04-16 José de Brito , Felipe Lara , Di Liu

This paper deals with the regularization of the sum of functions defined on a locally convex spaces through their closed-convex hulls in the bidual space. Different conditions guaranteeing that the closed-convex hull of the sum is the sum…

Optimization and Control · Mathematics 2024-10-11 Rafael Correa , Abderrahim Hantoute , Marco A. López

We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function using proximal-gradient methods, where an error is present in the calculation of the gradient of the smooth term or in the proximity…

Machine Learning · Computer Science 2011-12-02 Mark Schmidt , Nicolas Le Roux , Francis Bach

A broad range of inverse problems can be abstracted into the problem of minimizing the sum of several convex functions in a Hilbert space. We propose a proximal decomposition algorithm for solving this problem with an arbitrary number of…

Optimization and Control · Mathematics 2009-11-13 Patrick L. Combettes , Jean-Christophe Pesquet

Subaddivity type matrix inequalities for concave funcions and symetric norms are given.

Functional Analysis · Mathematics 2008-04-08 Jean-Christophe Bourin , Eun-Young Lee

This paper explores the well known approximation approach to decide weak bisimilarity of Basic Parallel Processes. We look into how different refinement functions can be used to prove weak bisimilarity decidable for certain subclasses. We…

Formal Languages and Automata Theory · Computer Science 2012-08-15 Piotr Hofman , Patrick Totzke

Incremental methods are widely utilized for solving finite-sum optimization problems in machine learning and signal processing. In this paper, we study a family of incremental methods -- including incremental subgradient, incremental…

Optimization and Control · Mathematics 2022-12-26 Xiao Li , Zhihui Zhu , Anthony Man-Cho So , Jason D Lee

Stochastic nonconvex optimization problems with nonlinear constraints have a broad range of applications in intelligent transportation, cyber-security, and smart grids. In this paper, first, we propose an inexact-proximal accelerated…

Optimization and Control · Mathematics 2021-07-08 Morteza Boroun , Afrooz Jalilzadeh

We introduce a geometrically transparent strict saddle property for nonsmooth functions. This property guarantees that simple proximal algorithms on weakly convex problems converge only to local minimizers, when randomly initialized. We…

Optimization and Control · Mathematics 2021-02-18 Damek Davis , Dmitriy Drusvyatskiy

This work provides calculus for the Fr\'echet and limiting subdifferential of the pointwise supremum given by an arbitrary family of lower semicontinuous functions. We start our study showing fuzzy results about the Fr\'echet…

Optimization and Control · Mathematics 2018-12-05 Pedro Pérez-Aros

The aim of the present work is to show that the results obtained earlier on the approximation of distributions of sums of independent summands by the accompanying compound Poisson laws and the estimates of the proximity of sequential…

Probability · Mathematics 2022-08-04 Friedrich Götze , Andrei Yu. Zaitsev

The error term in the approximate functional equation for exponential sums involving the divisor function will be improved under certain conditions for the parameters of the approximate functional equation.

Number Theory · Mathematics 2014-09-23 Anne-Maria Ernvall-Hytönen

Enhancing the FedProx federated learning algorithm (Li et al., 2020) with server-side extrapolation, Li et al. (2024a) recently introduced the FedExProx method. Their theoretical analysis, however, relies on the assumption that each client…

Optimization and Control · Mathematics 2024-10-03 Hanmin Li , Peter Richtárik

We characterize proximity operators, that is to say functions that map a vector to a solution of a penalized least squares optimization problem. Proximity operators of convex penalties have been widely studied and fully characterized by…

Classical Analysis and ODEs · Mathematics 2020-02-24 Rémi Gribonval , Mila Nikolova

We obtain approximate convexity principles for solutions to some classes of nonlinear elliptic partial differential equations in convex domains involving approximately concave nonlinearities. Furthermore, we provide some applications to…

Analysis of PDEs · Mathematics 2019-02-19 Claudia Bucur , Marco Squassina

The proximity operator of a convex function is a natural extension of the notion of a projection operator onto a convex set. This tool, which plays a central role in the analysis and the numerical solution of convex optimization problems,…

Optimization and Control · Mathematics 2010-05-19 Patrick L. Combettes , Jean-Christophe Pesquet

We study minimization of a structured objective function, being the sum of a smooth function and a composition of a weakly convex function with a linear operator. Applications include image reconstruction problems with regularizers that…

Optimization and Control · Mathematics 2021-06-01 Axel Böhm , Stephen J. Wright

Consider a sum of convex functions, where the only information known about each individual summand is the location of a minimizer. In this work, we give an exact characterization of the set of possible minimizers of the sum. Our results…

Optimization and Control · Mathematics 2024-03-11 Moslem Zamani , François Glineur , Julien M. Hendrickx

Many practical optimization problems lack strong convexity. Fortunately, recent studies have revealed that first-order algorithms also enjoy linear convergences under various weaker regularity conditions. While the relationship among…

Optimization and Control · Mathematics 2026-02-05 Feng-Yi Liao , Lijun Ding , Yang Zheng