English
Related papers

Related papers: Level proximal subdifferential, variational convex…

200 papers

This paper considers the problem of minimizing the summation of a differentiable function and a nonsmooth function on a Riemannian manifold. In recent years, proximal gradient method and its invariants have been generalized to the…

Optimization and Control · Mathematics 2021-11-16 Wen Huang , Ke Wei

We consider minimization of functions that are compositions of convex or prox-regular functions (possibly extended-valued) with smooth vector functions. A wide variety of important optimization problems fall into this framework. We describe…

Optimization and Control · Mathematics 2015-04-24 A. S. Lewis , S. J. Wright

We present two approximate versions of the proximal subgradient method for minimizing the sum of two convex functions (not necessarily differentiable). The algorithms involve, at each iteration, inexact evaluations of the proximal operator…

Optimization and Control · Mathematics 2019-07-12 Reinier Díaz Millán , Majela Pentón Machado

In this paper we present a new method for solving optimization problems involving the sum of two proper, convex, lower semicontinuous functions, one of which has Lipschitz continuous gradient. The proposed method has a hybrid nature that…

Optimization and Control · Mathematics 2022-11-03 Kristian Bredies , Enis Chenchene , Alireza Hosseini

Backtracking linesearch is the de facto approach for minimizing continuously differentiable functions with locally Lipschitz gradient. In recent years, it has been shown that in the convex setting it is possible to avoid linesearch…

Optimization and Control · Mathematics 2024-03-14 Puya Latafat , Andreas Themelis , Lorenzo Stella , Panagiotis Patrinos

The usual approach to developing and analyzing first-order methods for smooth convex optimization assumes that the gradient of the objective function is uniformly smooth with some Lipschitz constant $L$. However, in many settings the…

Optimization and Control · Mathematics 2017-10-11 Haihao Lu , Robert M. Freund , Yurii Nesterov

In this paper we propose a scalarization proximal point method to solve multiobjective unconstrained minimization problems with locally Lipschitz and quasiconvex vector functions. We prove, under natural assumptions, that the sequence…

Optimization and Control · Mathematics 2014-07-28 H. C. F. Apolinário , E. A. Papa Quiroz , P. R. Oliveira

We propose a single time-scale stochastic subgradient method for constrained optimization of a composition of several nonsmooth and nonconvex functions. The functions are assumed to be locally Lipschitz and differentiable in a generalized…

Optimization and Control · Mathematics 2020-12-22 Andrzej Ruszczynski

The directional subdifferential of the value function gives an estimate on how much the optimal value changes under a perturbation in a certain direction. In this paper we derive upper estimates for the directional limiting and singular…

Optimization and Control · Mathematics 2023-04-19 Kuang Bai , Jane J. Ye

This book is devoted to finite-dimensional problems of non-convex non-smooth optimization and numerical methods for their solution. The problem of nonconvexity is studied in the book on two main models of nonconvex dependencies: these are…

Optimization and Control · Mathematics 2024-06-18 V. S. Mikhalevich , A. M. Gupal , V. I. Norkin

An efficient proximal-gradient-based method, called proximal extrapolated gradient method, is designed for solving monotone variational inequality in Hilbert space. The proposed method extends the acceptable range of parameters to obtain…

Optimization and Control · Mathematics 2019-12-05 Xiaokai Chang , Sanyang Liu , Jianchao Bai , Jun Yang

We propose an adaptive proximal gradient method for minimizing the sum of two functions, where one is a simple convex function, and the other belongs to one of the three classes: nonconvex smooth, convex nonsmooth, or convex smooth. The key…

Optimization and Control · Mathematics 2026-05-08 Zimeng Wang , Alp Yurtsever

In this short survey, I revisit the role of the proximal point method in large scale optimization. I focus on three recent examples: a proximally guided subgradient method for weakly convex stochastic approximation, the prox-linear…

Optimization and Control · Mathematics 2017-12-19 Dmitriy Drusvyatskiy

In this paper, we consider the Forward--Backward proximal splitting algorithm to minimize the sum of two proper convex functions, one of which having a Lipschitz continuous gradient and the other being partly smooth relative to an active…

Optimization and Control · Mathematics 2015-03-11 Jingwei Liang , Jalal Fadili , Gabriel Peyré

Recently, based on the idea of randomizing space theory, random convex analysis has been being developed in order to deal with the corresponding problems in random environments such as analysis of conditional convex risk measures and the…

Functional Analysis · Mathematics 2017-09-11 Tiexin Guo , Erxin Zhang , Mingzhi Wu , Bixuan Yang , George Yuan , Xiaolin Zeng

We study proximal random reshuffling for minimizing the sum of locally Lipschitz functions and a proper lower semicontinuous convex function without assuming coercivity or the existence of limit points. The algorithmic guarantees pertaining…

Optimization and Control · Mathematics 2024-08-15 Cedric Josz , Lexiao Lai , Xiaopeng Li

This paper presents a stochastic block-coordinate proximal Newton method for minimizing the sum of a blockwise Lipschitz-continuously differentiable function and a separable nonsmooth convex function. At each iteration, the method randomly…

Optimization and Control · Mathematics 2026-03-25 Hong Zhu , Xun Qian

Local convergence analysis of the proximal point method for special class of nonconvex function on Hadamard manifold is presented in this paper. The well definedness of the sequence generated by the proximal point method is guaranteed.…

Optimization and Control · Mathematics 2010-04-13 G. C. Bento , O. P. Ferreira , P. R. Oliveira

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

In this paper, we introduce a stochastic projected subgradient method for weakly convex (i.e., uniformly prox-regular) nonsmooth, nonconvex functions---a wide class of functions which includes the additive and convex composite classes. At a…

Optimization and Control · Mathematics 2018-09-19 Damek Davis , Benjamin Grimmer