English
Related papers

Related papers: Holder continuity of the steepest descent directio…

200 papers

This paper addresses the challenge of obtaining strong optimality guarantees in constrained nonsmooth nonconvex optimization under mild regularity conditions, namely local Lipschitz continuity and existence and continuity of directional…

Optimization and Control · Mathematics 2026-05-22 Dan Greenstein , Nadav Hallak

The problem of optimization on Stiefel manifold, i.e., minimizing functions of (not necessarily square) matrices that satisfy orthogonality constraints, has been extensively studied. Yet, a new approach is proposed based on, for the first…

Machine Learning · Computer Science 2023-03-06 Lingkai Kong , Yuqing Wang , Molei Tao

In this paper we consider stochastic composite convex optimization problems with the objective function satisfying a stochastic bounded gradient condition, with or without a quadratic functional growth property. These models include the…

Optimization and Control · Mathematics 2020-03-10 Ion Necoara

Recently there were proposed some innovative convex optimization concepts, namely, relative smoothness [1] and relative strong convexity [2,3]. These approaches have significantly expanded the class of applicability of gradient-type methods…

Optimization and Control · Mathematics 2024-04-19 Fedor Stonyakin , Alexander Titov , Mohammad Alkousa , Oleg Savchuk , Alexander Gasnikov

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

We propose an adaptive zeroth-order method for minimizing differentiable functions with $L$-Lipschitz continuous gradients. The method is designed to take advantage of the eventual compressibility of the gradient of the objective function,…

Optimization and Control · Mathematics 2025-07-16 Geovani Nunes Grapiglia , Daniel McKenzie

In a general Hilbert framework, we consider continuous gradient-like dynamical systems for constrained multiobjective optimization involving non-smooth convex objective functions. Our approach is in the line of a previous work where was…

Optimization and Control · Mathematics 2017-07-14 Hedy Attouch , Guillaume Garrigos , Xavier Goudou

We prove the weak and the strong convergence of the trajectories of the continuous gradient projection method under some mild assumptions on the objective function and the step size function. Moreover, we estimate the decay rate to…

Optimization and Control · Mathematics 2018-10-30 Ramzi May

We consider the gradient (or steepest) descent method with exact line search applied to a strongly convex function with Lipschitz continuous gradient. We establish the exact worst-case rate of convergence of this scheme, and show that this…

Optimization and Control · Mathematics 2016-09-16 Etienne de Klerk , François Glineur , Adrien B. Taylor

We provide some necessary and sufficient conditions for a proper lower semicontinuous convex function, defined on a real Banach space, to be locally or globally Lipschitz continuous. Our criteria rely on the existence of a bounded selection…

Functional Analysis · Mathematics 2019-11-13 Bao Tran Nguyen , Pham Duy Khanh

In this paper, we consider the problem of minimizing the sum of two convex functions subject to linear linking constraints. The classical alternating direction type methods usually assume that the two convex functions have relatively easy…

Optimization and Control · Mathematics 2015-07-10 Tianyi Lin , Shiqian Ma , Shuzhong Zhang

In this paper we focus on the convergence analysis of the forward-backward splitting method for solving nonsmooth optimization problems in Hilbert spaces when the objective function is the sum of two convex functions. Assuming that one of…

Optimization and Control · Mathematics 2016-10-17 J. Y. Bello Cruz , T. T. A. Nghia

The paper presents a new descent algorithm for locally Lipschitz continuous functions $f:X\to\mathbb{R}$. The selection of a descent direction at some iteration point $x$ combines an approximation of the set-valued gradient of $f$ on a…

Numerical Analysis · Mathematics 2019-10-25 Jan Mankau , Friedemann Schuricht

An algorithm is proposed, analyzed, and tested for minimizing locally Lipschitz objective functions that may be nonconvex and/or nonsmooth. The algorithm, which is built upon the gradient-sampling methodology, is designed specifically for…

Optimization and Control · Mathematics 2026-04-02 Albert S. Berahas , Frank E. Curtis , Lara Zebiane

Approximation of subdifferentials is one of the main tasks when computing descent directions for nonsmooth optimization problems. In this article, we propose a bisection method for weakly lower semismooth functions which is able to compute…

Optimization and Control · Mathematics 2024-02-07 Bennet Gebken

We establish sharp results on the modulus of continuity of the distribution of the spectral measure for one-frequency Schrodinger operators with Diophantine frequencies in the region of absolutely continuous spectrum. More precisely, we…

Dynamical Systems · Mathematics 2015-05-14 Artur Avila , Svetlana Jitomirskaya

We study the quantitative stability of the mapping that to a measure associates its pushforward measure by a fixed (non-smooth) optimal transport map. We exhibit a tight H\"older-behavior for this operation under minimal assumptions. Our…

Optimization and Control · Mathematics 2024-01-08 Guillaume Carlier , Alex Delalande , Quentin Mérigot

We analyze the global and local behavior of gradient-like flows under stochastic errors towards the aim of solving convex optimization problems with noisy gradient input. We first study the unconstrained differentiable convex case, using a…

Optimization and Control · Mathematics 2024-03-12 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch

In this paper, we approach the problem of finding the zeros of the sum of a maximally monotone operator and a monotone and Lipschitz continuous one in a real Hilbert space via an implicit forward-backward-forward dynamical system with…

Optimization and Control · Mathematics 2015-04-23 Sebastian Banert , Radu Ioan Bot

This paper presents an accelerated proximal gradient method for multiobjective optimization, in which each objective function is the sum of a continuously differentiable, convex function and a closed, proper, convex function. Extending…

Optimization and Control · Mathematics 2023-06-08 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita