English
Related papers

Related papers: Constructing a subgradient from directional deriva…

200 papers

In this paper, locally Lipschitz, regular functions are utilized to identify and remove infeasible directions from set-valued maps that define differential inclusions. The resulting reduced set-valued map is point-wise smaller (in the sense…

Systems and Control · Computer Science 2021-07-07 Rushikesh Kamalapurkar , Warren E. Dixon , Andrew R. Teel

Computing explicitly the {\epsilon}-subdifferential of a proper function amounts to computing the level set of a convex function namely the conjugate minus a linear function. The resulting theoretical algorithm is applied to the the class…

Optimization and Control · Mathematics 2017-09-26 Anuj Bajaj , Warren Hare , Yves Lucet

We show that any smooth bi-Lipschitz $h$ can be represented exactly as a composition $h_m \circ ... \circ h_1$ of functions $h_1,...,h_m$ that are close to the identity in the sense that each $\left(h_i-\mathrm{Id}\right)$ is Lipschitz, and…

Machine Learning · Computer Science 2018-04-17 Peter L. Bartlett , Steven N. Evans , Philip M. Long

A framework is presented whereby a general convex conic optimization problem is transformed into an equivalent convex optimization problem whose only constraints are linear equations and whose objective function is Lipschitz continuous.…

Optimization and Control · Mathematics 2015-06-17 James Renegar

Approximation of subdifferentials is one of the main tasks when computing descent directions for nonsmooth optimization problems. In this article, we propose a bisection method for weakly lower semismooth functions which is able to compute…

Optimization and Control · Mathematics 2024-02-07 Bennet Gebken

In this work, we approach the minimization of a continuously differentiable convex function under linear equality constraints by a second-order dynamical system with asymptotically vanishing damping term. The system is formulated in terms…

Optimization and Control · Mathematics 2021-06-24 Radu Ioan Bot , Dang-Khoa Nguyen

In this paper we investigate continuity properties of first and second order shape derivatives of functionals depending on second order elliptic PDE's around nonsmooth domains, essentially either Lipschitz or convex, or satisfying a uniform…

Optimization and Control · Mathematics 2015-05-22 Jimmy Lamboley , Arian Novruzi , Michel Pierre

Given a non-convex twice differentiable cost function f, we prove that the set of initial conditions so that gradient descent converges to saddle points where \nabla^2 f has at least one strictly negative eigenvalue has (Lebesgue) measure…

Dynamical Systems · Mathematics 2016-06-08 Ioannis Panageas , Georgios Piliouras

The goal of the paper is to study the particular class of regularly ${\mathcal{H}}$-convex functions, when ${\mathcal{H}}$ is the set ${\mathcal{L}\widehat{C}}(X,{\mathbb{R}})$ of real-valued Lipschitz continuous classically concave…

Optimization and Control · Mathematics 2022-08-03 Valentin V. Gorokhovik

We propose a variable metric framework for minimizing the sum of a self-concordant function and a possibly non-smooth convex function, endowed with an easily computable proximal operator. We theoretically establish the convergence of our…

Machine Learning · Statistics 2014-04-15 Quoc Tran-Dinh , Anastasios Kyrillidis , Volkan Cevher

We initiate the study of nonsmooth optimization problems under bounded local subgradient variation, which postulates bounded difference between (sub)gradients in small local regions around points, in either average or maximum sense. The…

Optimization and Control · Mathematics 2024-11-05 Jelena Diakonikolas , Cristóbal Guzmán

Integrally convex functions constitute a fundamental function class in discrete convex analysis. This paper shows that an integer-valued integrally convex function admits an integral subgradient and that the integral biconjugate of an…

Combinatorics · Mathematics 2018-09-11 Kazuo Murota , Akihisa Tamura

Motivated by applications to stochastic programming, we introduce and study the expected-integral functionals, which are mappings given in an integral form depending on two variables, the first a finite dimensional decision vector and the…

Optimization and Control · Mathematics 2021-06-15 Boris S. Mordukhovich , Pedro Pérez-Aros

This work considers the question: what convergence guarantees does the stochastic subgradient method have in the absence of smoothness and convexity? We prove that the stochastic subgradient method, on any semialgebraic locally Lipschitz…

Optimization and Control · Mathematics 2018-05-29 Damek Davis , Dmitriy Drusvyatskiy , Sham Kakade , Jason D. Lee

We show that the gradient of a multi-variable strongly differentiable function at a point is the limit of a single coordinate-free Clifford quotient between a multi-difference pseudo-vector and a pseudo-scalar, or of a sum of Clifford…

Analysis of PDEs · Mathematics 2022-03-28 Paolo Roselli

We study subgradient sequences of locally Lipschitz functions definable in a polynomially bounded o-minimal structure. We show that the diameter of any subgradient sequence is related to the variation in function values, with error terms…

Optimization and Control · Mathematics 2026-05-15 Lexiao Lai , Mingzhi Song

We construct examples of Lipschitz continuous functions, with pathological subgradient dynamics both in continuous and discrete time. In both settings, the iterates generate bounded trajectories, and yet fail to detect any (generalized)…

Optimization and Control · Mathematics 2019-10-31 Aris Daniilidis , Dmitriy Drusvyatskiy

Zhang et al. introduced a novel modification of Goldstein's classical subgradient method, with an efficiency guarantee of $O(\varepsilon^{-4})$ for minimizing Lipschitz functions. Their work, however, makes use of a nonstandard subgradient…

Optimization and Control · Mathematics 2022-02-17 Damek Davis , Dmitriy Drusvyatskiy , Yin Tat Lee , Swati Padmanabhan , Guanghao Ye

This work concerns the study of the subdifferential of the integral functional $$ E_f(x)=\int_{T} f(t,x)d\mu(t), $$ where $f$ is a (not necessarily convex) normal integrand, $({T},\mathcal{A},\mu)$ is a $\sigma$-finite measure space, while…

Optimization and Control · Mathematics 2019-02-19 Rafael Correa , Abderrahim Hantoute , Pedro Pérez-Aros

This book is devoted to finite-dimensional problems of non-convex non-smooth optimization and numerical methods for their solution. The problem of nonconvexity is studied in the book on two main models of nonconvex dependencies: these are…

Optimization and Control · Mathematics 2024-06-18 V. S. Mikhalevich , A. M. Gupal , V. I. Norkin