English
Related papers

Related papers: Constructing a subgradient from directional deriva…

200 papers

In this paper, we propose a multi-step inertial Forward--Backward splitting algorithm for minimizing the sum of two non-necessarily convex functions, one of which is proper lower semi-continuous while the other is differentiable with a…

Optimization and Control · Mathematics 2016-10-28 Jingwei Liang , Jalal Fadili , Gabriel Peyré

In this paper we consider convex optimization problems with stochastic composite objective function subject to (possibly) infinite intersection of constraints. The objective function is expressed in terms of expectation operator over a sum…

Optimization and Control · Mathematics 2024-12-03 Ion Necoara , Nitesh Kumar Singh

We study unconstrained optimization problems of nonsmooth, nonconvex Lipschitz functions, using only noisy pairwise comparisons governed by a known link function. Our goal is to compute a $(\delta,\varepsilon)$-Goldstein stationary point.…

Optimization and Control · Mathematics 2026-02-10 Taha El Bakkali , El Mahdi Chayti , Omar Saadi

This contribution proposes a new formulation to efficiently compute directional derivatives of order one to fourth. The formulation is based on automatic differentiation implemented with dual numbers. Directional derivatives are particular…

Numerical Analysis · Mathematics 2023-06-14 R. Peón-Escalante , K. B. Cantún-Avila , O. Carvente , A. Espinosa-Romero , F. Peñuñuri

Differentiable structure ensures that many of the basics of classical convex analysis extend naturally from Euclidean space to Riemannian manifolds. Without such structure, however, extensions are more challenging. Nonetheless, in…

Optimization and Control · Mathematics 2023-11-28 Adrian S. Lewis , Genaro López-Acedo , Adriana Nicolae

Abstract convexity generalises classical convexity by considering the suprema of functions taken from an arbitrarily defined set of functions. These are called the abstract linear (abstract affine) functions. The purpose of this paper is to…

Optimization and Control · Mathematics 2025-01-30 Reinier Diàz Millàn , Nadezda Sukhorukova , Julien Ugon

We construct a continuous Lagrangian, strictly convex and superlinear in the third variable, such that the associated variational problem has a Lipschitz minimizer which is non-differentiable on a dense set. More precisely, the upper and…

Classical Analysis and ODEs · Mathematics 2015-05-18 Richard Gratwick , David Preiss

This article is devoted to presenting an abstract theory on time-fractional gradient flows for nonconvex energy functionals in Hilbert spaces. Main results consist of local and global in time existence of (continuous) strong solutions to…

Analysis of PDEs · Mathematics 2025-01-15 Goro Akagi , Yoshihito Nakajima

We analyze a preconditioned subgradient method for optimizing composite functions $h \circ c$, where $h$ is a locally Lipschitz function and $c$ is a smooth nonlinear mapping. We prove that when $c$ satisfies a constant rank property and…

Optimization and Control · Mathematics 2022-12-29 Damek Davis , Tao Jiang

Preconditioning is a crucial operation in gradient-based numerical optimisation. It helps decrease the local condition number of a function by appropriately transforming its gradient. For a convex function, where the gradient can be…

Optimization and Control · Mathematics 2023-08-29 Dmitrii A. Pasechnyuk , Alexander Gasnikov , Martin Takáč

For the first time, a globally convergent numerical method is developed and Lipschitz stability estimate is obtained for the challenging problem of travel time tomography in 3D for formally determined incomplete data. The semidiscrete case…

Numerical Analysis · Mathematics 2019-04-16 Michael V. Klibanov

The piecewise-concave function may be used to approximate a wide range of other functions to arbitrary precision over a bounded set. In this short paper, this property is proven for three function classes: (a) the multivariate twice…

Optimization and Control · Mathematics 2014-04-18 Gene A. Bunin

For a function defined on a convex set in a Euclidean space, midpoint convexity is the property requiring that the value of the function at the midpoint of any line segment is not greater than the average of its values at the endpoints of…

Metric Geometry · Mathematics 2019-05-20 Satoko Moriguchi , Kazuo Murota , Akihisa Tamura , Fabio Tardella

In view of training increasingly complex learning architectures, we establish a nonsmooth implicit function theorem with an operational calculus. Our result applies to most practical problems (i.e., definable problems) provided that a…

Machine Learning · Computer Science 2022-04-06 Jérôme Bolte , Tam Le , Edouard Pauwels , Antonio Silveti-Falls

Seminal work by Edmonds and Lovasz shows the strong connection between submodularity and convexity. Submodular functions have tight modular lower bounds, and subdifferentials in a manner akin to convex functions. They also admit poly-time…

Discrete Mathematics · Computer Science 2015-09-09 Rishabh Iyer , Jeff Bilmes

Lower and upper bounds for a given function are important in many mathematical and engineering contexts, where they often serve as a base for both analysis and application. In this short paper, we derive piecewise linear and quadratic…

Optimization and Control · Mathematics 2014-06-17 Gene A. Bunin , Grégory François , Dominique Bonvin

By methods of stochastic analysis on Riemannian manifolds, we derive explicit constants $c\_1(D)$ and $c\_2(D)$ for a $d$-dimensional compact Riemannian manifold $D$ with boundary such that $c\_1(D)\sqrt{\lambda}\|\phi\|\_\infty \le…

Probability · Mathematics 2018-08-14 Marc Arnaudon , Anton Thalmaier , Feng-Yu Wang

We consider flows of ordinary differential equations (ODEs) driven by path differentiable vector fields. Path differentiable functions constitute a proper subclass of Lipschitz functions which admit conservative gradients, a notion of…

Machine Learning · Computer Science 2022-01-12 Swann Marx , Edouard Pauwels

We address the minimization of the sum of a proper, convex and lower semicontinuous with a (possibly nonconvex) smooth function from the perspective of an implicit dynamical system of forward-backward type. The latter is formulated by means…

Optimization and Control · Mathematics 2015-07-07 Radu Ioan Bot , Ernö Robert Csetnek

The primary goal of the paper is to establish characteristic properties of (extended) real-valued functions defined on normed vector spaces that admit the representation as the lower envelope of their minimal (with respect to pointwise…

Optimization and Control · Mathematics 2018-01-08 Valentin V. Gorokhovik