English
Related papers

Related papers: The subdifferentials of the first and second order…

200 papers

This Note revisits the Leibnitz integral calculus method based on differentiation under the integral sign with respect to a parameter either already existing or introduced ad hoc. Through several cases exemplifying the method, it is shown…

History and Overview · Mathematics 2023-08-21 Jean-Luc Boulnois

We establish some higher differentiability results of integer and fractional order for solution to non-autonomous obstacle problems of the form \begin{equation*} \min \left\{\int_{\Omega}f(x, Dv(x))\,:\, v\in…

Analysis of PDEs · Mathematics 2020-07-09 Andrea Gentile

The article examines Nikolskii and Besov spaces with norms defined using "$L_p$-averaged" mixed moduli of continuity for functions of appropriate orders, instead of mixed moduli of continuity of known orders for certain mixed derivative…

Classical Analysis and ODEs · Mathematics 2024-01-19 S. N. Kudryavtsev

Differentiable optimization layers enable learning systems to make decisions by solving embedded optimization problems. However, computing gradients via implicit differentiation requires solving a linear system with Hessian terms, which is…

Machine Learning · Computer Science 2025-12-03 Zihao Zhao , Kai-Chia Mo , Shing-Hei Ho , Brandon Amos , Kai Wang

{Let $N, k$ be positive integers with $k\geq 2$, and $\Omega \subset \mathbb{R}^{N}$ be a domain.} By the well-known properties of the Laplacian and the gradient, we have \[ \Delta(f\cdot g)(x)=g(x) \Delta f(x)+f(x) \Delta g(x)+2\langle…

Classical Analysis and ODEs · Mathematics 2025-01-29 Włodzimierz Fechner , Eszter Gselmann , Aleksandra Świątczak

The analysis of gradient descent-type methods typically relies on the Lipschitz continuity of the objective gradient. This generally requires an expensive hyperparameter tuning process to appropriately calibrate a stepsize for a given…

Optimization and Control · Mathematics 2023-11-16 Albert S. Berahas , Lindon Roberts , Fred Roosta

The fact that the first variation of a variational functional must vanish along an extremizer is the base of most effective solution schemes to solve problems of the calculus of variations. We generalize the method to variational problems…

Optimization and Control · Mathematics 2018-02-14 Shakoor Pooseh , Ricardo Almeida , Delfim F. M. Torres

These notes focus on the minimization of convex functionals using first-order optimization methods, which are fundamental in many areas of applied mathematics and engineering. The primary goal of this document is to introduce and analyze…

Optimization and Control · Mathematics 2024-10-28 Charles Dossal , Samuel Hurault , Nicolas Papadakis

We introduce the generalized notion of semicontinuity of a function defined on a topological space and derive the useful classification of the so-called Lipschitz derivatives of functions defined on a metric space. Secondly, we investigate…

Functional Analysis · Mathematics 2025-09-26 Oleksandr V. Maslyuchenko , Ziemowit M. Wójcicki

We present two first-order, sequential optimization algorithms to solve constrained optimization problems. We consider a black-box setting with a priori unknown, non-convex objective and constraint functions that have Lipschitz continuous…

Optimization and Control · Mathematics 2020-11-19 Abraham P. Vinod , Arie Israel , Ufuk Topcu

A development of an inverse first-order divided difference operator for functions of several variables is presented. Two generalized derivative-free algorithms builded up from Ostrowski's method for solving systems of nonlinear equations…

Numerical Analysis · Mathematics 2011-10-12 Miquel Grau-Sánchez , Miquel Noguera , Sergio Amat

The unconstrained minimization of a sufficiently smooth objective function $f(x)$ is considered, for which derivatives up to order $p$, $p\geq 2$, are assumed to be available. An adaptive regularization algorithm is proposed that uses…

Optimization and Control · Mathematics 2021-05-31 Coralia Cartis , Nicholas I. M. Gould , Philippe L. Toint

The directional subdifferential of the value function gives an estimate on how much the optimal value changes under a perturbation in a certain direction. In this paper we derive upper estimates for the directional limiting and singular…

Optimization and Control · Mathematics 2023-04-19 Kuang Bai , Jane J. Ye

The forward-backward operator splitting algorithm is one of the most important methods for solving the optimization problem of the sum of two convex functions, where one is differentiable with a Lipschitz continuous gradient and the other…

Optimization and Control · Mathematics 2019-08-30 Yu-Chao Tang , Guo-Rong Wu , Chuan-Xi Zhu

This paper proposes and develops a new Newton-type algorithm to solve subdifferential inclusions defined by subgradients of extended-real-valued prox-regular functions. The proposed algorithm is formulated in terms of the second-order…

Optimization and Control · Mathematics 2022-09-16 Pham Duy Khanh , Boris Mordukhovich , Vo Thanh Phat

In this work we derive a second-order approach to bilevel optimization, a type of mathematical programming in which the solution to a parameterized optimization problem (the "lower" problem) is itself to be optimized (in the "upper"…

Optimization and Control · Mathematics 2022-05-06 Robert Dyro , Edward Schmerling , Nikos Arechiga , Marco Pavone

We discuss variants of construction of measurable subgradients for multivariate convex functions and the problem of characterization of the $\Delta_2$-condition in terms of their directional derivatives. Furthermore we study related basic…

Functional Analysis · Mathematics 2026-04-15 Sergey G. Bobkov , Friedrich Götze

This work provides calculus for the Fr\'echet and limiting subdifferential of the pointwise supremum given by an arbitrary family of lower semicontinuous functions. We start our study showing fuzzy results about the Fr\'echet…

Optimization and Control · Mathematics 2018-12-05 Pedro Pérez-Aros

Our objective in this paper is to introduce and investigate a newly-constructed subclass of normalized analytic and bi-univalent functions by means of the Chebyshev polynomials of the second kind. Upper bounds for the second and third…

Complex Variables · Mathematics 2021-02-18 Feras Yousef , Somaia Alroud , Mohamed Illafe

Let $\Lambda_s$ denote the Lipschitz space of order $s\in(0,\infty)$ on $\mathbb{R}^n$, which consists of all $f\in\mathfrak{C}\cap L^\infty$ such that, for some constant $L\in(0,\infty)$ and some integer $r\in(s,\infty)$, \begin{equation*}…

Functional Analysis · Mathematics 2025-05-23 Feng Dai , Eero Saksman , Dachun Yang , Wen Yuan , Yangyang Zhang