Related papers: The subdifferentials of the first and second order…
We study the optimization of non-convex functions that are not necessarily smooth (gradient and/or Hessian are Lipschitz) using first order methods. Smoothness is a restrictive assumption in machine learning in both theory and practice,…
We introduce a first order Total Variation type regulariser that decomposes a function into a part with a given Lipschitz constant (which is also allowed to vary spatially) and a jump part. The kernel of this regulariser contains all…
This work considers the question: what convergence guarantees does the stochastic subgradient method have in the absence of smoothness and convexity? We prove that the stochastic subgradient method, on any semialgebraic locally Lipschitz…
We define a class of discrete operators acting on infinite, finite or periodic sequences mimicking the standard properties of pseudo-differential operators. In particular we can define the notion of order and regularity, and we recover the…
In this paper we study $2$nd order $L^\infty$ variational problems, through seeking to minimise a supremal functional involving the Hessian of admissible functions as well as lower-order terms. Specifically, given a bounded domain…
The notion of $n$th order convexity in the sense of Hopf and Popoviciu is defined via the nonnegativity of the $(n+1)$st order divided differences of a given real-valued function. In view of the well-known recursive formula for divided…
In this work, we propose a method for minimizing non-convex functions with Lipschitz continuous $p$th-order derivatives, starting from $p \geq 1$. The method, however, only requires derivative information up to order $(p-1)$, since the…
We present and investigate a new type of implicit fractional linear multistep method of order two for fractional initial value problems. The method is obtained from the second order super convergence of the Gr\"unwald-Letnikov approximation…
When a function belonging to a fractional-order Sobolev space is supported in a proper subset of the Lipschitz domain on which the Sobolev space is defined, how is its Sobolev norm as a function on the smaller set compared to its norm on…
In the first part of this paper we establish, in terms of so called k-tangential sets, a kind of optimal estimate for the size and structure of the set of non-differentiability of Lipshitz functions with one-sided directional derivatives.…
In this paper, we will improve and generalize inequality of Ostrowski type for mappings whose second derivatives belong to L$_{1}\left(a,b\right) $ . Some well known inequalities can be derived as special cases. In addition, perturbed…
The paper is devoted to developing subdifferential theory for set-valued mappings taking values in ordered infinite-dimensional spaces. This study is motivated by applications to problems of vector and set optimization with various…
This paper discusses several (sub)gradient methods attaining the optimal complexity for smooth problems with Lipschitz continuous gradients, nonsmooth problems with bounded variation of subgradients, weakly smooth problems with H\"older…
The performance of standard stochastic approximation implementations can vary significantly based on the choice of the steplength sequence, and in general, little guidance is provided about good choices. Motivated by this gap, in the first…
The purpose of this note is to show how calculi on unital associative algebra with universal right bimodule generalize previously studied constructions by Pusz and Woronowicz [1989] and by Wess and Zumino [1990] and that in this language…
The high-order numerical analysis for fractional Laplacian via the Riesz fractional derivative, under the low regularity solution, has presented significant challenges in the past decades. To fill in this gap, we design a grid mapping…
In this paper, we consider a class of structured nonconvex nonsmooth optimization problems, in which the objective function is formed by the sum of a possibly nonsmooth nonconvex function and a differentiable function whose gradient is…
For linear differential equations of the form $u'(t)=[A + B(t)] u(t)$, $t\geq0$, with a possibly unbounded operator $A$, we construct and deduce error bounds for two families of second-order exponential splittings. The role of quadratures…
The L-fractional derivative is defined as a certain normalization of the well-known Caputo derivative, so alternative properties hold: smoothness and finite slope at the origin for the solution, velocity units for the vector field, and a…
Second-order polynomials generalize classical first-order ones in allowing for additional variables that range over functions rather than values. We are motivated by their applications in higher-order computational complexity theory,…