Related papers: On the approximation of derivatives using divided …
Higher-order tensor methods were recently proposed for minimizing smooth convex and nonconvex functions. Higher-order algorithms accelerate the convergence of the classical first-order methods thanks to the higher-order derivatives used in…
This paper addresses the study of derivative-free smooth optimization problems, where the gradient information on the objective function is unavailable. Two novel general derivative-free methods are proposed and developed for minimizing…
This paper is devoted to studying the first-order variational analysis of non-convex and non-differentiable functions that may not be subdifferentially regular. To achieve this goal, we entirely rely on two concepts of directional…
In this paper, we present a new numerical method to solve fractional differential equations. Given a fractional derivative of arbitrary real order, we present an approximation formula for the fractional operator that involves integer-order…
Discrete gradient methods are a class of numerical integrators producing solutions with exact preservation of first integrals of ordinary differential equations. In this paper, we apply order theory combined with the symmetrized Itoh--Abe…
We extend the nonlocal operator method to higher order scheme by using a higher order Taylor series expansion of the unknown field. Such a higher order scheme improves the original nonlocal operator method proposed by the authors in [A…
A class of high-order numerical algorithms for Riesz derivatives are established through constructing new generating functions. Such new high-order formulas can be regarded as the modification of the classical (or shifted) Lubich's…
The Obreshkov method is a single-step multi-derivative method used in the numerical solution of differential equations and has been used in recent years in efficient circuit simulation. It has been shown that it can be made of arbitrary…
In the article we propose a general scheme for solutions of some approximation problems under a rather general setting. We illustrate the application of the proposed scheme by a series of examples, in particular we show that many results in…
This paper considers the distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of local cost functions by using local information exchange. We first consider a distributed first-order primal-dual…
Recent theoretical work on automatic differentiation (autodiff) has focused on characteristics such as correctness and efficiency while assuming that all derivatives are automatically generated by autodiff using program transformation, with…
Because of the nonlocal properties of fractional operators, higher order schemes play more important role in discretizing fractional derivatives than classical ones. The striking feature is that higher order schemes of fractional…
A novel class of derivative-free optimization algorithms is developed. The main idea is to utilize certain non-commutative maps in order to approximate the gradient of the objective function. Convergence properties of the novel algorithms…
Conventional finite-difference schemes for solving partial differential equations are based on approximating derivatives by finite-differences. In this work, an alternative theory is proposed which view finite-difference schemes as…
In this paper we first extend a generalization of Ostrowski type inequality on time scales for functions whose derivatives are bounded and then unify corresponding continuous and discrete versions. We also point out some particular integral…
We introduce basic aspects of new operator method, which is very suitable for practical solving differential equations of various types. The main advantage of the method is revealed in opportunity to find compact exact operator solutions of…
Motivated by the problem of solving the Einstein equations, we discuss high order finite difference discretizations of first order in time, second order in space hyperbolic systems.Particular attention is paid to the case when first order…
In this article we introduce a finite difference approximation for integro-differential operators of L\'evy type. We approximate solutions of integro-differential equations, where the second order operator is allowed to degenerate. In the…
A class of second order approximations, called the weighted and shifted Gr\"{u}nwald difference operators, are proposed for Riemann-Liouville fractional derivatives, with their effective applications to numerically solving space fractional…
We present a new numerical tool to solve partial differential equations involving Caputo derivatives of fractional variable order. Three Caputo-type fractional operators are considered, and for each one of them an approximation formula is…