English
Related papers

Related papers: On the approximation of derivatives using divided …

200 papers

We study non-conforming grid interfaces for summation-by-parts finite difference methods applied to partial differential equations with second derivatives in space. To maintain energy stability, previous efforts have been forced to accept a…

Numerical Analysis · Mathematics 2020-02-11 Martin Almquist , Siyang Wang , Jonatan Werpers

Local search heuristics for non-convex optimizations are popular in applied machine learning. However, in general it is hard to guarantee that such algorithms even converge to a local minimum, due to the existence of complicated saddle…

Machine Learning · Computer Science 2016-02-19 Anima Anandkumar , Rong Ge

There exist many applications where it is necessary to approximate numerically derivatives of a function which is given by a computer procedure. In particular, all the fields of optimization have a special interest in such a kind of…

Numerical Analysis · Mathematics 2012-03-15 Yaroslav D. Sergeyev

A consequent approach is proposed to construct symplectic force-gradient algorithms of arbitrarily high orders in the time step for precise integration of motion in classical and quantum mechanics simulations. Within this approach the basic…

Statistical Mechanics · Physics 2009-11-07 Igor Omelyan , Ihor Mryglod , Reinhard Folk

In this paper, we study the distributed optimization problem using approximate first-order information. We suppose the agent can repeatedly call an inexact first-order oracle of each individual objective function and exchange information…

Optimization and Control · Mathematics 2022-08-26 Kui Zhu , Yichen Zhang , Yutao Tang

We introduce a notion of fractional (noninteger order) derivative on an arbitrary nonempty closed subset of the real numbers (on a time scale). Main properties of the new operator are proved and several illustrative examples given.

Classical Analysis and ODEs · Mathematics 2016-09-06 Benaoumeur Bayour , Delfim F. M. Torres

We present a novel approach of discretizing variable coefficient diffusion operators in the context of meshfree generalized finite difference methods. Our ansatz uses properties of derived operators and combines the discrete Laplace…

Numerical Analysis · Mathematics 2024-06-21 Heinrich Kraus , Jörg Kuhnert , Pratik Suchde

Solving partial differential equations (PDEs) efficiently is essential for analyzing complex physical systems. Recent advancements in leveraging deep learning for solving PDE have shown significant promise. However, machine learning…

Machine Learning · Computer Science 2024-02-16 Ruichen Li , Chuwei Wang , Haotian Ye , Di He , Liwei Wang

We consider in this paper a class of single-ratio fractional minimization problems, in which the numerator part of the objective is the sum of a nonsmooth nonconvex function and a smooth nonconvex function while the denominator part is a…

Optimization and Control · Mathematics 2020-12-23 Na Zhang , Qia Li

In this paper, we study optimization methods consisting of iteratively minimizing surrogates of an objective function. By proposing several algorithmic variants and simple convergence analyses, we make two main contributions. First, we…

Machine Learning · Statistics 2013-05-15 Julien Mairal

Optimization methods that make use of derivatives of the objective function up to order $p > 2$ are called tensor methods. Among them, ones that minimize a regularized $p$th-order Taylor expansion at each step have been shown to possess…

Optimization and Control · Mathematics 2025-10-30 Karl Welzel , Yang Liu , Raphael A. Hauser , Coralia Cartis

In many recent applications when new materials and technologies are developed it is important to describe and simulate new nonlinear and nonlocal diffusion transport processes. A general class of such models deals with nonlocal fractional…

Numerical Analysis · Mathematics 2024-12-20 Raimondas Ciegis , Petr Vabishchevich

We aim at computing the derivative of the solution to a parametric optimization problem with respect to the involved parameters. For a class broader than that of strongly convex functions, this can be achieved by automatic differentiation…

Optimization and Control · Mathematics 2019-10-15 Sheheryar Mehmood , Peter Ochs

We propose a new reconstruction operator that aims to recover the missing parts of a function given the observed parts. This new operator belongs to a new, very large class of functional operators which includes the classical regression…

Statistics Theory · Mathematics 2019-05-14 Alois Kneip , Dominik Liebl

It is proved that one cannot approximate stably the first derivative of a smooth function given noisy values of this function and a bound on this function and its first derivative. Such an approximation is shown to be possible if an a…

Mathematical Physics · Physics 2007-05-23 A. G. Ramm

We develop a one step matrix method in order to obtain approximate solutions of first order systems and non-linear ordinary differential equations, reducible to first order systems. We find a sequence of such solutions that converge to the…

Numerical Analysis · Mathematics 2021-07-28 J. J. Alvarez-Sanchez , M. Gadella , L. P. Lara

The unsupervised task of aligning two or more distributions in a shared latent space has many applications including fair representations, batch effect mitigation, and unsupervised domain adaptation. Existing flow-based approaches estimate…

Machine Learning · Computer Science 2022-03-17 Zeyu Zhou , Ziyu Gong , Pradeep Ravikumar , David I. Inouye

In this paper, we propose first-order feasible methods for difference-of-convex (DC) programs with smooth inequality and simple geometric constraints. Our strategy for maintaining feasibility of the iterates is based on a "retraction" idea…

Optimization and Control · Mathematics 2022-12-05 Yongle Zhang , Guoyin Li , Ting Kei Pong , Shiqi Xu

In this work, multi-variable derivative-free optimization algorithms for unconstrained optimization problems are developed. A novel procedure for approximating the gradient of multi-variable objective functions based on non-commutative maps…

Optimization and Control · Mathematics 2021-11-17 Jan Feiling , Mohamed-Ali Belabbas , Christian Ebenbauer

Some new inequalities of Ostrowski type for twice differentiable mappings whose derivatives in absolute value are s-convex in the second sense are given.Applications for special means are also provided.

Classical Analysis and ODEs · Mathematics 2010-06-15 Erhan Set , Mehmet Zeki Sarikaya , M. Emin Ozdemir