English
Related papers

Related papers: Numerical differentiation: local versus global met…

200 papers

For regression models, most of existing specification tests can be categorized into the class of local smoothing tests and of global smoothing tests. Compared with global smoothing tests, local smoothing tests can only detect local…

Methodology · Statistics 2017-10-18 Lingzhu Li , Lixing Zhu

The gradient discretisation method (GDM) is a generic framework designed recently, as a discretise in spatial space, to partial differential equations. This paper aims to use the GDM to establish a first general error estimate for numerical…

Numerical Analysis · Mathematics 2020-09-22 Yahya Alnashri

We present a computational scheme that derives a global polynomial level set parametrisation for smooth closed surfaces from a regular surface-point set and prove its uniqueness. This enables us to approximate a broad class of smooth…

We deal with the problem of gradient estimation for stochastic differentiable relaxations of algorithms, operators, simulators, and other non-differentiable functions. Stochastic smoothing conventionally perturbs the input of a…

Machine Learning · Computer Science 2024-10-11 Felix Petersen , Christian Borgelt , Aashwin Mishra , Stefano Ermon

The first order derivative of a data density can be estimated efficiently by denoising score matching, and has become an important component in many applications, such as image generation and audio synthesis. Higher order derivatives…

Machine Learning · Computer Science 2021-11-09 Chenlin Meng , Yang Song , Wenzhe Li , Stefano Ermon

In this paper, we present a novel derivative-free optimization framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning involve settings…

Optimization and Control · Mathematics 2024-04-19 Raghu Bollapragada , Cem Karamanli , Stefan M. Wild

A trademark of nonlinear, time-dependent, convection-dominated problems is the spontaneous formation of non-smooth macro-scale features, like shock discontinuities and non-differentiable kinks, which pose a challenge for high-resolution…

Numerical Analysis · Mathematics 2025-10-20 Eitan Tadmor

Based on a regularized Volterra equation, two different approaches for numerical differentiation are considered. The first approach consists of solving a regularized Volterra equation while the second approach is based on solving a…

Numerical Analysis · Mathematics 2007-12-02 N. S. Hoang , A. G. Ramm

We adapt the gradient sampling algorithm to the local scoring algorithm to solve complex estimation problems based on an optimization of an objective function. This overcomes non-differentiability and non-smoothness of the objective…

Methodology · Statistics 2017-05-30 Marc-Olivier Boldi , Valérie Chavez-Demoulin

In this paper, we evaluate dimensionality reduction methods in terms of difficulty in estimating visual information on original images from dimensionally reduced ones. Recently, dimensionality reduction has been receiving attention as the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Masaki Kitayama , Hitoshi Kiya

Global optimization of black-box functions from noisy samples is a fundamental challenge in machine learning and scientific computing. Traditional methods such as Bayesian Optimization often converge to local minima on multi-modal…

Machine Learning · Computer Science 2026-04-07 Qusay Muzaffar , David Levin , Michael Werman

The method of derivative based global sensitivity measures (DGSM) has recently become popular among practitioners. It has a strong link with the Morris screening method and Sobol' sensitivity indices and has several advantages over them.…

Statistics Theory · Mathematics 2023-12-05 Serge Kucherenko , Bertrand Iooss

When combining the numerical concept of variational discretization and semi-smooth Newton methods for the numerical solution of pde constrained optimization with control constraints, special emphasis has to be taken on the implementation,…

Optimization and Control · Mathematics 2009-12-03 Michael Hinze , Morten Vierling

In the paper titled "New numerical approach for fractional differential equations" by A. Atangana and K.M. Owolabi [Math. Model. Nat. Phenom., 13(1), 2018], it is presented a method for the numerical solution of some fractional differential…

Numerical Analysis · Mathematics 2019-02-27 Roberto Garrappa

There exist many applications where it is necessary to approximate numerically derivatives of a function which is given by a computer procedure. In particular, all the fields of optimization have a special interest in such a kind of…

Numerical Analysis · Mathematics 2012-03-15 Yaroslav D. Sergeyev

This book is devoted to finite-dimensional problems of non-convex non-smooth optimization and numerical methods for their solution. The problem of nonconvexity is studied in the book on two main models of nonconvex dependencies: these are…

Optimization and Control · Mathematics 2024-06-18 V. S. Mikhalevich , A. M. Gupal , V. I. Norkin

Partial differential equations (PDEs) are used, with huge success, to model phenomena arising across all scientific and engineering disciplines. However, across an equally wide swath, there exist situations in which PDE models fail to…

Numerical Analysis · Mathematics 2020-12-16 Marta D'Elia , Qiang Du , Christian Glusa , Max Gunzburger , Xiaochuan Tian , Zhi Zhou

This article proposes new perspectives for developing derivative based numerical algorithms, supported by the introduction of a generalized derivative operators. It demonstrates that these operators have the potential to enhance and extend…

General Mathematics · Mathematics 2026-01-13 Flavio Barbosa , Fernando Nogueira

A linear Gaussian state-space smoothing algorithm is presented for estimation of derivatives from a sequence of noisy measurements. The algorithm uses numerically stable square-root formulas, can handle simultaneous independent measurements…

Methodology · Statistics 2016-10-17 Robert Piche

Finite differences have been widely used in mathematical theory as well as in scientific and engineering computations. These concepts are constantly mentioned in calculus. Most frequently-used difference formulas provide excellent…

Numerical Analysis · Mathematics 2010-06-09 Brian Jain , Andrew D. Sheng