English
Related papers

Related papers: A Taxonomy of Numerical Differentiation Methods

200 papers

Diff is a software program that detects differences between two data sets and is useful in natural language processing. This paper shows several examples of the application of diff. They include the detection of differences between two…

Computation and Language · Computer Science 2007-05-23 Masaki Murata , Hitoshi Isahara

A computational revolution unleashed the power of artificial neural networks. At the heart of that revolution is automatic differentiation, which calculates the derivative of a performance measure relative to a large number of parameters.…

Quantitative Methods · Quantitative Biology 2023-12-27 Steven A. Frank

This paper explores the critical role of differentiation approaches for data-driven differential equation discovery. Accurate derivatives of the input data are essential for reliable algorithmic operation, particularly in real-world…

Machine Learning · Computer Science 2023-11-13 Mikhail Masliaev , Ilya Markov , Alexander Hvatov

We present a computationally efficient algorithm for stable numerical differentiation from noisy, uniformly-sampled data on a bounded interval. The method combines multi-interval Fourier extension approximations with an adaptive domain…

Numerical Analysis · Mathematics 2025-08-29 Zhenyu Zhao , Yanfei Wang , Xinran Liu

Automatic differentiation is involved for long in applied mathematics as an alternative to finite difference to improve the accuracy of numerical computation of derivatives. Each time a numerical minimization is involved, automatic…

Computational Finance · Quantitative Finance 2017-06-08 Sébastien Geeraert , Charles-Albert Lehalle , Barak Pearlmutter , Olivier Pironneau , Adil Reghai

Artificial intelligence has recently experienced remarkable advances, fueled by large models, vast datasets, accelerated hardware, and, last but not least, the transformative power of differentiable programming. This new programming…

Machine Learning · Computer Science 2025-06-25 Mathieu Blondel , Vincent Roulet

We introduce derivative sensitivity, an analogue to local sensitivity for continuous functions. We use this notion in an analysis that determines the amount of noise to be added to the result of a database query in order to obtain a certain…

Cryptography and Security · Computer Science 2018-11-16 Peeter Laud , Alisa Pankova , Martin Pettai

Computer programs often behave differently under different compilers or in different computing environments. Relative debugging is a collection of techniques by which these differences are analysed. Differences may arise because of…

Software Engineering · Computer Science 2013-04-12 John Collins , Brian Farrimond , David Flower , Mark Anderson , David Gill

Classic algorithms and machine learning systems like neural networks are both abundant in everyday life. While classic computer science algorithms are suitable for precise execution of exactly defined tasks such as finding the shortest path…

Machine Learning · Computer Science 2022-09-02 Felix Petersen

Approximation techniques have been historically important for solving differential equations, both as initial value problems and boundary value problems. The integration of numerical, analytic and perturbation methods and techniques can…

Classical Analysis and ODEs · Mathematics 2025-02-25 J. Nathan Kutz

We investigate the benefits and challenges of utilizing the frequency information in differential equation identification. Solving differential equations and Fourier analysis are closely related, yet there is limited work in exploring this…

Numerical Analysis · Mathematics 2023-11-29 Mengyi Tang , Hao Liu , Wenjing Liao , Sung Ha Kang

Discrete numerical methods with finite time-steps represent a practical technique to solve initial-value problems involving nonlinear differential equations. These methods seem particularly useful to the study of chaos since no analytical…

Chaotic Dynamics · Physics 2010-01-01 Lun-Shin Yao

Recently, we have proposed a new diffusive representation for fractional derivatives and, based on this representation, suggested an algorithm for their numerical computation. From the construction of the algorithm, it is immediately…

Numerical Analysis · Mathematics 2022-04-12 Kai Diethelm

Extracting noisy or incorrectly labeled samples from a labeled dataset with hard/difficult samples is an important yet under-explored topic. Two general and often independent lines of work exist, one focuses on addressing noisy labels, and…

Machine Learning · Computer Science 2023-07-21 Mahsa Forouzesh , Patrick Thiran

Discrete mathematics is the foundation of computer science. It focuses on concepts and reasoning methods that are studied using math notations. It has long been argued that discrete math is better taught with programming, which takes…

Computers and Society · Computer Science 2021-10-07 Yanhong A. Liu , Matthew Castelllana

Differential privacy is a de facto standard for statistical computations over databases that contain private data. The strength of differential privacy lies in a rigorous mathematical definition that guarantees individual privacy and yet…

Cryptography and Security · Computer Science 2020-05-05 Gilles Barthe , Rohit Chadha , Vishal Jagannath , A. Prasad Sistla , Mahesh Viswanathan

Finite differences have been widely used in mathematical theory as well as in scientific and engineering computations. These concepts are constantly mentioned in calculus. Most frequently-used difference formulas provide excellent…

Numerical Analysis · Mathematics 2010-06-09 Brian Jain , Andrew D. Sheng

This article introduces the groundbreaking concept of the financial differential machine learning algorithm through a rigorous mathematical framework. Diverging from existing literature on financial machine learning, the work highlights the…

Mathematical Finance · Quantitative Finance 2024-05-03 Pedro Duarte Gomes

Algorithmic differentiation (AD) allows exact computation of derivatives given only an implementation of an objective function. Although many AD tools are available, a proper and efficient implementation of AD methods is not…

Mathematical Software · Computer Science 2018-07-27 Filip Šrajer , Zuzana Kukelova , Andrew Fitzgibbon

Many problems in science and engineering can be represented by a set of partial differential equations (PDEs) through mathematical modeling. Mechanism-based computation following PDEs has long been an essential paradigm for studying topics…

Machine Learning · Computer Science 2022-11-21 Shudong Huang , Wentao Feng , Chenwei Tang , Jiancheng Lv