English
Related papers

Related papers: On the efficient computation of high-order derivat…

200 papers

Finite differences have been widely used in mathematical theory as well as in scientific and engineering computations. These concepts are constantly mentioned in calculus. Most frequently-used difference formulas provide excellent…

Numerical Analysis · Mathematics 2010-06-09 Brian Jain , Andrew D. Sheng

This paper introduces a new computational framework to derive electromagnetic field derivatives with respect to multiple design parameters up to any order with the Finite-Difference Time-Domain (FDTD) technique. Specifically, only one FDTD…

Signal Processing · Electrical Eng. & Systems 2019-10-23 Kae-An Liu , Costas D. Sarris

A computational revolution unleashed the power of artificial neural networks. At the heart of that revolution is automatic differentiation, which calculates the derivative of a performance measure relative to a large number of parameters.…

Quantitative Methods · Quantitative Biology 2023-12-27 Steven A. Frank

Automatic differentiation (autodiff) has revolutionized machine learning. It allows to express complex computations by composing elementary ones in creative ways and removes the burden of computing their derivatives by hand. More recently,…

This overview is devoted to splitting methods, a class of numerical integrators intended for differential equations that can be subdivided into different problems easier to solve than the original system. Closely connected with this class…

Numerical Analysis · Mathematics 2024-05-08 Sergio Blanes , Fernando Casas , Ander Murua

Financial derivatives are contracts that can have a complex payoff dependent upon underlying benchmark assets. In this work, we present a quantum algorithm for the Monte Carlo pricing of financial derivatives. We show how the relevant…

Quantum Physics · Physics 2018-08-23 Patrick Rebentrost , Brajesh Gupt , Thomas R. Bromley

In view of training increasingly complex learning architectures, we establish a nonsmooth implicit function theorem with an operational calculus. Our result applies to most practical problems (i.e., definable problems) provided that a…

Machine Learning · Computer Science 2022-04-06 Jérôme Bolte , Tam Le , Edouard Pauwels , Antonio Silveti-Falls

A typical system of k difference (or differential) equations can be compressed, or folded into a difference (or ordinary differential) equation of order k. Such foldings appear in control theory as the canonical forms of the controllability…

Dynamical Systems · Mathematics 2014-03-18 H. Sedaghat

Classic algorithms and machine learning systems like neural networks are both abundant in everyday life. While classic computer science algorithms are suitable for precise execution of exactly defined tasks such as finding the shortest path…

Machine Learning · Computer Science 2022-09-02 Felix Petersen

Diffusive representations of fractional differential and integral operators can provide a convenient means to construct efficient numerical algorithms for their approximate evaluation. In the current literature, many different variants of…

Numerical Analysis · Mathematics 2024-07-15 Kai Diethelm

The computation of the Mittag-Leffler (ML) function with matrix arguments, and some applications in fractional calculus, are discussed. In general the evaluation of a scalar function in matrix arguments may require the computation of…

Numerical Analysis · Mathematics 2019-12-03 Roberto Garrappa , Marina Popolizio

Several algorithms in computer algebra involve the computation of a power series solution of a given ordinary differential equation. Over finite fields, the problem is often lifted in an approximate $p$-adic setting to be well-posed. This…

Symbolic Computation · Computer Science 2023-06-12 Pierre Lairez , Tristan Vaccon

This paper provides a new approach to derive various arbitrary high order finite difference formulae for the numerical differentiation of analytic functions. In this approach, various first and second order formulae for the numerical…

Numerical Analysis · Mathematics 2020-05-26 Saint-Cyr E. R. Koyaguerebo-Imé , Yves Bourgault

Pricing a multi-asset derivative is an important problem in financial engineering, both theoretically and practically. Although it is suitable to numerically solve partial differential equations to calculate the prices of certain types of…

Quantum Physics · Physics 2022-07-05 Kenji Kubo , Koichi Miyamoto , Kosuke Mitarai , Keisuke Fujii

We propose a multi-level method to increase the accuracy of machine learning algorithms for approximating observables in scientific computing, particularly those that arise in systems modeled by differential equations. The algorithm relies…

Numerical Analysis · Mathematics 2020-07-06 Kjetil O. Lye , Siddhartha Mishra , Roberto Molinaro

The subdifferential of a function is a generalization for nonsmooth functions of the concept of gradient. It is frequently used in variational analysis, particularly in the context of nonsmooth optimization. The present work proposes…

Optimization and Control · Mathematics 2016-09-13 Charles Audet , Warren Hare

Automatic differentiation---the mechanical transformation of numeric computer programs to calculate derivatives efficiently and accurately---dates to the origin of the computer age. Reverse mode automatic differentiation both antedates and…

Machine Learning · Computer Science 2014-04-30 Atilim Gunes Baydin , Barak A. Pearlmutter

Many modern numerical methods in computational science and engineering rely on derivatives of mathematical models for the phenomena under investigation. The computation of these derivatives often represents the bottleneck in terms of…

Computational Complexity · Computer Science 2021-10-27 Uwe Naumann

The differentiable programming paradigm is a cornerstone of modern scientific computing. It refers to numerical methods for computing the gradient of a numerical model's output. Many scientific models are based on differential equations,…

Differential equations parameterized by neural networks become expensive to solve numerically as training progresses. We propose a remedy that encourages learned dynamics to be easier to solve. Specifically, we introduce a differentiable…

Machine Learning · Computer Science 2020-10-26 Jacob Kelly , Jesse Bettencourt , Matthew James Johnson , David Duvenaud