English
Related papers

Related papers: The Discrete Adjoint Method: Efficient Derivatives…

200 papers

This paper presents a novel method for analytical derivations of marginal densities using the fractional derivatives of moment-generating functions. Although the method requires likelihood functions to take specific forms, its assumptions…

Methodology · Statistics 2026-04-06 Si-Yang Li , David A. van Dyk , Maximilian Autenrieth

Differential sensitivity measures provide valuable tools for interpreting complex computational models used in applications ranging from simulation to algorithmic prediction. Taking the derivative of the model output in direction of a model…

Computation · Statistics 2024-10-03 Silvana M. Pesenti , Pietro Millossovich , Andreas Tsanakas

The differentiable programming paradigm is a cornerstone of modern scientific computing. It refers to numerical methods for computing the gradient of a numerical model's output. Many scientific models are based on differential equations,…

Traditional nonparametric estimation methods often lead to a slow convergence rate in large dimensions and require unrealistically enormous sizes of datasets for reliable conclusions. We develop an approach based on partial derivatives,…

Methodology · Statistics 2024-08-20 Xiaowu Dai

Discrete gradient methods are a powerful tool for the time discretization of dynamical systems, since they are structure-preserving regardless of the form of the total energy. In this work, we discuss the application of discrete gradient…

Numerical Analysis · Mathematics 2026-01-06 Philipp L. Kinon , Riccardo Morandin , Philipp Schulze

This paper discusses the computation of derivatives for optimization problems governed by linear hyperbolic systems of partial differential equations (PDEs) that are discretized by the discontinuous Galerkin (dG) method. An efficient and…

Numerical Analysis · Mathematics 2013-11-28 Lucas C. Wilcox , Georg Stadler , Tan Bui-Thanh , Omar Ghattas

Sensitivity analysis plays an important role in searching for constitutive parameters (e.g. permeability) subsurface flow simulations. The mathematics behind is to solve a dynamic constrained optimization problem. Traditional methods like…

Computational Physics · Physics 2019-06-05 Shu Wang , Satish Karra , Daniel O'Malley

We give an algorithm to compute the series expansion for the inverse of a given function. The algorithm is extremely easy to implement and gives the first $N$ terms of the series. We show several examples of its application in calculating…

Classical Analysis and ODEs · Mathematics 2007-05-23 Diego Dominici

In recent years, the use of adjoint vectors in Computational Fluid Dynamics (CFD) has seen a dramatic rise. Their utility in numerous applications, including design optimization, data assimilation, and mesh adaptation has sparked the…

Computational Engineering, Finance, and Science · Computer Science 2017-12-05 Steven M. Kast

The article proposes formulating and codifying a set of applied numerical methods, coined as Deep Learning Discrete Calculus (DLDC), that uses the knowledge from discrete numerical methods to interpret the deep learning algorithms through…

Numerical Analysis · Mathematics 2022-12-01 Sourav Saha , Chanwook Park , Stefan Knapik , Jiachen Guo , Owen Huang , Wing Kam Liu

The adjoint method, recently introduced by Evans, is used to study obstacle problems, weakly coupled systems, cell problems for weakly coupled systems of Hamilton-Jacobi equations, and weakly coupled systems of obstacle type. In particular,…

Analysis of PDEs · Mathematics 2013-03-13 Filippo Cagnetti , Diogo Gomes , Hung Tran

Derivatives of differential equation solutions are commonly for parameter estimation, fitting neural differential equations, and as model diagnostics. However, with a litany of choices and a Cartesian product of potential methods, it can be…

Numerical Analysis · Computer Science 2021-07-21 Yingbo Ma , Vaibhav Dixit , Mike Innes , Xingjian Guo , Christopher Rackauckas

Consider a sequence of real-valued functions of a real variable given by a homogeneous linear recursion with differentiable coefficients. We show that if the functions in the sequence are differentiable, then the sequence of derivatives…

Functional Analysis · Mathematics 2025-03-05 Dávid Papp , Kolos Csaba Ágoston

Discrete choice models are commonly used by applied statisticians in numerous fields, such as marketing, economics, finance, and operations research. When agents in discrete choice models are assumed to have differing preferences, exact…

Methodology · Statistics 2010-06-04 Michael Braun , Jon McAuliffe

Gradients have been exploited in proposal distributions to accelerate the convergence of Markov chain Monte Carlo algorithms on discrete distributions. However, these methods require a natural differentiable extension of the target discrete…

Machine Learning · Computer Science 2023-02-28 Yue Xiang , Dongyao Zhu , Bowen Lei , Dongkuan Xu , Ruqi Zhang

Motivated by extending the functional stochastic calculus, to important functionals to which it does not apply, a notion of functional derivative along a curve is introduced. This new setting is developed by incorporating path-dependent…

Probability · Mathematics 2026-04-14 Christian Houdré , Jorge Víquez

Recent studies have shown that fractional calculus is an effective alternative mathematical tool in various scientific fields. However, some investigations indicate that results established in differential and integral calculus do not…

Optimization and Control · Mathematics 2026-03-09 Higor V. M. Ferreira , Camila A. Tavares , Nelson H. T. Lemes , José P. C. dos Santos

We construct explicit easily implementable polynomial approximations of sufficiently high accuracy for locally constant functions on the union of disjoint segments. This problem has important applications in several areas of numerical…

Functional Analysis · Mathematics 2023-11-29 Yuri Malykhin , Konstantin Ryutin

Calibration of large-scale differential equation models to observational or experimental data is a widespread challenge throughout applied sciences and engineering. A crucial bottleneck in state-of-the art calibration methods is the…

Optimization and Control · Mathematics 2021-02-23 Jon Cockayne , Andrew B. Duncan

We present a new software system PETSc TSAdjoint for first-order and second-order adjoint sensitivity analysis of time-dependent nonlinear differential equations. The derivative calculation in PETSc TSAdjoint is essentially a high-level…

Mathematical Software · Computer Science 2021-10-28 Hong Zhang , Emil M. Constantinescu , Barry F. Smith