English
Related papers

Related papers: Adjoints and Automatic (Algorithmic) Differentiati…

200 papers

Automatic Differentiation (AD) allows to determine exactly the Taylor series of any function truncated at any order. Here we propose to use AD techniques for Monte Carlo data analysis. We discuss how to estimate errors of a general function…

High Energy Physics - Lattice · Physics 2019-02-07 Alberto Ramos

We present a GPU-based system for automatic differentiation (AD) of functions defined on triangle meshes, designed to exploit the locality and sparsity in mesh-based computation. Our system evaluates derivatives using per-element…

Graphics · Computer Science 2026-02-03 Ahmed H. Mahmoud , Rahul Goel , Jonathan Ragan-Kelley , Justin Solomon

Recently, we have proposed a new diffusive representation for fractional derivatives and, based on this representation, suggested an algorithm for their numerical computation. From the construction of the algorithm, it is immediately…

Numerical Analysis · Mathematics 2022-04-12 Kai Diethelm

Adversarial Optimization (AO) provides a reliable, practical way to match two implicitly defined distributions, one of which is usually represented by a sample of real data, and the other is defined by a generator. Typically, AO involves…

Machine Learning · Computer Science 2020-05-26 Maxim Borisyak , Tatiana Gaintseva , Andrey Ustyuzhanin

We consider upper and lower bounds for maxmin allocations of a completely divisible good in both competitive and cooperative strategic contexts. We then derive a subgradient algorithm to compute the exact value up to any fixed degree of…

Optimization and Control · Mathematics 2017-03-24 Marco Dall'Aglio , Camilla Di Luca

A characteristic feature of differential-algebraic equations is that one needs to find derivatives of some of their equations with respect to time, as part of so called index reduction or regularisation, to prepare them for numerical…

Numerical Analysis · Mathematics 2017-03-28 John D. Pryce , Nedialko S. Nedialkov , Guangning Tan , Xiao Li

Adjoint logic is a general approach to combining multiple logics with different structural properties, including linear, affine, strict, and (ordinary) intuitionistic logics, where each proposition has an intrinsic mode of truth. It has…

Logic in Computer Science · Computer Science 2024-02-05 Junyoung Jang , Sophia Roshal , Frank Pfenning , Brigitte Pientka

The ambiguity function is fundamental to radar waveform design, characterizing range and Doppler resolution capabilities. However, its traditional formulation involves non-differentiable operations, preventing integration with…

Signal Processing · Electrical Eng. & Systems 2025-07-01 Marc Bara Iniesta

The numerical methods for differential equation solution allow obtaining a discrete field that converges towards the solution if the method is applied to the correct problem. Nevertheless, the numerical methods have the restricted class of…

Numerical Analysis · Mathematics 2023-07-03 Alexander Hvatov , Tatiana Tikhonova

Fair division is the problem of dividing one or several goods amongst two or more agents in a way that satisfies a suitable fairness criterion. These Notes provide a succinct introduction to the field. We cover three main topics. First, we…

Artificial Intelligence · Computer Science 2018-06-13 Ulle Endriss

The computation of Greeks is a fundamental task for risk managing of financial instruments. The standard approach to their numerical evaluation is via finite differences. Most exotic derivatives are priced via Monte Carlo simulation: in…

Computational Finance · Quantitative Finance 2021-06-24 Andrea Maran , Andrea Pallavicini , Stefano Scoleri

Differentiable programming, enabled by automatic differentiation (AD), provides a robust framework for gradient-based optimization in computational plasma physics. While optimization is often only used towards design, we demonstrate that it…

Plasma Physics · Physics 2026-03-13 A. S. Joglekar , A. G. R. Thomas , A. L. Milder , K. G. Miller , J. P. Palastro , D. H. Froula

The field of algorithms with predictions incorporates machine learning advice in the design of online algorithms to improve real-world performance. A central consideration is the extent to which predictions can be trusted -- while existing…

Machine Learning · Statistics 2026-03-26 Judy Hanwen Shen , Ellen Vitercik , Anders Wikum

We address the problem of parameter estimation in models of systems biology from noisy observations. The models we consider are characterized by simultaneous deterministic nonlinear differential equations whose parameters are either taken…

Machine Learning · Statistics 2017-05-01 Xin Liu , Mahesan Niranjan

Automatic differentiation (AD) aims to compute derivatives of user-defined functions, but in Turing-complete languages, this simple specification does not fully capture AD's behavior: AD sometimes disagrees with the true derivative of a…

Programming Languages · Computer Science 2021-12-07 Alexander K. Lew , Mathieu Huot , Vikash K. Mansinghka

The Alternating Direction Method of Multipliers (ADMM) has been studied for years. The traditional ADMM algorithm needs to compute, at each iteration, an (empirical) expected loss function on all training examples, resulting in a…

Machine Learning · Statistics 2014-06-10 Peilin Zhao , Jinwei Yang , Tong Zhang , Ping Li

Differentiable economics, which uses neural networks as function approximators and gradient-based optimization in automated mechanism design (AMD), marked a significant breakthrough with the introduction of RegretNet…

Computer Science and Game Theory · Computer Science 2025-02-03 Mai Pham , Vikrant Vaze , Peter Chin

Calibration is a basic property for prediction systems, and algorithms for achieving it are well-studied in both statistics and machine learning. In many applications, however, the predictions are used to make decisions that select which…

Computer Science and Game Theory · Computer Science 2012-11-19 H. Brendan McMahan , Omkar Muralidharan

The known Complex Step Derivative (CSD) method allows easy and accurate differentiation up to machine precision of real analytic functions by evaluating them a small imaginary step next to the real number line. The current paper proposes…

Numerical Analysis · Mathematics 2021-06-18 Martin Roelfs , David Dudal , Daan Huybrechs

A recent approach to automated mechanism design, differentiable economics, represents auctions by rich function approximators and optimizes their performance by gradient descent. The ideal auction architecture for differentiable economics…

Computer Science and Game Theory · Computer Science 2022-02-08 Michael Curry , Tuomas Sandholm , John Dickerson