English
Related papers

Related papers: Automatic differentiation in ML: Where we are and …

200 papers

As an emerging field, Automated Machine Learning (AutoML) aims to reduce or eliminate manual operations that require expertise in machine learning. In this paper, a graph-based architecture is employed to represent flexible combinations of…

Neural and Evolutionary Computing · Computer Science 2019-01-24 Fei Qi , Zhaohui Xia , Gaoyang Tang , Hang Yang , Yu Song , Guangrui Qian , Xiong An , Chunhuan Lin , Guangming Shi

Automatic Differentiation (AD) allows to determine exactly the Taylor series of any function truncated at any order. Here we propose to use AD techniques for Monte Carlo data analysis. We discuss how to estimate errors of a general function…

High Energy Physics - Lattice · Physics 2019-02-07 Alberto Ramos

Automatic differentiation (AD) is conventionally understood as a family of distinct algorithms, rooted in two "modes" -- forward and reverse -- which are typically presented (and implemented) separately. Can there be only one? Following up…

Programming Languages · Computer Science 2022-12-07 Alexey Radul , Adam Paszke , Roy Frostig , Matthew Johnson , Dougal Maclaurin

Automatic differentiation, as implemented today, does not have a simple mathematical model adapted to the needs of modern machine learning. In this work we articulate the relationships between differentiation of programs as implemented in…

Machine Learning · Computer Science 2020-10-30 Jerome Bolte , Edouard Pauwels

We show that Automatic Differentiation (AD) operators can be provided in a dynamic language without sacrificing numeric performance. To achieve this, general forward and reverse AD functions are added to a simple high-level dynamic…

Programming Languages · Computer Science 2016-11-11 Jeffrey Mark Siskind , Barak A. Pearlmutter

MLIR has become popular since it was open sourced in 2019. A sub-project of LLVM, the flexibility provided by MLIR to represent Intermediate Representations (IR) as dialects at different abstraction levels, to mix these, and to leverage…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-04 Nick Brown , Maurice Jamieson , Anton Lydike , Emilien Bauer , Tobias Grosser

In this paper, we present our vision of differentiable ML pipelines called DiffML to automate the construction of ML pipelines in an end-to-end fashion. The idea is that DiffML allows to jointly train not just the ML model itself but also…

Databases · Computer Science 2022-07-06 Benjamin Hilprecht , Christian Hammacher , Eduardo Reis , Mohamed Abdelaal , Carsten Binnig

Derivative-based algorithms are ubiquitous in statistics, machine learning, and applied mathematics. Automatic differentiation offers an algorithmic way to efficiently evaluate these derivatives from computer programs that execute relevant…

Computation · Statistics 2022-03-01 Charles C. Margossian , Michael Betancourt

Differentiable programming allows for derivatives of functions implemented via computer code to be calculated automatically. These derivatives are calculated using automatic differentiation (AD). This thesis explores two applications of…

Plasma Physics · Physics 2024-10-16 Nick McGreivy

Reconstructing force fields (FFs) from atomistic simulation data is a challenge since accurate data can be highly expensive. Here, machine learning (ML) models can help to be data economic as they can be successfully constrained using the…

Chemical Physics · Physics 2022-10-27 Niklas Frederik Schmitz , Klaus-Robert Müller , Stefan Chmiela

This article aims to demonstrate and discuss the applications of automatic differentiation (AD) for finding derivatives in PDE-constrained optimization problems and Jacobians in non-linear finite element analysis. The main idea is to…

Numerical Analysis · Mathematics 2025-06-03 Julian Andrej , Tzanio Kolev , Boyan Lazarov

Automatic differentiation is a set of techniques to efficiently and accurately compute the derivative of a function represented by a computer program. Existing C++ libraries for automatic differentiation (e.g. Adept, Stan Math Library),…

Mathematical Software · Computer Science 2021-02-09 James Yang

We introduce Tritium, an automatic differentiation-based sensitivity analysis framework for differentially private (DP) machine learning (ML). Optimal noise calibration in this setting requires efficient Jacobian matrix computations and…

Machine Learning · Computer Science 2022-04-06 Dmitrii Usynin , Alexander Ziller , Moritz Knolle , Andrew Trask , Kritika Prakash , Daniel Rueckert , Georgios Kaissis

Automatic differentiation is a technique which allows a programmer to define a numerical computation via compositions of a broad range of numeric and computational primitives and have the underlying system support the computation of partial…

Mathematical Software · Computer Science 2017-06-02 Samer Abdallah

For scientific machine learning tasks with a lot of custom code, picking the right Automatic Differentiation (AD) system matters. Our Julia package DifferentiationInterface$.$jl provides a common frontend to a dozen AD backends, unlocking…

Mathematical Software · Computer Science 2025-05-19 Guillaume Dalle , Adrian Hill

A large class of non-smooth practical optimization problems can be written as minimization of a sum of smooth and partly smooth functions. We examine such structured problems which also depend on a parameter vector and study the problem of…

Optimization and Control · Mathematics 2024-10-28 Sheheryar Mehmood , Peter Ochs

Automatic differentiation (AD) is a set of techniques that systematically applies the chain rule to compute the gradients of functions without requiring human intervention. Although the fundamentals of this technology were established…

Machine Learning · Computer Science 2025-09-03 Afif Boudaoud , Alexandru Calotoiu , Marcin Copik , Torsten Hoefler

There is a large space of NUMA and hardware prefetcher configurations that can significantly impact the performance of an application. Previous studies have demonstrated how a model can automatically select configurations based on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-02 Ali TehraniJamsaz , Mihail Popov , Akash Dutta , Emmanuelle Saillard , Ali Jannesari

Differentiation along algorithms, i.e., piggyback propagation of derivatives, is now routinely used to differentiate iterative solvers in differentiable programming. Asymptotics is well understood for many smooth problems but the…

Optimization and Control · Mathematics 2022-06-02 Jérôme Bolte , Edouard Pauwels , Samuel Vaiter

Machine learning (ML) methods are widely used in industrial applications, which usually require a large amount of training data. However, data collection needs extensive time costs and investments in the manufacturing system, and data…

Machine Learning · Computer Science 2024-04-02 Yue Zhao , Yuxuan Li , Chenang Liu , Yinan Wang