English
Related papers

Related papers: Automatic Backward Differentiation for American Mo…

200 papers

Probabilistic modeling is iterative. A scientist posits a simple model, fits it to her data, refines it according to her analysis, and repeats. However, fitting complex models to large data is a bottleneck in this process. Deriving…

Machine Learning · Statistics 2016-03-03 Alp Kucukelbir , Dustin Tran , Rajesh Ranganath , Andrew Gelman , David M. Blei

The expectation-maximization (EM) algorithm is a well-known iterative method for computing maximum likelihood estimates from incomplete data. Despite its numerous advantages, a main drawback of the EM algorithm is its frequently observed…

Computation · Statistics 2018-08-14 Nicholas C. Henderson , Ravi Varadhan

American and Bermudan-type financial instruments are often priced with specific Monte Carlo techniques whose efficiency critically depends on the effective dimensionality of the problem and the available computational power. In our work we…

Pricing of Securities · Quantitative Finance 2021-05-04 Riccardo Aiolfi , Nicola Moreni , Marco Bianchetti , Marco Scaringi , Filippo Fogliani

For a real function, automatic differentiation is such a standard algorithm used to efficiently compute its gradient, that it is integrated in various neural network frameworks. However, despite the recent advances in using complex…

Machine Learning · Computer Science 2021-01-19 Chu Guo , Dario Poletti

This course, intended for undergraduates familiar with elementary calculus and linear algebra, introduces the extension of differential calculus to functions on more general vector spaces, such as functions that take as input a matrix and…

History and Overview · Mathematics 2025-01-28 Paige Bright , Alan Edelman , Steven G. Johnson

The "backward simulation" of a stochastic process is defined as the stochastic dynamics that trace a time-reversed path from the target region to the initial configuration. If the probabilities calculated by the original simulation are…

Data Analysis, Statistics and Probability · Physics 2019-01-29 Shinichi Takayanagi , Yukito Iba

A computational revolution unleashed the power of artificial neural networks. At the heart of that revolution is automatic differentiation, which calculates the derivative of a performance measure relative to a large number of parameters.…

Quantitative Methods · Quantitative Biology 2023-12-27 Steven A. Frank

For the numerical solution of the American option valuation problem, we provide a script written in MATLAB implementing an explicit finite difference scheme. Our main contribute is the definition of a posteriori error estimator for the…

Mathematical Finance · Quantitative Finance 2015-04-20 Riccardo Fazio

Automatic differentiation (AD) is conventionally understood as a family of distinct algorithms, rooted in two "modes" -- forward and reverse -- which are typically presented (and implemented) separately. Can there be only one? Following up…

Programming Languages · Computer Science 2022-12-07 Alexey Radul , Adam Paszke , Roy Frostig , Matthew Johnson , Dougal Maclaurin

Invariants are a set of properties over program attributes that are expected to be true during the execution of a program. Since developing those invariants manually can be costly and challenging, there are a myriad of approaches that…

Robotics · Computer Science 2020-12-15 Meriel Stein , Sebastian Elbaum , Lu Feng , Shili Sheng

We propose algorithms for addressing the bias of the posterior mean when used as an estimator of parameters. These algorithms build upon the recently proposed Bayesian infinitesimal jackknife approximation (Giordano and Broderick (2023))…

Methodology · Statistics 2024-09-06 Yukito Iba

We give an auction for downward-closed environments that generalizes the random sampling profit extraction auction for digital goods of Fiat et al. (2002). The mechanism divides the agents in to a market and a sample using a biased coin and…

Computer Science and Game Theory · Computer Science 2012-06-22 Bach Q. Ha , Jason D. Hartline

This work introduces a new approximate proximal sampler that operates solely with zeroth-order information of the potential function. Prior theoretical analyses have revealed that proximal sampling corresponds to alternating forward and…

Machine Learning · Computer Science 2026-03-23 Hirohane Takagi , Atsushi Nitanda

Reverse differentiation is an essential operation for automatic differentiation. Cartesian reverse differential categories axiomatize reverse differentiation in a categorical framework, where one of the primary axioms is the reverse chain…

Logic in Computer Science · Computer Science 2025-09-26 Aaron Biggin , Jean-Simon Pacaud Lemay

Tools for algorithmic differentiation (AD) provide accurate derivatives of computer-implemented functions for use in, e. g., optimization and machine learning (ML). However, they often require the source code of the function to be available…

Mathematical Software · Computer Science 2022-12-29 Max Aehle , Johannes Blühdorn , Max Sagebaum , Nicolas R. Gauger

Bayesian filtering aims at tracking sequentially a hidden process from an observed one. In particular, sequential Monte Carlo (SMC) techniques propagate in time weighted trajectories which represent the posterior probability density…

Computation · Statistics 2012-10-22 Yohan Petetin , François Desbouvries

Robust and reliable covariance estimates play a decisive role in financial and many other applications. An important class of estimators is based on Factor models. Here, we show by extensive Monte Carlo simulations that covariance matrices…

Portfolio Management · Quantitative Finance 2015-03-19 Daniel Bartz , Kerr Hatrick , Christian W. Hesse , Klaus-Robert Müller , Steven Lemm

The use of the Bayesian tools in system identification and model updating paradigms has been increased in the last ten years. Usually, the Bayesian techniques can be implemented to incorporate the uncertainties associated with measurements…

Computational Engineering, Finance, and Science · Computer Science 2017-10-27 M. Sherri , I. Boulkaibet , T. Marwala , M. I. Friswell

High dimensional covariance estimation and graphical models is a contemporary topic in statistics and machine learning having widespread applications. An important line of research in this regard is to shrink the extreme spectrum of the…

Methodology · Statistics 2016-06-28 Sang-Yun Oh , Bala Rajaratnam , Joong-Ho Won

We propose a novel algorithm which allows to sample paths from an underlying price process in a local volatility model and to achieve a substantial variance reduction when pricing exotic options. The new algorithm relies on the construction…

Computational Finance · Quantitative Finance 2015-11-04 Giacomo Bormetti , Giorgia Callegaro , Giulia Livieri , Andrea Pallavicini