English
Related papers

Related papers: DiCE: The Infinitely Differentiable Monte-Carlo Es…

200 papers

Automatic Chord Estimation (ACE) is a fundamental task in Music Information Retrieval (MIR) and has applications in both music performance and MIR research. The task consists of segmenting a music recording or score and assigning a chord…

Sound · Computer Science 2020-02-25 Daphne Odekerken , Hendrik Vincent Koops , Anja Volk

Monte Carlo is a simple and flexible tool that is widely used in computational finance. In this context, it is common for the quantity of interest to be the expected value of a random variable defined via a stochastic differential equation.…

Numerical Analysis · Mathematics 2015-05-06 Desmond J. Higham

Stochastic differential equations (SDEs) offer powerful and accessible mathematical models for capturing both deterministic and probabilistic aspects of dynamic behavior across a wide range of physical, financial, and social systems.…

Statistics Theory · Mathematics 2026-02-17 Paromita Banerjee , Anirban Mondal

Novelty detection, i.e., identifying whether a given sample is drawn from outside the training distribution, is essential for reliable machine learning. To this end, there have been many attempts at learning a representation well-suited for…

Machine Learning · Computer Science 2020-10-22 Jihoon Tack , Sangwoo Mo , Jongheon Jeong , Jinwoo Shin

Recent progress in deep latent variable models has largely been driven by the development of flexible and scalable variational inference methods. Variational training of this type involves maximizing a lower bound on the log-likelihood,…

Machine Learning · Computer Science 2016-06-02 Andriy Mnih , Danilo J. Rezende

The Monte Carlo dropout method has proved to be a scalable and easy-to-use approach for estimating the uncertainty of deep neural network predictions. This approach was recently applied to Fault Detection and Di-agnosis (FDD) applications…

Machine Learning · Computer Science 2019-09-11 Baihong Jin , Yingshui Tan , Yuxin Chen , Alberto Sangiovanni-Vincentelli

We propose a new Monte Carlo-based estimator for digital options with assets modelled by a stochastic differential equation (SDE). The new estimator is based on repeated path splitting and relies on the correlation of approximate paths of…

Numerical Analysis · Mathematics 2024-06-19 Michael B. Giles , Abdul-Lateef Haji-Ali

Data plays a pivotal role in the groundbreaking advancements in artificial intelligence. The quantitative analysis of data significantly contributes to model training, enhancing both the efficiency and quality of data utilization. However,…

Machine Learning · Computer Science 2025-08-21 Haoru Tan , Sitong Wu , Xiuzhe Wu , Wang Wang , Bo Zhao , Zeke Xie , Gui-Song Xia , Xiaojuan Qi

We introduce a new class of Monte Carlo based approximations of expectations of random variables such that their laws are only available via certain discretizations. Sampling from the discretized versions of these laws can typically…

Computation · Statistics 2017-10-17 Dan Crisan , Pierre Del Moral , Jeremie Houssineau , Ajay Jasra

Derivative-free optimization (DFO) is vital in solving complex optimization problems where only noisy function evaluations are available through an oracle. Within this domain, DFO via finite difference (FD) approximation has emerged as a…

Machine Learning · Computer Science 2025-02-19 Wang Du-Yi , Liang Guo , Liu Guangwu , Zhang Kun

This paper deals with the estimation of rare event probabilities using importance sampling (IS), where an optimal proposal distribution is computed with the cross-entropy (CE) method. Although, IS optimized with the CE method leads to an…

Computation · Statistics 2020-02-05 Patrick Héas

Conventional semi-supervised learning (SSL) ideally assumes that labeled and unlabeled data share an identical class distribution, however in practice, this assumption is easily violated, as unlabeled data often includes unknown class data,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Heejo Kong , Sung-Jin Kim , Gunho Jung , Seong-Whan Lee

We propose an accurate data-driven numerical scheme to solve Stochastic Differential Equations (SDEs), by taking large time steps. The SDE discretization is built up by means of a polynomial chaos expansion method, on the basis of…

Numerical Analysis · Mathematics 2021-09-24 Shuaiqiang Liu , Lech A. Grzelak , Cornelis W. Oosterlee

Discriminative linear models are a popular tool in machine learning. These can be generally divided into two types: The first is linear classifiers, such as support vector machines, which are well studied and provide state-of-the-art…

Machine Learning · Computer Science 2012-07-02 Koby Crammer , Amir Globerson

We introduce an algorithm that simplifies the construction of efficient estimators, making them accessible to a broader audience. 'Dimple' takes as input computer code representing a parameter of interest and outputs an efficient estimator.…

Methodology · Statistics 2025-06-17 Alex Luedtke

Researchers have demonstrated state-of-the-art performance in sequential decision making problems (e.g., robotics control, sequential prediction) with deep neural network models. One often has access to near-optimal oracles that achieve…

Machine Learning · Computer Science 2017-03-06 Wen Sun , Arun Venkatraman , Geoffrey J. Gordon , Byron Boots , J. Andrew Bagnell

Dynamic graphs with ordered sequences of events between nodes are prevalent in real-world industrial applications such as e-commerce and social platforms. However, representation learning for dynamic graphs has posed great computational…

Machine Learning · Computer Science 2021-12-16 Xinshi Chen , Yan Zhu , Haowen Xu , Mengyang Liu , Liang Xiong , Muhan Zhang , Le Song

Steganography schemes are designed with the objective of minimizing a defined distortion function. In most existing state of the art approaches, this distortion function is based on image feature preservation. Since smooth regions or clean…

Multimedia · Computer Science 2016-11-28 Jean-François Couchot , Raphaël Couturier , Yousra Ahmed Fadil , Christophe Guyeux

Discrete optimization problems often arise in deep learning tasks, despite the fact that neural networks typically operate on continuous data. One class of these problems involve objective functions which depend on neural networks, but…

Machine Learning · Computer Science 2023-10-17 Eric Lei , Arman Adibi , Hamed Hassani

Modelers use automatic differentiation (AD) of computation graphs to implement complex Deep Learning models without defining gradient computations. Stochastic AD extends AD to stochastic computation graphs with sampling steps, which arise…

Machine Learning · Statistics 2021-10-27 Emile van Krieken , Jakub M. Tomczak , Annette ten Teije