English
Related papers

Related papers: Variance Reduction Methods for Dirichlet Expectati…

200 papers

We investigate the use of Antithetic Variables, Control Variates and Importance Sampling to reduce the statistical errors of option sensitivities calculated with the Likelihood Ratio Method in Monte Carlo. We show how Antithetic Variables…

Data Analysis, Statistics and Probability · Physics 2008-08-24 Luca Capriotti

This paper introduces a Monte Carlo method for maximum likelihood inference in the context of discretely observed diffusion processes. The method gives unbiased and a.s.\@ continuous estimators of the likelihood function for a family of…

Statistics Theory · Mathematics 2009-03-03 Alexandros Beskos , Omiros Papaspiliopoulos , Gareth Roberts

A natural Monte Carlo method to approximate conditional expectations in a probabilistic framework is justified by a general result inspired on the Besicovitch covering theorem on differentiation of measures. The method is specially useful…

Computation · Statistics 2013-06-06 Agustín G. Nogales , P. Pérez , P. Monfort

With the widespread success of deep neural networks in science and technology, it is becoming increasingly important to quantify the uncertainty of the predictions produced by deep learning. In this paper, we introduce a new method that…

Machine Learning · Computer Science 2019-08-15 Qingyang Wu , He Li , Lexin Li , Zhou Yu

Pareto front learning is a technique that introduces preference vectors in a neural network to approximate the Pareto front. Previous Pareto front learning methods have demonstrated high performance in approximating simple Pareto fronts.…

Machine Learning · Computer Science 2024-04-15 Rongguang Ye , Lei Chen , Weiduo Liao , Jinyuan Zhang , Hisao Ishibuchi

Consider a Dirichlet process mixture model (DPM) with random precision parameter $\alpha$, inducing $K_n$ clusters over $n$ observations through its latent random partition. Our goal is to specify the prior distribution…

Methodology · Statistics 2025-06-03 Carlo Vicentini , Ian Hyla Jermyn

The method of Bayesian variable selection via penalized credible regions separates model fitting and variable selection. The idea is to search for the sparsest solution within the joint posterior credible regions. Although the approach was…

Methodology · Statistics 2016-09-02 Yan Zhang , Howard D. Bondell

Estimating predictive uncertainty is crucial for many computer vision tasks, from image classification to autonomous driving systems. Hamiltonian Monte Carlo (HMC) is an sampling method for performing Bayesian inference. On the other hand,…

Machine Learning · Computer Science 2019-07-03 Diego Vergara , Sergio Hernández , Matias Valdenegro-Toro , Felipe Jorquera

Laplace's method, a family of asymptotic methods used to approximate integrals, is presented as a potential candidate for the tool box of techniques used for knowledge acquisition and probabilistic inference in belief networks with…

Artificial Intelligence · Computer Science 2013-02-28 Adriano Azevedo-Filho , Ross D. Shachter

Matrix Dirichlet processes, in reference to their reversible measure, appear in a natural way in many different models in probability. Applying the language of diffusion operators and the method of boundary equations, we describe Dirichlet…

Probability · Mathematics 2017-07-04 Songzi Li

Importance sampling is a widely used technique to reduce the variance of a Monte Carlo estimator by an appropriate change of measure. In this work, we study importance sam- pling in the framework of diffusion process and consider the change…

Probability · Mathematics 2018-03-28 Carsten Hartmann , Christof Schütte , Marcus Weber , Wei Zhang

We develop and analyze $M$-estimation methods for divergence functionals and the likelihood ratios of two probability distributions. Our method is based on a non-asymptotic variational characterization of $f$-divergences, which allows the…

Statistics Theory · Mathematics 2016-11-18 XuanLong Nguyen , Martin J. Wainwright , Michael I. Jordan

Monte Carlo methods represent a cornerstone of computer science. They allow to sample high dimensional distribution functions in an efficient way. In this paper we consider the extension of Automatic Differentiation (AD) techniques to Monte…

High Energy Physics - Lattice · Physics 2023-07-31 Guilherme Catumba , Alberto Ramos , Bryan Zaldivar

We introduce estimation and test procedures through divergence minimization for models satisfying linear constraints with unknown parameter. Several statistical examples and motivations are given. These procedures extend the empirical…

Statistics Theory · Mathematics 2008-11-24 Michel Broniatowski , Amor Keziou

Inference for Dirichlet process hierarchical models is typically performed using Markov chain Monte Carlo methods, which can be roughly categorised into marginal and conditional methods. The former integrate out analytically the…

Methodology · Statistics 2007-10-24 Omiros Papaspiliopoulos , Gareth Roberts

This paper introduces and studies a new class of nonparametric prior distributions. Random probability distribution functions are constructed via normalization of random measures driven by increasing additive processes. In particular, we…

Statistics Theory · Mathematics 2007-06-13 Luis E. Nieto-Barajas , Igor Prunster , Stephen G. Walker

In this article we consider the approximation of expectations w.r.t. probability distributions associated to the solution of partial differential equations (PDEs); this scenario appears routinely in Bayesian inverse problems. In practice,…

Computation · Statistics 2017-02-07 Alexandros Beskos , Ajay Jasra , Kody Law , Raul Tempone , Yan Zhou

In this article, we consider computing expectations w.r.t. probability measures which are subject to discretization error. Examples include partially observed diffusion processes or inverse problems, where one may have to discretize time…

Computation · Statistics 2021-02-25 Jeremy Heng , Ajay Jasra , Kody J. H. Law , Alexander Tarakanov

Given a collection of categorical data, we want to find the parameters of a Dirichlet distribution which maximizes the likelihood of that data. Newton's method is typically used for this purpose but current implementations require reading…

Machine Learning · Statistics 2023-05-30 Max Sklar

Discrete choice models are commonly used by applied statisticians in numerous fields, such as marketing, economics, finance, and operations research. When agents in discrete choice models are assumed to have differing preferences, exact…

Methodology · Statistics 2010-06-04 Michael Braun , Jon McAuliffe