English
Related papers

Related papers: Variance Reduction Methods for Dirichlet Expectati…

200 papers

In the present paper new light is shed on the non-central extensions of the Dirichlet distribution. Due to several probabilistic and inferential properties and to the easiness of parameter interpretation, the Dirichlet distribution proves…

Statistics Theory · Mathematics 2021-08-02 Carlo Orsi

The Reduced-Basis Control-Variate Monte-Carlo method was introduced recently in [S. Boyaval and T. Leli\`evre, CMS, 8 2010] as an improved Monte-Carlo method, for the fast estimation of many parametrized expected values at many parameter…

Numerical Analysis · Mathematics 2015-06-04 Sébastien Boyaval

Probabilistic models such as logistic regression, Bayesian classification, neural networks, and models for natural language processing, are increasingly more present in both undergraduate and graduate statistics and data science curricula…

Other Statistics · Statistics 2023-05-26 Vojtech Kejzlar , Jingchen Hu

Statistical Data Assimilation (SDA) is the transfer of information from field or laboratory observations to a user selected model of the dynamical system producing those observations. The data is noisy and the model has errors; the…

Computation · Statistics 2019-01-16 Adrian S. Wong , Kangbo Hao , Zheng Fang , Henry D. I. Abarbanel

For complex latent variable models, the likelihood function is not available in closed form. In this context, a popular method to perform parameter estimation is Importance Weighted Variational Inference. It essentially maximizes the…

Statistics Theory · Mathematics 2025-01-16 Badr-Eddine Cherief-Abdellatif , Randal Douc , Arnaud Doucet , Hugo Marival

We know that the marginals in a Dirichlet distribution are beta variates exhibiting a negative correlation. But we can construct two linear combinations of such marginals in such a way to obtain a positive correlation. We discuss the…

Probability · Mathematics 2007-05-23 Mario Catalani

This paper studies the Dirichlet problem for Laplace's equation in a domain $\Omega_{\varepsilon, \eta}$ perforated with small holes, where $\varepsilon$ represents the scale of the minimal distances between holes and $\eta$ the ratio…

Analysis of PDEs · Mathematics 2022-08-26 Zhongwei Shen

We describe and analyze a variance reduction approach for Monte Carlo (MC) sampling that accelerates the estimation of statistics of computationally expensive simulation models using an ensemble of models with lower cost. These lower cost…

Computation · Statistics 2021-05-04 Alex A. Gorodetsky , Gianluca Geraci , Mike Eldred , John D. Jakeman

We develop a pure Monte Carlo method to compute $E(g(X_T))$ where $g$ is a bounded and Lipschitz function and $X_t$ an Ito process. This approach extends a previously proposed method to the general multidimensional case with a SDE with…

Probability · Mathematics 2016-07-18 Mahamadou Doumbia , Nadia Oudjane , Xavier Warin

Modern applications routinely collect high-dimensional data, leading to statistical models having more parameters than there are samples available. A common solution is to impose sparsity in parameter estimation, often using penalized…

Methodology · Statistics 2025-07-08 Paolo Onorati , David B. Dunson , Antonio Canale

Stochastic optimization techniques are standard in variational inference algorithms. These methods estimate gradients by approximating expectations with independent Monte Carlo samples. In this paper, we explore a technique that uses…

Machine Learning · Computer Science 2019-08-15 Mike Wu , Noah Goodman , Stefano Ermon

Recent success in Deep Reinforcement Learning (DRL) methods has shown that policy optimization with respect to an off-policy distribution via importance sampling is effective for sample reuse. In this paper, we show that the use of…

Machine Learning · Computer Science 2023-02-07 Zichuan Lin , Xiapeng Wu , Mingfei Sun , Deheng Ye , Qiang Fu , Wei Yang , Wei Liu

We apply the Monte Carlo method to solving the Dirichlet problem of linear parabolic equations with fractional Laplacian. This method exploit- s the idea of weak approximation of related stochastic differential equations driven by the…

Numerical Analysis · Mathematics 2022-10-28 Caiyu Jiao , Changpin Li

Several techniques exist to assess and reduce nonresponse bias, including propensity models, calibration methods, or post-stratification. These approaches can only be applied after the data collection, and assume reliable information…

Methodology · Statistics 2020-05-26 Blanka Szeitl , Tamás Rudas

We develop stochastic variational inference, a scalable algorithm for approximating posterior distributions. We develop this technique for a large class of probabilistic models and we demonstrate it with two probabilistic topic models,…

Machine Learning · Statistics 2013-04-24 Matt Hoffman , David M. Blei , Chong Wang , John Paisley

We construct the entropic measure $\mathbb{P}^\beta$ on compact manifolds of any dimension. It is defined as the push forward of the Dirichlet process (another random probability measure, well-known to exist on spaces of any dimension)…

Probability · Mathematics 2009-01-14 Karl-Theodor Sturm

We consider stochastic gradient estimation using only black-box function evaluations, where the function argument lies within a probability simplex. This problem is motivated from gradient-descent optimization procedures in multiple…

Optimization and Control · Mathematics 2021-05-20 Henry Lam , Junhui Zhang

Using a hierarchical construction, we develop methods for a wide and flexible class of models by taking a fully parametric approach to generalized linear mixed models with complex covariance dependence. The Laplace approximation is used to…

Methodology · Statistics 2024-07-31 Jay M. Ver Hoef , Eryn Blagg , Michael Dumelle , Philip M. Dixon , Dale L. Zimmerman , Paul Conn

We propose Dirichlet Simplex Nest, a class of probabilistic models suitable for a variety of data types, and develop fast and provably accurate inference algorithms by accounting for the model's convex geometry and low dimensional…

Machine Learning · Statistics 2019-05-28 Mikhail Yurochkin , Aritra Guha , Yuekai Sun , XuanLong Nguyen

Monte Carlo methods, Variational Inference, and their combinations play a pivotal role in sampling from intractable probability distributions. However, current studies lack a unified evaluation framework, relying on disparate performance…

Machine Learning · Computer Science 2024-06-12 Denis Blessing , Xiaogang Jia , Johannes Esslinger , Francisco Vargas , Gerhard Neumann