English
Related papers

Related papers: Accurate Computation of Marginal Data Densities Us…

200 papers

We propose a method for estimating the posterior distribution of a standard geostatistical model. After choosing the model formulation and specifying a prior, we use normal mixture densities to approximate the posterior distribution. The…

Methodology · Statistics 2014-09-10 Zepu Zhang

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

We consider finite element discretizations of Maxwell's equations coupled with a non-local hydrodynamic Drude model that accurately accounts for electron motions in metallic nanostructures. Specifically, we focus on a posteriori error…

Numerical Analysis · Mathematics 2021-08-04 T. Chaumont-Frelet , S. Lanteri , P. Vega

In Bayesian statistics, the choice of the prior can have an important influence on the posterior and the parameter estimation, especially when few data samples are available. To limit the added subjectivity from a priori information, one…

Methodology · Statistics 2025-12-05 Nils Baillie , Antoine Van Biesbroeck , Clément Gauchy

For the important classical problem of inference on a sparse high-dimensional normal mean vector, we propose a novel empirical Bayes model that admits a posterior distribution with desirable properties under mild conditions. In particular,…

Statistics Theory · Mathematics 2014-10-31 Ryan Martin , Stephen G. Walker

Mutual information (MI) is a fundamental quantity in information theory and machine learning. However, direct estimation of MI is intractable, even if the true joint probability density for the variables of interest is known, as it involves…

Machine Learning · Computer Science 2024-04-29 Rob Brekelmans , Sicong Huang , Marzyeh Ghassemi , Greg Ver Steeg , Roger Grosse , Alireza Makhzani

Consider the Gaussian sequence model under the additional assumption that a fixed fraction of the means is known. We study the problem of variance estimation from a frequentist Bayesian perspective. The maximum likelihood estimator (MLE)…

Statistics Theory · Mathematics 2019-12-19 Gianluca Finocchio , Johannes Schmidt-Hieber

We discuss an approach for deriving robust posterior distributions from $M$-estimating functions using Approximate Bayesian Computation (ABC) methods. In particular, we use $M$-estimating functions to construct suitable summary statistics…

Methodology · Statistics 2019-06-13 Erlis Ruli , Nicola Sartori , Laura Ventura

Density Ratio Estimation has attracted attention from the machine learning community due to its ability to compare the underlying distributions of two datasets. However, in some applications, we want to compare distributions of random…

Machine Learning · Statistics 2020-06-26 Song Liu , Yulong Zhang , Mingxuan Yi , Mladen Kolar

We study full Bayesian procedures for high-dimensional linear regression. We adopt data-dependent empirical priors introduced in [1]. In their paper, these priors have nice posterior contraction properties and are easy to compute. Our paper…

Statistics Theory · Mathematics 2022-02-14 Xiao Fang , Malay Ghosh

Multiple importance sampling (MIS) is an increasingly used methodology where several proposal densities are used to approximate integrals, generally involving target probability density functions. The use of several proposals allows for a…

Statistics Theory · Mathematics 2022-07-12 Rahul Mukerjee , Víctor Elvira

Discrete probability laws underpin statistical modeling, yet the catalog of interpretable distributions has expanded only gradually through centuries of case-by-case mathematical derivations. We introduce symbolic density estimation (SDE),…

Machine Learning · Computer Science 2026-05-25 Ziwen Liu , Meng Li

In this paper, we propose a sequential directional importance sampling (SDIS) method for rare event estimation. SDIS expresses a small failure probability in terms of a sequence of auxiliary failure probabilities, defined by magnifying the…

Computation · Statistics 2022-02-14 Kai Cheng , Iason Papaioannou , Zhenzhou Lu , Xiaobo Zhang , Yanping Wang

In many contexts, there is interest in selecting the most important variables from a very large collection, commonly referred to as support recovery or variable, feature or subset selection. There is an enormous literature proposing a rich…

Computation · Statistics 2015-06-23 Willem van den Boom , Galen Reeves , David B. Dunson

Multivariate density estimation is a popular technique in statistics with wide applications including regression models allowing for heteroskedasticity in conditional variances. The estimation problems become more challenging when…

Methodology · Statistics 2018-08-15 Zhen Li , Lili Wu , Weilian Zhou , Sujit Ghosh

The Minimum Covariance Determinant (MCD) approach robustly estimates the location and scatter matrix using the subset of given size with lowest sample covariance determinant. Its main drawback is that it cannot be applied when the dimension…

Methodology · Statistics 2021-01-13 Kris Boudt , Peter J. Rousseeuw , Steven Vanduffel , Tim Verdonck

Regularization of inverse problems is of paramount importance in computational imaging. The ability of neural networks to learn efficient image representations has been recently exploited to design powerful data-driven regularizers. While…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Maud Biquard , Marie Chabert , Florence Genin , Christophe Latry , Thomas Oberlin

The density ratio of two probability distributions is one of the fundamental tools in mathematical and computational statistics and machine learning, and it has a variety of known applications. Therefore, density ratio estimation from…

Machine Learning · Statistics 2024-06-28 Masanari Kimura , Howard Bondell

This paper introduces a novel density estimator supported on $d$-dimensional half-spaces. It stands out as the first asymmetric kernel density estimator for half-spaces in the literature. Using the multivariate inverse Gaussian (MIG)…

Statistics Theory · Mathematics 2026-03-09 Léo R. Belzile , Alain Desgagné , Christian Genest , Frédéric Ouimet

Soft demodulation of received symbols into bit log-likelihood ratios (LLRs) is at the very heart of multiple-input-multiple-output (MIMO) detection. However, the optimal maximum a posteriori (MAP) detector is complicated and infeasible to…

Signal Processing · Electrical Eng. & Systems 2022-08-18 Jiankun Zhang , Hao Wang , Jing Qian , Zhenxing Gao