English
Related papers

Related papers: Learned harmonic mean estimation of the marginal l…

200 papers

Systems biology relies on mathematical models that often involve complex and intractable likelihood functions, posing challenges for efficient inference and model selection. Generative models, such as normalizing flows, have shown…

Quantitative Methods · Quantitative Biology 2023-12-06 Vincent D. Zaballa , Elliot E. Hui

This paper develops some objective priors for certain parameters of the bivariate normal distribution. The parameters considered are the regression coefficient, the generalized variance, and the ratio of the conditional variance of one…

Statistics Theory · Mathematics 2008-12-18 Malay Ghosh , Upasana Santra , Dalho Kim

Normalizing flows are a powerful class of generative models for continuous random variables, showing both strong model flexibility and the potential for non-autoregressive generation. These benefits are also desired when modeling discrete…

Machine Learning · Statistics 2019-06-06 Zachary M. Ziegler , Alexander M. Rush

Modern Bayesian inference involves a mixture of computational techniques for estimating, validating, and drawing conclusions from probabilistic models as part of principled workflows for data analysis. Typical problems in Bayesian workflows…

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

The sliding window model generalizes the standard streaming model and often performs better in applications where recent data is more important or more accurate than data that arrived prior to a certain time. We study the problem of…

Data Structures and Algorithms · Computer Science 2021-09-06 Vladimir Braverman , Viska Wei , Samson Zhou

Modeling real-world distributions can often be challenging due to sample data that are subjected to perturbations, e.g., instrumentation errors, or added random noise. Since flow models are typically nonlinear algorithms, they amplify these…

Machine Learning · Computer Science 2022-10-11 Sameera Ramasinghe , Kasun Fernando , Salman Khan , Nick Barnes

Probability density function estimation with weighted samples is the main foundation of all adaptive importance sampling algorithms. Classically, a target distribution is approximated either by a non-parametric model or within a parametric…

Machine Learning · Computer Science 2023-10-16 Julien Demange-Chryst , François Bachoc , Jérôme Morio , Timothé Krauth

Tuning of measurement models is challenging in real-world applications of sequential Monte Carlo methods. Recent advances in differentiable particle filters have led to various efforts to learn measurement models through neural networks.…

Artificial Intelligence · Computer Science 2022-03-17 Xiongjie Chen , Yunpeng Li

To model manifold data using normalizing flows, we employ isometric autoencoders to design embeddings with explicit inverses that do not distort the probability distribution. Using isometries separates manifold learning and density…

Machine Learning · Computer Science 2023-05-09 Eike Cramer , Felix Rauh , Alexander Mitsos , Raúl Tempone , Manuel Dahmen

For ill-posed inverse problems, a regularised solution can be interpreted as a mode of the posterior distribution in a Bayesian framework. This framework enriches the set the solutions, as other posterior estimates can be used as a solution…

Statistics Theory · Mathematics 2013-04-22 Natalia Bochkina

We study the normal mean inference problem, which involves simultaneous testing of the means of many normal distributions. This problem has been extensively studied within the empirical Bayes (EB) framework. However, the reliability of most…

Methodology · Statistics 2026-04-03 Kwangok Seo , Johan Lim

Density deconvolution is the task of estimating a probability density function given only noise-corrupted samples. We can fit a Gaussian mixture model to the underlying density by maximum likelihood if the noise is normally distributed, but…

Machine Learning · Statistics 2020-07-14 Tim Dockhorn , James A. Ritchie , Yaoliang Yu , Iain Murray

Normalizing flows are machine-learned maps between different lattice theories which can be used as components in exact sampling and inference schemes. Ongoing work yields increasingly expressive flows on gauge fields, but it remains an open…

Normalizing flows are a class of machine learning models used to construct a complex distribution through a bijective mapping of a simple base distribution. We demonstrate that normalizing flows are particularly well suited as a Monte Carlo…

Nuclear Theory · Physics 2021-08-11 Jack Brady , Pengsheng Wen , Jeremy W. Holt

Estimating the parameters of mathematical models is a common problem in almost all branches of science. However, this problem can prove notably difficult when processes and model descriptions become increasingly complex and an explicit…

Machine Learning · Statistics 2024-02-09 Stefan T. Radev , Ulf K. Mertens , Andreas Voss , Lynton Ardizzone , Ullrich Köthe

Eliciting a high-dimensional probability distribution from an expert via noisy judgments is notoriously challenging, yet useful for many applications, such as prior elicitation and reward modeling. We introduce a method for eliciting the…

Machine Learning · Computer Science 2024-10-17 Petrus Mikkola , Luigi Acerbi , Arto Klami

We propose a framework for computing, optimizing and integrating with respect to a smooth marginal likelihood in statistical models that involve high-dimensional parameters/latent variables and continuous low-dimensional hyperparameters.…

Methodology · Statistics 2026-02-10 Omiros Papaspiliopoulos , Timothée Stumpf-Fétizon , Jonathan Weare

Normalizing Flows are generative models which produce tractable distributions where both sampling and density evaluation can be efficient and exact. The goal of this survey article is to give a coherent and comprehensive review of the…

Machine Learning · Statistics 2020-06-09 Ivan Kobyzev , Simon J. D. Prince , Marcus A. Brubaker

Normalizing flows have emerged as an important family of deep neural networks for modelling complex probability distributions. In this note, we revisit their coupling and autoregressive transformation layers as probabilistic graphical…

Machine Learning · Computer Science 2020-06-05 Antoine Wehenkel , Gilles Louppe