English
Related papers

Related papers: Marginalization in Composed Probabilistic Models

200 papers

This article provides a mathematically rigorous introduction to denoising diffusion probabilistic models (DDPMs), sometimes also referred to as diffusion probabilistic models or diffusion models, for generative artificial intelligence. We…

Machine Learning · Computer Science 2024-12-03 Davide Gallon , Arnulf Jentzen , Philippe von Wurstemberger

Estimation of Markov Random Field and covariance models from high-dimensional data represents a canonical problem that has received a lot of attention in the literature. A key assumption, widely employed, is that of {\em sparsity} of the…

Optimization and Control · Mathematics 2018-05-16 Davoud Ataee Tarzanagh , George Michailidis

We introduce a Bayesian perspective for the structured matrix factorization problem. The proposed framework provides a probabilistic interpretation for existing geometric methods based on determinant minimization. We model input data…

Machine Learning · Computer Science 2023-02-17 Gokcan Tatli , Alper T. Erdogan

We consider Gallai's graph Modular Decomposition theory for network analytics. On the one hand, by arguing that this is a choice tool for understanding structural and functional similarities among nodes in a network. On the other, by…

Discrete Mathematics · Computer Science 2018-12-04 Carenne Ludena , Miguel mendez , Nicolas Bolivar

High dimensional statistics deals with the challenge of extracting structured information from complex model settings. Compared with the growing number of frequentist methodologies, there are rather few theoretically optimal Bayes methods…

Statistics Theory · Mathematics 2018-08-21 Chao Gao , Aad W. van der Vaart , Harrison H. Zhou

We consider discrete graphical models Markov with respect to a graph $G$ and propose two distributed marginal methods to estimate the maximum likelihood estimate of the canonical parameter of the model. Both methods are based on a…

Machine Learning · Statistics 2013-10-22 Helene Massam , Nanwei Wang

Bayesian inference in state-space models is challenging due to high-dimensional state trajectories. A viable approach is particle Markov chain Monte Carlo, combining MCMC and sequential Monte Carlo to form "exact approximations" to…

Computation · Statistics 2022-10-27 Anna Wigren , Riccardo Sven Risuleo , Lawrence Murray , Fredrik Lindsten

We introduce a simple, accurate, and extremely efficient method for numerically solving the multi-marginal optimal transport (MMOT) problems arising in density functional theory. The method relies on (i) the sparsity of optimal plans [for…

Machine Learning · Computer Science 2021-03-24 Gero Friesecke , Andreas S. Schulz , Daniela Vögler

The problem of domain generalization is to learn, given data from different source distributions, a model that can be expected to generalize well on new target distributions which are only seen through unlabeled samples. In this paper, we…

Machine Learning · Computer Science 2024-03-12 Markus Holzleitner , Sergei V. Pereverzyev , Werner Zellinger

Markov jump process models have many applications across science. Often, these models are defined on a state-space of product form and only one of the components of the process is of direct interest. In this paper, we extend the marginal…

Quantitative Methods · Quantitative Biology 2018-06-28 Leo Bronstein , Heinz Koeppl

In this paper we consider the problem of computing the stationary distribution of nearly completely decomposable Markov processes, a well-established area in the classical theory of Markov processes with broad applications in the design,…

Numerical Analysis · Mathematics 2025-06-19 Vasileios Kalantzis , Mark S. Squillante , Chai Wah Wu

Likelihood-free methods are an essential tool for performing inference for implicit models which can be simulated from, but for which the corresponding likelihood is intractable. However, common likelihood-free methods do not scale well to…

Methodology · Statistics 2022-07-15 Christopher Drovandi , David J Nott , David T Frazier

With several examples and in an analysis of the Pantheon+ supernova sample we discuss the properties of the marginal posterior distribution versus the profiled posterior distribution -- the profile likelihood in a Bayesian disguise. We…

Cosmology and Nongalactic Astrophysics · Physics 2024-11-05 Martin Kerscher , Jochen Weller

The key distinguishing property of a Bayesian approach is marginalization instead of optimization, not the prior, or Bayes rule. Bayesian inference is especially compelling for deep neural networks. (1) Neural networks are typically…

Machine Learning · Computer Science 2020-01-30 Andrew Gordon Wilson

The goal of this paper is to analyze distributional Markov Decision Processes as a class of control problems in which the objective is to learn policies that steer the distribution of a cumulative reward toward a prescribed target law,…

Optimization and Control · Mathematics 2026-02-09 Nicole Bäuerle , Athanasios Vasileiadis

Computation of the marginal likelihood from a simulated posterior distribution is central to Bayesian model selection but is computationally difficult. I argue that the marginal likelihood can be reliably computed from a posterior sample by…

Instrumentation and Methods for Astrophysics · Physics 2010-06-24 Martin D. Weinberg

In this paper a new approach is derived in the context of shape theory. The implemented methodology is motivated in an open problem proposed in \citet{GM93} about the construction of certain shape density involving Euler hypergeometric…

Statistics Theory · Mathematics 2015-02-04 Francisco J. Caro-Lopera , José A. Díaz-García

This text presents an unified approach of probability and statistics in the pursuit of understanding and computation of randomness in engineering or physical or social system with prediction with generalizability. Starting from elementary…

History and Overview · Mathematics 2024-01-19 Lakshman Mahto

Motivated by the need, in some Bayesian likelihood free inference problems, of imputing a multivariate counting distribution based on its vector of means and variance-covariance matrix, we define a generic multivariate discrete…

Applications · Statistics 2011-03-28 Marcos Capistrán , J. Andrés Christen

The configuration model is a sequence of random graphs constructed such that in the large network limit the degree distribution converges to a pre-specified probability distribution. The component structure of such random graphs can be…

Probability · Mathematics 2019-12-12 Shankar Bhamidi , Amarjit Budhiraja , Paul Dupuis , Ruoyu Wu