English
Related papers

Related papers: Generative Modeling with Bayesian Sample Inference

200 papers

Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and…

Machine Learning · Statistics 2022-11-23 Lei Cheng , Feng Yin , Sergios Theodoridis , Sotirios Chatzis , Tsung-Hui Chang

This paper introduces posterior mean matching (PMM), a new method for generative modeling that is grounded in Bayesian inference. PMM uses conjugate pairs of distributions to model complex data of various modalities like images and text,…

Machine Learning · Computer Science 2024-12-23 Sebastian Salazar , Michal Kucer , Yixin Wang , Emily Casleton , David Blei

Background: Continuous traits evolution of a group of taxa that are correlated through a phylogenetic tree is commonly modelled using parametric stochastic differential equations to represent deterministic change of trait through time,…

Populations and Evolution · Quantitative Biology 2026-04-03 Bayu Brahmantio , Krzysztof Bartoszek , Etka Yapar

We propose a novel generative saliency prediction framework that adopts an informative energy-based model as a prior distribution. The energy-based prior model is defined on the latent space of a saliency generator network that generates…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Jing Zhang , Jianwen Xie , Nick Barnes , Ping Li

Diffusion models generate high-quality synthetic data. They operate by defining a continuous-time forward process which gradually adds Gaussian noise to data until fully corrupted. The corresponding reverse process progressively "denoises"…

Recursive Bayesian inference, in which posterior beliefs are updated in light of accumulating data, is a tool for implementing Bayesian models in applications with streaming and/or very large data sets. As the posterior of one iteration…

Methodology · Statistics 2025-08-05 Henry R. Scharf

Any well-behaved generative model over a variable $\mathbf{x}$ can be expressed as a deterministic transformation of an exogenous ('outsourced') Gaussian noise variable $\mathbf{z}$: $\mathbf{x}=f_\theta(\mathbf{z})$. In such a model (\eg,…

Machine Learning · Computer Science 2025-05-29 Siddarth Venkatraman , Mohsin Hasan , Minsu Kim , Luca Scimeca , Marcin Sendera , Yoshua Bengio , Glen Berseth , Nikolay Malkin

We investigate Bayesian predictive inference for finite population quantities when there are unequal probabilities of selection. Only limited information about the sample design is available; i.e., only the first-order selection…

Methodology · Statistics 2018-04-10 Junheng Ma , Joe Sedransk , Balgobin Nandram , Lu Chen

We present a new inference method based on approximate Bayesian computation for estimating parameters governing an entire network based on link-traced samples of that network. To do this, we first take summary statistics from an observed…

Computation · Statistics 2017-01-17 Jack Davis , Steven K. Thompson

Modern generative models can produce realistic samples, however, balancing memorisation and generalisation remains an open problem. We approach this challenge from a Bayesian perspective by focusing on the parameter space of flow matching…

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

Deep generative models produce data according to a learned representation, e.g. diffusion models, through a process of approximation computing possible samples. Approximation can be understood as reconstruction and the large datasets used…

Human-Computer Interaction · Computer Science 2023-09-25 Luís Arandas , Mick Grierson , Miguel Carvalhais

Recent studies suggest utilizing generative models instead of traditional auto-regressive algorithms for time series forecasting (TSF) tasks. These non-auto-regressive approaches involving different generative methods, including GAN,…

Machine Learning · Computer Science 2025-03-19 Jiangxuan Long , Zhao Song , Chiwun Yang

We develop a Bayesian approach for selecting the model which is the most supported by the data within a class of marginal models for categorical variables formulated through equality and/or inequality constraints on generalised logits…

Statistics Theory · Mathematics 2012-02-21 Francesco Bartolucci , Luisa Scaccia , Alessio Farcomeni

This paper considers the objective comparison of stochastic models to solve inverse problems, more specifically image restoration. Most often, model comparison is addressed in a supervised manner, that can be time-consuming and partly…

Computation · Statistics 2020-10-14 Benjamin Harroué , Jean-François Giovannelli , Marcelo Pereyra

Generative probability models are widely used for speaker verification (SV). However, the generative models are lack of discriminative feature selection ability. As a hypothesis test, the SV can be regarded as a binary classification task…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-08 Xugang Lu , Peng Shen , Yu Tsao , Hisashi Kawai

In this paper, we introduce the notion of Gaussian processes indexed by probability density functions for extending the Mat\'ern family of covariance functions. We use some tools from information geometry to improve the efficiency and the…

Methodology · Statistics 2020-11-09 A. Fradi , Y. Feunteun , C. Samir , M. Baklouti , F. Bachoc , J-M. Loubes

The shape of an object is an important characteristic for many vision problems such as segmentation, detection and tracking. Being independent of appearance, it is possible to generalize to a large range of objects from only small amounts…

Machine Learning · Statistics 2018-12-14 Alessandro Di Martino , Erik Bodin , Carl Henrik Ek , Neill D. F. Campbell

Gaussian Process Networks (GPNs) are a class of directed graphical models which employ Gaussian processes as priors for the conditional expectation of each variable given its parents in the network. The model allows the description of…

Machine Learning · Statistics 2024-02-20 Enrico Giudice , Jack Kuipers , Giusi Moffa

We study Bayesian discriminative inference given a model family $p(c,\x, \theta)$ that is assumed to contain all our prior information but still known to be incorrect. This falls in between "standard" Bayesian generative modeling and…

Machine Learning · Statistics 2008-11-18 Jarkko Salojärvi , Kai Puolamäki , Eerika Savia , Samuel Kaski