English
Related papers

Related papers: Structured Diffusion Models with Mixture of Gaussi…

200 papers

Diffusion models offer stable training and state-of-the-art performance for deep generative modeling tasks. Here, we consider their use in the context of multivariate subsurface modeling and probabilistic inversion. We first demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Roberto Miele , Niklas Linde

In recent years, generative diffusion models have achieved a rapid paradigm shift in deep generative models by showing groundbreaking performance across various applications. Meanwhile, structured data, encompassing tabular and time series…

Machine Learning · Computer Science 2023-07-11 Heejoon Koo , To Eun Kim

This paper deals with Bayesian inference of a mixture of Gaussian distributions. A novel formulation of the mixture model is introduced, which includes the prior constraint that each Gaussian component is always assigned a minimal number of…

Methodology · Statistics 2014-05-21 Colin J. Stoneking

Although discrete mixture modeling has formed the backbone of the literature on Bayesian density estimation, there are some well known disadvantages. We propose an alternative class of priors based on random nonlinear functions of a uniform…

Statistics Theory · Mathematics 2015-03-19 Suprateek Kundu , David B. Dunson

Gaussian state space models have been used for decades as generative models of sequential data. They admit an intuitive probabilistic interpretation, have a simple functional form, and enjoy widespread adoption. We introduce a unified…

Machine Learning · Statistics 2016-12-06 Rahul G. Krishnan , Uri Shalit , David Sontag

Solving ill-posed inverse problems requires careful formulation of prior beliefs over the signals of interest and an accurate description of their manifestation into noisy measurements. Handcrafted signal priors based on e.g. sparsity are…

Machine Learning · Computer Science 2025-08-14 Tristan S. W. Stevens , Hans van Gorp , Faik C. Meral , Junseob Shin , Jason Yu , Jean-Luc Robert , Ruud J. G. van Sloun

Model-based reinforcement learning refers to a set of approaches capable of sample-efficient decision making, which create an explicit model of the environment. This model can subsequently be used for learning optimal policies. In this…

Machine Learning · Computer Science 2024-11-19 Théophile Champion , Marek Grześ , Howard Bowman

Generative diffusion processes are an emerging and effective tool for image and speech generation. In the existing methods, the underline noise distribution of the diffusion process is Gaussian noise. However, fitting distributions with…

Machine Learning · Computer Science 2021-06-17 Eliya Nachmani , Robin San Roman , Lior Wolf

We present prompt distribution learning for effectively adapting a pre-trained vision-language model to address downstream recognition tasks. Our method not only learns low-bias prompts from a few samples but also captures the distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Yuning Lu , Jianzhuang Liu , Yonggang Zhang , Yajing Liu , Xinmei Tian

Diffusion models have attracted a lot of attention in recent years. These models view speech generation as a continuous-time process. For efficient training, this process is typically restricted to additive Gaussian noising, which is…

Machine Learning · Computer Science 2025-10-14 Xiaozhou Tan , Minghui Zhao , Anton Ragni

We introduce Diffusion Active Learning, a novel approach that combines generative diffusion modeling with data-driven sequential experimental design to adaptively acquire data for inverse problems. Although broadly applicable, we focus on…

Machine Learning · Computer Science 2025-04-07 Luis Barba , Johannes Kirschner , Tomas Aidukas , Manuel Guizar-Sicairos , Benjamín Béjar

Learning a categorical distribution comes with its own set of challenges. A successful approach taken by state-of-the-art works is to cast the problem in a continuous domain to take advantage of the impressive performance of the generative…

Machine Learning · Computer Science 2023-03-09 Florence Regol , Mark Coates

Bayesian models based on Gaussian processes (GPs) offer a flexible framework to predict spatially distributed variables with uncertainty. But the use of nonstationary priors, often necessary for capturing complex spatial patterns, makes…

Machine Learning · Statistics 2025-06-02 Gabriel V Cardoso , Mike Pereira

Forecasting on sparse multivariate time series (MTS) aims to model the predictors of future values of time series given their incomplete past, which is important for many emerging applications. However, most existing methods process MTS's…

Machine Learning · Computer Science 2021-03-04 Yinjun Wu , Jingchao Ni , Wei Cheng , Bo Zong , Dongjin Song , Zhengzhang Chen , Yanchi Liu , Xuchao Zhang , Haifeng Chen , Susan Davidson

Diffusion models have attained prominence for their ability to synthesize a probability distribution for a given dataset via a diffusion process, enabling the generation of new data points with high fidelity. However, diffusion processes…

Machine Learning · Computer Science 2024-11-25 Shervin Khalafi , Dongsheng Ding , Alejandro Ribeiro

A mixture of variance-gamma distributions is introduced and developed for model-based clustering and classification. The latest in a growing line of non-Gaussian mixture approaches to clustering and classification, the proposed mixture of…

Methodology · Statistics 2014-12-30 Sharon M. McNicholas , Paul D. McNicholas , Ryan P. Browne

Nonparametric Bayesian approaches based on Gaussian processes have recently become popular in the empirical learning community. They encompass many classical methods of statistics, like Radial Basis Functions or various splines, and are…

Data Analysis, Statistics and Probability · Physics 2007-05-23 J. C. Lemm

We explore the estimation of generalized additive models using basis expansion in conjunction with Bayesian model selection. Although Bayesian model selection is useful for regression splines, it has traditionally been applied mainly to…

Methodology · Statistics 2024-09-02 Gyeonghun Kang , Seonghyun Jeong

We propose a novel hierarchical diffusion planner that embeds task and motion structure directly into the noise model. Unlike standard diffusion-based planners that rely on zero-mean, isotropic Gaussian corruption, we introduce…

Robotics · Computer Science 2026-03-17 Amelie Minji Kim , Anqi Wu , Ye Zhao

We give a new algorithm for learning mixtures of $k$ Gaussians (with identity covariance in $\mathbb{R}^n$) to TV error $\varepsilon$, with quasi-polynomial ($O(n^{\text{poly\,log}\left(\frac{n+k}{\varepsilon}\right)})$) time and sample…

Machine Learning · Computer Science 2025-03-05 Khashayar Gatmiry , Jonathan Kelner , Holden Lee