中文
相关论文

相关论文: End-To-End Learning of Gaussian Mixture Priors for…

200 篇论文

A longstanding problem in machine learning is to find unsupervised methods that can learn the statistical structure of high dimensional signals. In recent years, GANs have gained much attention as a possible solution to the problem, and in…

计算机视觉与模式识别 · 计算机科学 2018-11-06 Eitan Richardson , Yair Weiss

Masked generative models (MGMs) have shown impressive generative ability while providing an order of magnitude efficient sampling steps compared to continuous diffusion models. However, MGMs still underperform in image synthesis compared to…

计算机视觉与模式识别 · 计算机科学 2024-10-18 Jiwan Hur , Dong-Jae Lee , Gyojin Han , Jaehyun Choi , Yunho Jeon , Junmo Kim

Bayesian Last Layer (BLL) models focus solely on uncertainty in the output layer of neural networks, demonstrating comparable performance to more complex Bayesian models. However, the use of Gaussian priors for last layer weights in…

机器学习 · 计算机科学 2024-08-08 Jian Xu , Zhiqi Lin , Shigui Li , Min Chen , Junmei Yang , Delu Zeng , John Paisley

This paper is concerned with the approximation of probability distributions known up to normalization constants, with a focus on Bayesian inference for large-scale inverse problems in scientific computing. In this context, key challenges…

机器学习 · 计算机科学 2025-06-10 Baojun Che , Yifan Chen , Zhenghao Huan , Daniel Zhengyu Huang , Weijie Wang

Mixture models with Gamma and or inverse-Gamma distributed mixture components are useful for medical image tissue segmentation or as post-hoc models for regression coefficients obtained from linear regression within a Generalised Linear…

机器学习 · 统计学 2016-07-27 A. Llera , D. Vidaurre , R. H. R. Pruim , C. F. Beckmann

In this paper, we study the problem of learning one-dimensional Gaussian mixture models (GMMs) with a specific focus on estimating both the model order and the mixing distribution from independent and identically distributed (i.i.d.)…

机器学习 · 统计学 2026-02-24 Xinyu Liu , Hai Zhang

We establish in-expectation and tail bounds on the generalization error of representation learning type algorithms. The bounds are in terms of the relative entropy between the distribution of the representations extracted from the training…

机器学习 · 统计学 2025-03-21 Milad Sefidgaran , Abdellatif Zaidi , Piotr Krasnowski

Gaussian Process (GP) regression is shown to be effective for learning unknown dynamics, enabling efficient and safety-aware control strategies across diverse applications. However, existing GP-based model predictive control (GP-MPC)…

系统与控制 · 电气工程与系统科学 2025-05-13 Manish Prajapat , Johannes Köhler , Amon Lahr , Andreas Krause , Melanie N. Zeilinger

Continual learning in neural networks aims to learn new tasks without forgetting old tasks. Sequential function-space variational inference (SFSVI) uses a Gaussian variational distribution to approximate the distribution of the outputs of…

机器学习 · 计算机科学 2025-05-28 Menghao Waiyan William Zhu , Pengcheng Hao , Ercan Engin Kuruoğlu

We study Bayesian estimation of finite mixture models in a general setup where the number of components is unknown and allowed to grow with the sample size. An assumption on growing number of components is a natural one as the degree of…

统计理论 · 数学 2022-03-18 Ilsang Ohn , Lizhen Lin

Diffusion models have emerged as an expressive family of generative models rivaling GANs in sample quality and autoregressive models in likelihood scores. Standard diffusion models typically require hundreds of forward passes through the…

机器学习 · 计算机科学 2022-02-14 Daniel Watson , William Chan , Jonathan Ho , Mohammad Norouzi

GNSS localization is an important part of today's autonomous systems, although it suffers from non-Gaussian errors caused by non-line-of-sight effects. Recent methods are able to mitigate these effects by including the corresponding…

机器人学 · 计算机科学 2020-03-20 Tim Pfeifer , Peter Protzel

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

机器学习 · 计算机科学 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu

Effective implementations of sampling-based probabilistic inference often require manually constructed, model-specific proposals. Inspired by recent progresses in meta-learning for training learning agents that can generalize to unseen…

人工智能 · 计算机科学 2019-01-03 Tongzhou Wang , Yi Wu , David A. Moore , Stuart J. Russell

This paper explores the challenges and benefits of a trainable destruction process in diffusion samplers -- diffusion-based generative models trained to sample an unnormalised density without access to data samples. Contrary to the majority…

We develop a framework for approximating collapsed Gibbs sampling in generative latent variable cluster models. Collapsed Gibbs is a popular MCMC method, which integrates out variables in the posterior to improve mixing. Unfortunately for…

机器学习 · 统计学 2018-07-23 Christopher Aicher , Emily B. Fox

Training generative models to sample from unnormalized density functions is an important and challenging task in machine learning. Traditional training methods often rely on the reverse Kullback-Leibler (KL) divergence due to its…

机器学习 · 计算机科学 2025-03-05 Jiajun He , Wenlin Chen , Mingtian Zhang , David Barber , José Miguel Hernández-Lobato

Denoising diffusions are state-of-the-art generative models exhibiting remarkable empirical performance. They work by diffusing the data distribution into a Gaussian distribution and then learning to reverse this noising process to obtain…

机器学习 · 统计学 2024-02-20 Joe Benton , Yuyang Shi , Valentin De Bortoli , George Deligiannidis , Arnaud Doucet

Generative diffusion models for end-to-end autonomous driving often suffer from mode collapse, tending to generate conservative and homogeneous behaviors. While DiffusionDrive employs predefined anchors representing different driving…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Jialv Zou , Shaoyu Chen , Bencheng Liao , Zhiyu Zheng , Yuehao Song , Lefei Zhang , Qian Zhang , Wenyu Liu , Xinggang Wang

Finite mixture models are frequently used to uncover latent structures in high-dimensional datasets (e.g.\ identifying clusters of patients in electronic health records). The inference of such structures can be performed in a Bayesian…