中文
相关论文

相关论文: Generative Particle Variational Inference via Esti…

200 篇论文

Inspired by the seminal work on Stein Variational Inference and Stein Variational Policy Gradient, we derived a method to generate samples from the posterior variational parameter distribution by \textit{explicitly} minimizing the KL…

机器学习 · 计算机科学 2018-03-28 Tianbing Xu

Ensemble weather forecasts based on multiple runs of numerical weather prediction models typically show systematic errors and require post-processing to obtain reliable forecasts. Accurately modeling multivariate dependencies is crucial in…

大气与海洋物理 · 物理学 2024-02-02 Jieyu Chen , Tim Janke , Florian Steinke , Sebastian Lerch

Given some observed data and a probabilistic generative model, Bayesian inference aims at obtaining the distribution of a model's latent parameters that could have yielded the data. This task is challenging for large population studies…

人工智能 · 计算机科学 2022-06-13 Louis Rouillard , Thomas Moreau , Demian Wassermann

In this paper, we propose generative probabilistic models for label aggregation. We use Gibbs sampling and a novel variational inference algorithm to perform the posterior inference. Empirical results show that our methods consistently…

人工智能 · 计算机科学 2017-10-04 Chi Hong

A multi-layer deep Gaussian process (DGP) model is a hierarchical composition of GP models with a greater expressive power. Exact DGP inference is intractable, which has motivated the recent development of deterministic and stochastic…

机器学习 · 计算机科学 2019-10-29 Haibin Yu , Yizhou Chen , Zhongxiang Dai , Kian Hsiang Low , Patrick Jaillet

Obtaining high certainty in predictive models is crucial for making informed and trustworthy decisions in many scientific and engineering domains. However, extensive experimentation required for model accuracy can be both costly and…

机器学习 · 计算机科学 2024-12-17 Giorgio Morales , John Sheppard

Building on the remarkable achievements in generative sampling of natural images, we propose an innovative challenge, potentially overly ambitious, which involves generating samples of entire multivariate time series that resemble images.…

Variational inference transforms posterior inference into parametric optimization thereby enabling the use of latent variable models where otherwise impractical. However, variational inference can be finicky when different variational…

机器学习 · 计算机科学 2019-12-03 Da Tang , Rajesh Ranganath

Gaussian Processes (GPs) provide a flexible and statistically principled foundation for modelling spatiotemporal phenomena, but their $O(N^3)$ scaling makes them intractable for large datasets. Approximate methods such as variational…

机器学习 · 统计学 2026-04-01 Jhonathan Navott , Daniel Jenson , Seth Flaxman , Elizaveta Semenova

Stein Variational Gradient Descent (SVGD) is a nonparametric particle-based deterministic sampling algorithm. Despite its wide usage, understanding the theoretical properties of SVGD has remained a challenging problem. For sampling from a…

统计理论 · 数学 2023-10-31 Tianle Liu , Promit Ghosal , Krishnakumar Balasubramanian , Natesh S. Pillai

Recent work has suggested using Monte Carlo methods based on piecewise deterministic Markov processes (PDMPs) to sample from target distributions of interest. PDMPs are non-reversible continuous-time processes endowed with momentum, and…

机器学习 · 统计学 2024-06-28 Paul Fearnhead , Sebastiano Grazzi , Chris Nemeth , Gareth O. Roberts

Amortized variational inference (AVI) replaces instance-specific local inference with a global inference network. While AVI has enabled efficient training of deep generative models such as variational autoencoders (VAE), recent empirical…

机器学习 · 统计学 2018-07-25 Yoon Kim , Sam Wiseman , Andrew C. Miller , David Sontag , Alexander M. Rush

Particle-based variational inference (VI) minimizes the KL divergence between model samples and the target posterior with gradient flow estimates. With the popularity of Stein variational gradient descent (SVGD), the focus of particle-based…

机器学习 · 统计学 2023-04-19 Hanze Dong , Xi Wang , Yong Lin , Tong Zhang

Computer vision is hard because of a large variability in lighting, shape, and texture; in addition the image signal is non-additive due to occlusion. Generative models promised to account for this variability by accurately modelling the…

计算机视觉与模式识别 · 计算机科学 2015-03-10 Varun Jampani , Sebastian Nowozin , Matthew Loper , Peter V. Gehler

This paper explores the interplay between statistics and generative artificial intelligence. Generative statistics, an integral part of the latter, aims to construct models that can generate efficiently and meaningfully new data across the…

统计方法学 · 统计学 2025-02-25 Bing Cheng , Howell Tong

Learning generative models for graph-structured data is challenging because graphs are discrete, combinatorial, and the underlying data distribution is invariant to the ordering of nodes. However, most of the existing generative models for…

机器学习 · 计算机科学 2020-03-03 Chenhao Niu , Yang Song , Jiaming Song , Shengjia Zhao , Aditya Grover , Stefano Ermon

Bayesian inference provides principled uncertainty quantification, but accurate posterior sampling with MCMC can be computationally prohibitive for modern applications. Variational inference (VI) offers a scalable alternative and often…

统计方法学 · 统计学 2026-05-14 Laura Battaglia , Stefano Cortinovis , Chris Holmes , David T. Frazier , Jack Jewson

Gradient-based sampling algorithms have demonstrated their effectiveness in text generation, especially in the context of controlled text generation. However, there exists a lack of theoretically grounded and principled approaches for this…

计算与语言 · 计算机科学 2024-06-07 Afra Amini , Li Du , Ryan Cotterell

Developing efficient solutions for inference problems in intelligent sensor networks is crucial for the next generation of location, tracking, and mapping services. This paper develops a scalable distributed probabilistic inference…

机器学习 · 计算机科学 2023-10-24 Parth Paritosh , Nikolay Atanasov , Sonia Martinez

Bayesian Likelihood-Free Inference methods yield posterior approximations for simulator models with intractable likelihood. Recently, many works trained neural networks to approximate either the intractable likelihood or the posterior…

统计计算 · 统计学 2022-06-01 Lorenzo Pacchiardi , Ritabrata Dutta