English
Related papers

Related papers: Denoising Diffusion Variational Inference: Diffusi…

200 papers

Denoising diffusion probabilistic models have transformed image generation with their impressive fidelity and diversity. We show that they also excel in estimating optical flow and monocular depth, surprisingly, without task-specific…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Saurabh Saxena , Charles Herrmann , Junhwa Hur , Abhishek Kar , Mohammad Norouzi , Deqing Sun , David J. Fleet

Diffusion tensor imaging (DTI) holds significant importance in clinical diagnosis and neuroscience research. However, conventional model-based fitting methods often suffer from sensitivity to noise, leading to decreased accuracy in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Jialong Li , Zhicheng Zhang , Yunwei Chen , Qiqi Lu , Ye Wu , Xiaoming Liu , QianJin Feng , Yanqiu Feng , Xinyuan Zhang

This paper presents an evolvable conditional diffusion method such that black-box, non-differentiable multi-physics models, as are common in domains like computational fluid dynamics and electromagnetics, can be effectively used for guiding…

Machine Learning · Computer Science 2025-06-18 Zhao Wei , Chin Chun Ooi , Abhishek Gupta , Jian Cheng Wong , Pao-Hsiung Chiu , Sheares Xue Wen Toh , Yew-Soon Ong

Semi-implicit variational inference (SIVI) enriches the expressiveness of variational families by utilizing a kernel and a mixing distribution to hierarchically define the variational distribution. Existing SIVI methods parameterize the…

Machine Learning · Statistics 2025-01-16 Jen Ning Lim , Adam M. Johansen

Diffusion models (DMs) excel in image generation but suffer from slow inference and training-inference discrepancies. Although gradient-based solvers for DMs accelerate denoising inference, they often lack theoretical foundations in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Shigui Li , Wei Chen , Delu Zeng

Semi-implicit variational inference (SIVI) has been introduced to expand the analytical variational families by defining expressive semi-implicit distributions in a hierarchical manner. However, the single-layer architecture commonly used…

Machine Learning · Computer Science 2023-10-27 Longlin Yu , Tianyu Xie , Yu Zhu , Tong Yang , Xiangyu Zhang , Cheng Zhang

Current black-box variational inference (BBVI) methods require the user to make numerous design choices -- such as the selection of variational objective and approximating family -- yet there is little principled guidance on how to do so.…

Variational inference has become a widely used method to approximate posteriors in complex latent variables models. However, deriving a variational inference algorithm generally requires significant model-specific analysis, and these…

Machine Learning · Statistics 2014-01-03 Rajesh Ranganath , Sean Gerrish , David M. Blei

Bayesian (deep) neural networks (BNN) are often more attractive than the vanilla point-estimate deep learning in various aspects including uncertainty quantification, robustness to noise, resistance to overfitting, and more. The variational…

Machine Learning · Computer Science 2026-05-22 Minyoung Kim

Variational inference for latent variable models is prevalent in various machine learning problems, typically solved by maximizing the Evidence Lower Bound (ELBO) of the true data likelihood with respect to a variational distribution.…

Machine Learning · Computer Science 2018-07-11 Guoqing Zheng , Yiming Yang , Jaime Carbonell

We introduce Support Decomposition Variational Inference (SDVI), a new variational inference (VI) approach for probabilistic programs with stochastic support. Existing approaches to this problem rely on designing a single global variational…

Machine Learning · Computer Science 2023-11-02 Tim Reichelt , Luke Ong , Tom Rainforth

Diffusion-based generative models have demonstrated a capacity for perceptually impressive synthesis, but can they also be great likelihood-based models? We answer this in the affirmative, and introduce a family of diffusion-based…

Machine Learning · Computer Science 2023-04-17 Diederik P. Kingma , Tim Salimans , Ben Poole , Jonathan Ho

Probabilistic modeling is iterative. A scientist posits a simple model, fits it to her data, refines it according to her analysis, and repeats. However, fitting complex models to large data is a bottleneck in this process. Deriving…

Machine Learning · Statistics 2016-03-03 Alp Kucukelbir , Dustin Tran , Rajesh Ranganath , Andrew Gelman , David M. Blei

Diffusion models demonstrate remarkable capabilities in capturing complex data distributions and have achieved compelling results in many generative tasks. While they have recently been extended to dense prediction tasks such as depth…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Haorui Ji , Taojun Lin , Hongdong Li

Text-to-image diffusion models (DMs) are frequently abused to produce harmful or copyrighted content, violating public interests. Concept erasure (unlearning) is a promising paradigm to alleviate this issue. However, there exists a peculiar…

Machine Learning · Computer Science 2026-05-08 Manyi Li , Yufan Liu , Lai Jiang , Bing Li , Yuming Li , Weiming Hu

Denoising diffusion bridge models (DDBMs) are a powerful variant of diffusion models for interpolating between two arbitrary paired distributions given as endpoints. Despite their promising performance in tasks like image translation, DDBMs…

Machine Learning · Computer Science 2025-05-01 Kaiwen Zheng , Guande He , Jianfei Chen , Fan Bao , Jun Zhu

Due to the high complexity and technical requirements of industrial production processes, surface defects will inevitably appear, which seriously affects the quality of products. Although existing lightweight detection networks are highly…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xuyi Yu

Recently, research on denoising diffusion models has expanded its application to the field of image restoration. Traditional diffusion-based image restoration methods utilize degraded images as conditional input to effectively guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Zhenning Shi , Haoshuai Zheng , Chen Xu , Changsheng Dong , Bin Pan , Xueshuo Xie , Along He , Tao Li , Huazhu Fu

Deep learning algorithms have significantly reduced the computational time and improved the spatial resolution of particle image velocimetry~(PIV). However, the models trained on synthetic datasets might have a degraded performance on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Qianyu Zhu , Junjie Wang , Jeremiah Hu , Jia Ai , Yong Lee

Face recognition models embed a face image into a low-dimensional identity vector containing abstract encodings of identity-specific facial features that allow individuals to be distinguished from one another. We tackle the challenging task…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Manuel Kansy , Anton Raël , Graziana Mignone , Jacek Naruniec , Christopher Schroers , Markus Gross , Romann M. Weber