English
Related papers

Related papers: ReDDiT: Rehashing Noise for Discrete Visual Genera…

200 papers

Generative processes that involve solving differential equations, such as diffusion models, frequently necessitate balancing speed and quality. ODE-based samplers are fast but plateau in performance while SDE-based samplers deliver higher…

Machine Learning · Computer Science 2023-11-02 Yilun Xu , Mingyang Deng , Xiang Cheng , Yonglong Tian , Ziming Liu , Tommi Jaakkola

Recovering noise-covered details from low-light images is challenging, and the results given by previous methods leave room for improvement. Recent diffusion models show realistic and detailed image generation through a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Dewei Zhou , Zongxin Yang , Yi Yang

The development of diffusion-based generative models over the past decade has largely proceeded independently of progress in representation learning. These diffusion models typically rely on regression-based objectives and generally lack…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Runqian Wang , Kaiming He

The reconstruction of unsteady flow fields from limited measurements is a challenging and crucial task for many engineering applications. Machine learning models are gaining popularity for solving this problem due to their ability to learn…

Fluid Dynamics · Physics 2026-01-09 Marc Amorós-Trepat , Luis Medrano-Navarro , Qiang Liu , Luca Guastoni , Nils Thuerey

Recently, diffusion models have shown remarkable results in image synthesis by gradually removing noise and amplifying signals. Although the simple generative process surprisingly works well, is this the best way to generate image data? For…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Sangyun Lee , Hyungjin Chung , Jaehyeon Kim , Jong Chul Ye

Diffusion Models (DMs) have achieved State-Of-The-Art (SOTA) results in the Lidar point cloud generation task, benefiting from their stable training and iterative refinement during sampling. However, DMs often fail to realistically model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Hamed Haghighi , Amir Samadi , Mehrdad Dianati , Valentina Donzella , Kurt Debattista

Denoising diffusion probabilistic models (DDPMs) have achieved impressive performance on various image generation tasks, including image super-resolution. By learning to reverse the process of gradually diffusing the data distribution into…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Kai Zhao , Alex Ling Yu Hung , Kaifeng Pang , Haoxin Zheng , Kyunghyun Sung

Volumetric video relighting is essential for bringing captured performances into virtual worlds, but current approaches struggle to deliver temporally stable, production-ready results. Diffusion-based intrinsic decomposition methods show…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Elisabeth Jüttner , Janelle Pfeifer , Leona Krath , Stefan Korfhage , Hannah Dröge , Matthias B. Hullin , Markus Plack

Diffusion models have gained prominence in generating high-quality sequences of text. Nevertheless, current approaches predominantly represent discrete text within a continuous diffusion space, which incurs substantial computational…

Machine Learning · Computer Science 2023-10-17 Shansan Gong , Mukai Li , Jiangtao Feng , Zhiyong Wu , Lingpeng Kong

Speech separation, the task of isolating multiple speech sources from a mixed audio signal, remains challenging in noisy environments. In this paper, we propose a generative correction method to enhance the output of a discriminative…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Helin Wang , Jesus Villalba , Laureano Moro-Velazquez , Jiarui Hai , Thomas Thebaud , Najim Dehak

Score-based diffusion models have significantly advanced generative deep learning for image processing. Measurement conditioned models have also been applied to inverse problems such as CT reconstruction. However, the conventional approach,…

Medical Physics · Physics 2025-02-24 Matthew Tivnan , Dufan Wu , Quanzheng Li

Recently, large-scale diffusion models, e.g., Stable diffusion and DallE2, have shown remarkable results on image synthesis. On the other hand, large-scale cross-modal pre-trained models (e.g., CLIP, ALIGN, and FILIP) are competent for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Runhui Huang , Jianhua Han , Guansong Lu , Xiaodan Liang , Yihan Zeng , Wei Zhang , Hang Xu

Unified generation models aim to handle diverse tasks across modalities -- such as text generation, image generation, and vision-language reasoning -- within a single architecture and decoding paradigm. Autoregressive unified models suffer…

Machine Learning · Computer Science 2026-05-27 Qingyu Shi , Jinbin Bai , Zhuoran Zhao , Wenhao Chai , Kaidong Yu , Jianzong Wu , Yunhai Tong , Xiangtai Li , Xuelong Li , Shuicheng Yan

Diffusion models excel at capturing the natural design spaces of images, molecules, DNA, RNA, and protein sequences. However, rather than merely generating designs that are natural, we often aim to optimize downstream reward functions while…

Rectified Flow (RF) has been widely used as an effective generative model. Although RF is primarily based on probability flow Ordinary Differential Equations (ODE), recent studies have shown that injecting noise through reverse-time…

Machine Learning · Computer Science 2025-11-13 Zhenyu Gu , Yanchen Xu , Sida Huang , Yubin Guo , Hongyuan Zhang

Denoising diffusion models represent a recent emerging topic in computer vision, demonstrating remarkable results in the area of generative modeling. A diffusion model is a deep generative model that is based on two stages, a forward…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Florinel-Alin Croitoru , Vlad Hondru , Radu Tudor Ionescu , Mubarak Shah

Diffusion Probabilistic Models (DPMs) have emerged as the de facto approach for high-fidelity image synthesis, operating diffusion processes on continuous VAE latent, which significantly differ from the text generation methods employed by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xiaoping Wu , Jie Hu , Xiaoming Wei

This report presents the comprehensive implementation, evaluation, and optimization of Denoising Diffusion Probabilistic Models (DDPMs) and Denoising Diffusion Implicit Models (DDIMs), which are state-of-the-art generative models. During…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jaineet Shah , Michael Gromis , Rickston Pinto

Diffusion models for continuous data gained widespread adoption owing to their high quality generation and control mechanisms. However, controllable diffusion on discrete data faces challenges given that continuous guidance methods do not…

Generative models such as Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) have shown promise in sequential recommendation tasks. However, they face challenges, including posterior collapse and limited…

Machine Learning · Computer Science 2024-10-28 Sharare Zolghadr , Ole Winther , Paul Jeha