English
Related papers

Related papers: Conditional GAN for Enhancing Diffusion Models in …

200 papers

It is widely accepted that medical imaging systems should be objectively assessed via task-based image quality (IQ) measures that ideally account for all sources of randomness in the measured image data, including the variation in the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xichen Xu , Wentao Chen , Weimin Zhou

Denoising Diffusion Probabilistic Models (DDPMs) have achieved remarkable success in various image generation tasks compared with Generative Adversarial Nets (GANs). Recent work on semantic image synthesis mainly follows the de facto…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Wengang Zhou , Weilun Wang , Jianmin Bao , Dongdong Chen , Dong Chen , Lu Yuan , Houqiang Li

Diffusion models, as a type of generative model, have achieved impressive results in generating images and videos conditioned on textual conditions. However, the generation process of diffusion models involves denoising dozens of steps to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Hui Zhang , Zuxuan Wu , Zhen Xing , Jie Shao , Yu-Gang Jiang

Denoising diffusion probabilistic models (DDPMs) have achieved impressive performance on various image generation tasks, including image super-resolution. By learning to reverse the process of gradually diffusing the data distribution into…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Kai Zhao , Alex Ling Yu Hung , Kaifeng Pang , Haoxin Zheng , Kyunghyun Sung

Generative models such as Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs) are widely utilized to model the generative process of user interactions. However, these generative models suffer from intrinsic…

Information Retrieval · Computer Science 2025-06-26 Wenjie Wang , Yiyan Xu , Fuli Feng , Xinyu Lin , Xiangnan He , Tat-Seng Chua

Generating the motion of orchestral conductors from a given piece of symphony music is a challenging task since it requires a model to learn semantic music features and capture the underlying distribution of real conducting motion. Prior…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-14 Zhuoran Zhao , Jinbin Bai , Delong Chen , Debang Wang , Yubo Pan

Denoising diffusion probabilistic models (DDPMs) have recently achieved leading performances in many generative tasks. However, the inherited iterative sampling process costs hindered their applications to speech synthesis. This paper…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-22 Rongjie Huang , Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu , Yi Ren , Zhou Zhao

Denoising diffusion probabilistic models (DDPMs) are expressive generative models that have been used to solve a variety of speech synthesis problems. However, because of their high sampling costs, DDPMs are difficult to use in real-time…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-31 Songxiang Liu , Dan Su , Dong Yu

Diffusion-based Deep Generative Models (DDGMs) offer state-of-the-art performance in generative modeling. Their main strength comes from their unique setup in which a model (the backward diffusion process) is trained to reverse the forward…

Machine Learning · Computer Science 2022-06-02 Kamil Deja , Anna Kuzina , Tomasz Trzciński , Jakub M. Tomczak

Diffusion Probabilistic Models (DPMs) have emerged as the de facto approach for high-fidelity image synthesis, operating diffusion processes on continuous VAE latent, which significantly differ from the text generation methods employed by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xiaoping Wu , Jie Hu , Xiaoming Wei

Diffusion models have shown promising results for a wide range of generative tasks with continuous data, such as image and audio synthesis. However, little progress has been made on using diffusion models to generate discrete symbolic music…

Sound · Computer Science 2023-10-24 Jincheng Zhang , György Fazekas , Charalampos Saitis

Generative models have attracted significant interest due to their ability to handle uncertainty by learning the inherent data distributions. However, two prominent generative models, namely Generative Adversarial Networks (GANs) and…

Machine Learning · Computer Science 2023-04-25 Yu Wang , Zhiwei Liu , Liangwei Yang , Philip S. Yu

Diffusion Probabilistic Models (DPMs) have demonstrated substantial promise in image generation tasks but heavily rely on the availability of large amounts of training data. Previous works, like GANs, have tackled the limited data problem…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Xiyu Wang , Baijiong Lin , Daochang Liu , Chang Xu

Gestures are essential for enhancing co-speech communication, offering visual emphasis and complementing verbal interactions. While prior work has concentrated on point-level motion or fully supervised data-driven methods, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Jiahui Chen , Yang Huan , Runhua Shi , Chanfan Ding , Xiaoqi Mo , Siyu Xiong , Yinong He

Interactive motion synthesis is essential in creating immersive experiences in entertainment applications, such as video games and virtual reality. However, generating animations that are both high-quality and contextually responsive…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Tianyu Li , Calvin Qiao , Guanqiao Ren , KangKang Yin , Sehoon Ha

Class-conditional image generation using generative adversarial networks (GANs) has been investigated through various techniques; however, it continues to face challenges such as mode collapse, training instability, and low-quality output…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Taesun Yeom , Minhyeok Lee

Generative diffusion models have emerged as leading models in speech and image generation. However, in order to perform well with a small number of denoising steps, a costly tuning of the set of noise parameters is needed. In this work, we…

Machine Learning · Computer Science 2021-09-14 Robin San-Roman , Eliya Nachmani , Lior Wolf

Practically, training diffusion models typically requires explicit time conditioning to guide the network through the denoising sampling process. Especially in deterministic methods like DDIM, the absence of time conditioning leads to…

Machine Learning · Computer Science 2026-04-29 Liuzhuozheng Li , Zhiyuan Zhan , Shuhong Liu , Dengyang Jiang , Zanyi Wang , Guang Dai , Jingdong Wang , Mengmeng Wang

Diffusion probabilistic models have been shown to generate state-of-the-art results on several competitive image synthesis benchmarks but lack a low-dimensional, interpretable latent space, and are slow at generation. On the other hand,…

Machine Learning · Computer Science 2022-11-30 Kushagra Pandey , Avideep Mukherjee , Piyush Rai , Abhishek Kumar

We propose a simple and novel method for generating 3D human motion from complex natural language sentences, which describe different velocity, direction and composition of all kinds of actions. Different from existing methods that use…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zhiyuan Ren , Zhihong Pan , Xin Zhou , Le Kang