中文
相关论文

相关论文: Tackling the Generative Learning Trilemma with Den…

200 篇论文

Diffusion models learn to denoise data and the trained denoiser is then used to generate new samples from the data distribution. In this paper, we revisit the diffusion sampling process and identify a fundamental cause of sample quality…

机器学习 · 计算机科学 2024-11-05 Yunshu Wu , Yingtao Luo , Xianghao Kong , Evangelos E. Papalexakis , Greg Ver Steeg

Denoising diffusions are state-of-the-art generative models exhibiting remarkable empirical performance. They work by diffusing the data distribution into a Gaussian distribution and then learning to reverse this noising process to obtain…

机器学习 · 统计学 2024-02-20 Joe Benton , Yuyang Shi , Valentin De Bortoli , George Deligiannidis , Arnaud Doucet

Generative Adversarial Networks (GANs) have achieved remarkable achievements in image synthesis. These successes of GANs rely on large scale datasets, requiring too much cost. With limited training data, how to stable the training process…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Ziqiang Li , Beihao Xia , Jing Zhang , Chaoyue Wang , Bin Li

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li

Denoising diffusion models are a class of generative models which have recently achieved state-of-the-art results across many domains. Gradual noise is added to the data using a diffusion process, which transforms the data distribution into…

机器学习 · 统计学 2024-06-28 Francisco Vargas , Teodora Reu , Anna Kerekes , Michael M Bronstein

Neural networks struggle with image classification when biases are learned and misleads correlations, affecting their generalization and performance. Previous methods require attribute labels (e.g. background, color) or utilizes Generative…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Donggeun Ko , Dongjun Lee , Namjun Park , Wonkyeong Shim , Jaekwang Kim

Deep generative models have garnered significant attention in low-level vision tasks due to their generative capabilities. Among them, diffusion model-based solutions, characterized by a forward diffusion process and a reverse denoising…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Chunming He , Yuqi Shen , Chengyu Fang , Fengyang Xiao , Longxiang Tang , Yulun Zhang , Wangmeng Zuo , Zhenhua Guo , Xiu Li

Diffusion models have recently shown great promise for generative modeling, outperforming GANs on perceptual quality and autoregressive models at density estimation. A remaining downside is their slow sampling time: generating high quality…

机器学习 · 计算机科学 2022-06-08 Tim Salimans , Jonathan Ho

Generative models such as Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs) are widely utilized to model the generative process of user interactions. However, these generative models suffer from intrinsic…

信息检索 · 计算机科学 2025-06-26 Wenjie Wang , Yiyan Xu , Fuli Feng , Xinyu Lin , Xiangnan He , Tat-Seng Chua

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

计算机视觉与模式识别 · 计算机科学 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

In recent years, deep learning models have been successfully employed for augmenting low-resolution cosmological simulations with small-scale information, a task known as "super-resolution". So far, these cosmological super-resolution…

宇宙学与河外天体物理 · 物理学 2024-11-14 Andreas Schanz , Florian List , Oliver Hahn

Generative diffusion processes are an emerging and effective tool for image and speech generation. In the existing methods, the underlying noise distribution of the diffusion process is Gaussian noise. However, fitting distributions with…

信号处理 · 电气工程与系统科学 2021-10-13 Eliya Nachmani , Robin San Roman , Lior Wolf

Generative adversial network (GAN) is a type of generative model that maps a high-dimensional noise to samples in target distribution. However, the dimension of noise required in GAN is not well understood. Previous approaches view GAN as a…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Ziran Zhu , Tongda Xu , Ling Li , Yan Wang

The diffusion model is capable of generating high-quality data through a probabilistic approach. However, it suffers from the drawback of slow generation speed due to the requirement of a large number of time steps. To address this…

声音 · 计算机科学 2024-04-30 Myeongjin Ko , Yong-Hoon Choi

Denoising diffusion probabilistic models (DDPM) are a class of generative models which have recently been shown to produce excellent samples. We show that with a few simple modifications, DDPMs can also achieve competitive log-likelihoods…

机器学习 · 计算机科学 2021-02-22 Alex Nichol , Prafulla Dhariwal

Voice conversion is a method that allows for the transformation of speaking style while maintaining the integrity of linguistic information. There are many researchers using deep generative models for voice conversion tasks. Generative…

声音 · 计算机科学 2023-08-29 Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Generative diffusion models have emerged as leading models in speech and image generation. However, in order to perform well with a small number of denoising steps, a costly tuning of the set of noise parameters is needed. In this work, we…

机器学习 · 计算机科学 2021-09-14 Robin San-Roman , Eliya Nachmani , Lior Wolf

Denoising Diffusion Probabilistic Models (DDPMs) have achieved impressive performance on various generation tasks. By modeling the reverse process of gradually diffusing the data distribution into a Gaussian distribution, generating a…

计算机视觉与模式识别 · 计算机科学 2022-05-31 Zhaoyang Lyu , Xudong XU , Ceyuan Yang , Dahua Lin , Bo Dai

We introduce Efficient Motion Diffusion Model (EMDM) for fast and high-quality human motion generation. Current state-of-the-art generative diffusion models have produced impressive results but struggle to achieve fast generation without…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Wenyang Zhou , Zhiyang Dou , Zeyu Cao , Zhouyingcheng Liao , Jingbo Wang , Wenjia Wang , Yuan Liu , Taku Komura , Wenping Wang , Lingjie Liu

Denoising diffusion models, a class of generative models, have garnered immense interest lately in various deep-learning problems. A diffusion probabilistic model defines a forward diffusion stage where the input data is gradually perturbed…

图像与视频处理 · 电气工程与系统科学 2023-06-06 Amirhossein Kazerouni , Ehsan Khodapanah Aghdam , Moein Heidari , Reza Azad , Mohsen Fayyaz , Ilker Hacihaliloglu , Dorit Merhof