中文
相关论文

相关论文: Glauber Generative Model: Discrete Diffusion Model…

200 篇论文

Diffusion models have recently emerged as a powerful framework for generative modeling. They consist of a forward process that perturbs input data with Gaussian white noise and a reverse process that learns a score function to generate…

Employing a forward diffusion chain to gradually map the data to a noise distribution, diffusion-based generative models learn how to generate the data by inferring a reverse diffusion chain. However, this approach is slow and costly…

机器学习 · 统计学 2023-09-08 Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

Diffusion models have garnered significant attention since they can effectively learn complex multivariate Gaussian distributions, resulting in diverse, high-quality outcomes. They introduce Gaussian noise into training data and reconstruct…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Vidya Prasad , Chen Zhu-Tian , Anna Vilanova , Hanspeter Pfister , Nicola Pezzotti , Hendrik Strobelt

We investigate the utility of diffusion generative models to efficiently synthesise datasets that effectively train deep learning models for image analysis. Specifically, we propose novel $\Gamma$-distribution Latent Denoising Diffusion…

图像与视频处理 · 电气工程与系统科学 2024-10-01 David Stojanovski , Mariana da Silva , Pablo Lamata , Arian Beqiri , Alberto Gomez

Diffusion models have emerged as a powerful framework for generative tasks in deep learning. They decompose generative modeling into two computational primitives: deterministic neural-network evaluation and stochastic sampling. Current…

机器学习 · 计算机科学 2026-03-31 Nihal Sanjay Singh , Mazdak Mohseni-Rajaee , Shaila Niazi , Kerem Y. Camsari

Strong generative models can accurately learn channel distributions. This could save recurring costs for physical measurements of the channel. Moreover, the resulting differentiable channel model supports training neural encoders by…

信息论 · 计算机科学 2024-06-12 Muah Kim , Rick Fritschek , Rafael F. Schaefer

Spatio-temporal modeling is foundational for smart city applications, yet it is often hindered by data scarcity in many cities and regions. To bridge this gap, we propose a novel generative pre-training framework, GPD, for spatio-temporal…

机器学习 · 计算机科学 2024-03-26 Yuan Yuan , Chenyang Shao , Jingtao Ding , Depeng Jin , Yong Li

Diffusion models and score-based generative models provide a powerful framework for synthesizing high-quality images from noise. However, there is still no satisfactory theory that describes how coarse-grained quantities, such as blockwise…

机器学习 · 计算机科学 2026-01-07 Tatsuaki Tsuruyama

Diffusion models have excelled in generating natural images and are now being adapted to a variety of data types, including graphs. However, conventional models often rely on Gaussian or categorical diffusion processes, which can struggle…

机器学习 · 计算机科学 2024-10-08 Xinyang Liu , Yilin He , Bo Chen , Mingyuan Zhou

Applying pre-trained generative denoising diffusion models (DDMs) for downstream tasks such as image semantic editing usually requires either fine-tuning DDMs or learning auxiliary editing networks in the existing literature. In this work,…

计算机视觉与模式识别 · 计算机科学 2023-10-19 Ye Zhu , Yu Wu , Zhiwei Deng , Olga Russakovsky , Yan Yan

Standard diffusion models involve an image transform -- adding Gaussian noise -- and an image restoration operator that inverts this degradation. We observe that the generative behavior of diffusion models is not strongly dependent on the…

计算机视觉与模式识别 · 计算机科学 2022-08-22 Arpit Bansal , Eitan Borgnia , Hong-Min Chu , Jie S. Li , Hamid Kazemi , Furong Huang , Micah Goldblum , Jonas Geiping , Tom Goldstein

A wide variety of deep generative models has been developed in the past decade. Yet, these models often struggle with simultaneously addressing three key requirements including: high sample quality, mode coverage, and fast sampling. We call…

机器学习 · 计算机科学 2022-04-06 Zhisheng Xiao , Karsten Kreis , Arash Vahdat

Generative adversarial networks (GANs) are challenging to train stably, and a promising remedy of injecting instance noise into the discriminator input has not been very effective in practice. In this paper, we propose Diffusion-GAN, a…

机器学习 · 计算机科学 2023-08-29 Zhendong Wang , Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

Generative steganography (GS) is an emerging technique that generates stego images directly from secret data. Various GS methods based on GANs or Flow have been developed recently. However, existing GAN-based GS methods cannot completely…

多媒体 · 计算机科学 2023-09-07 Ping Wei , Qing Zhou , Zichi Wang , Zhenxing Qian , Xinpeng Zhang , Sheng Li

Modern successes of diffusion models in learning complex, high-dimensional data distributions are attributed, in part, to their capability to construct diffusion processes with analytic transition kernels and score functions. The…

机器学习 · 统计学 2024-03-01 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou , Molei Tao

Generative steganography is the process of hiding secret messages in generated images instead of cover images. Existing studies on generative steganography use GAN or Flow models to obtain high hiding message capacity and anti-detection…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Daegyu Kim , Chaehun Shin , Jooyoung Choi , Dahuin Jung , Sungroh Yoon

Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. DMs work by constructing a Stochastic Differential Equation (SDE) in the input space (ie, position space), and using a neural network to reverse it.…

机器学习 · 计算机科学 2024-05-14 Tianrong Chen , Jiatao Gu , Laurent Dinh , Evangelos A. Theodorou , Joshua Susskind , Shuangfei Zhai

Deep generative models (DGM) are neural networks with many hidden layers trained to approximate complicated, high-dimensional probability distributions using a large number of samples. When trained successfully, we can use the DGMs to…

机器学习 · 计算机科学 2021-04-13 Lars Ruthotto , Eldad Haber

Diffusion models have successfully been applied to generative tasks in various continuous domains. However, applying diffusion to discrete categorical data remains a non-trivial task. Moreover, generation in continuous domains often…

机器学习 · 计算机科学 2023-08-21 Jaesung Tae

Layout Generation aims to synthesize plausible arrangements from given elements. Currently, the predominant methods in layout generation are Generative Adversarial Networks (GANs) and diffusion models, each presenting its own set of…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Zhaoxing Gan , Guangnan Ye