中文
相关论文

相关论文: Text Generation with Diffusion Language Models: A …

200 篇论文

Diffusion models have achieved great success in modeling continuous data modalities such as images, audio, and video, but have seen limited use in discrete domains such as language. Recent attempts to adapt diffusion to language have…

计算与语言 · 计算机科学 2023-11-08 Justin Lovelace , Varsha Kishore , Chao Wan , Eliot Shekhtman , Kilian Q. Weinberger

Semantic communications mark a paradigm shift from bit-accurate transmission toward meaning-centric communication, essential as wireless systems approach theoretical capacity limits. The emergence of generative AI has catalyzed generative…

信号处理 · 电气工程与系统科学 2026-05-08 Hai-Long Qin , Jincheng Dai , Guo Lu , Shuo Shao , Sixian Wang , Tongda Xu , Wenjun Zhang , Ping Zhang , Khaled B. Letaief

Text-to-image generation (TTI) refers to the usage of models that could process text input and generate high fidelity images based on text descriptions. Text-to-image generation using neural networks could be traced back to the emergence of…

In this paper, we propose a model using generative adversarial net (GAN) to generate realistic text. Instead of using standard GAN, we combine variational autoencoder (VAE) with generative adversarial net. The use of high-level latent…

计算与语言 · 计算机科学 2018-11-08 Heng Wang , Zengchang Qin , Tao Wan

Although deep neural network (DNN)-based speech enhancement (SE) methods outperform the previous non-DNN-based ones, they often degrade the perceptual quality of generated outputs. To tackle this problem, we introduce a DNN-based generative…

音频与语音处理 · 电气工程与系统科学 2023-08-31 Ryosuke Sawata , Naoki Murata , Yuhta Takida , Toshimitsu Uesaka , Takashi Shibuya , Shusuke Takahashi , Yuki Mitsufuji

We provide an overview of the diffusion model as a method to generate new samples. Generative models have been recently adopted for tasks such as art generation (Stable Diffusion, Dall-E) and text generation (ChatGPT). Diffusion models in…

机器学习 · 统计学 2025-06-13 Justin Le

Generative adversarial networks (GANs) are challenging to train stably, and a promising remedy of injecting instance noise into the discriminator input has not been very effective in practice. In this paper, we propose Diffusion-GAN, a…

机器学习 · 计算机科学 2023-08-29 Zhendong Wang , Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

The latest advances in artificial intelligence (AI) present many unprecedented opportunities to achieve much improved bandwidth saving in communications. Unlike conventional communication systems focusing on packet transport, rich datasets…

机器学习 · 计算机科学 2023-12-07 Achintha Wijesinghe , Songyang Zhang , Suchinthaka Wanninayaka , Weiwei Wang , Zhi Ding

In this work, we build upon our previous publication and use diffusion-based generative models for speech enhancement. We present a detailed overview of the diffusion process that is based on a stochastic differential equation and delve…

音频与语音处理 · 电气工程与系统科学 2025-10-14 Julius Richter , Simon Welker , Jean-Marie Lemercier , Bunlong Lay , Timo Gerkmann

The lack of high-quality data for content-grounded generation tasks has been identified as a major obstacle to advancing these tasks. To address this gap, we propose Genie, a novel method for automatically generating high-quality…

计算与语言 · 计算机科学 2024-01-26 Asaf Yehudai , Boaz Carmeli , Yosi Mass , Ofir Arviv , Nathaniel Mills , Assaf Toledo , Eyal Shnarch , Leshem Choshen

We present DiffusionBERT, a new generative masked language model based on discrete diffusion models. Diffusion models and many pre-trained language models have a shared training objective, i.e., denoising, making it possible to combine the…

计算与语言 · 计算机科学 2022-12-02 Zhengfu He , Tianxiang Sun , Kuanning Wang , Xuanjing Huang , Xipeng Qiu

Existing text-to-image diffusion models struggle to synthesize realistic images given dense captions, where each text prompt provides a detailed description for a specific image region. To address this, we propose DenseDiffusion, a…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Yunji Kim , Jiyoung Lee , Jin-Hwa Kim , Jung-Woo Ha , Jun-Yan Zhu

While diffusion models have significantly advanced the quality of image generation their capability to accurately and coherently render text within these images remains a substantial challenge. Conventional diffusion-based methods for scene…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Qilong Zhangli , Jindong Jiang , Di Liu , Licheng Yu , Xiaoliang Dai , Ankit Ramchandani , Guan Pang , Dimitris N. Metaxas , Praveen Krishnan

This survey reviews the progress of diffusion models in generating images from text, ~\textit{i.e.} text-to-image diffusion models. As a self-contained work, this survey starts with a brief introduction of how diffusion models work for…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Chenshuang Zhang , Chaoning Zhang , Mengchun Zhang , In So Kweon , Junmo Kim

Recently, diffusion-based image generation methods are credited for their remarkable text-to-image generation capabilities, while still facing challenges in accurately generating multilingual scene text images. To tackle this problem, we…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Lingjun Zhang , Xinyuan Chen , Yaohui Wang , Yue Lu , Yu Qiao

Diffusion models are the current state-of-the-art in image generation, synthesizing high-quality images by breaking down the generation process into many fine-grained denoising steps. Despite their good performance, diffusion models are…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Noam Elata , Bahjat Kawar , Tomer Michaeli , Michael Elad

Generative artificial intelligence (AI) refers to algorithms that create synthetic but realistic output. Diffusion models currently offer state of the art performance in generative AI for images. They also form a key component in more…

机器学习 · 计算机科学 2023-12-27 Catherine F. Higham , Desmond J. Higham , Peter Grindrod

Diffusion-based generative models have recently gained attention in speech enhancement (SE), providing an alternative to conventional supervised methods. These models transform clean speech training samples into Gaussian noise centered at…

计算机视觉与模式识别 · 计算机科学 2023-09-20 Jean-Eudes Ayilo , Mostafa Sadeghi , Romain Serizel

In this paper, we propose a diffusion probabilistic model for handwriting generation. Diffusion models are a class of generative models where samples start from Gaussian noise and are gradually denoised to produce output. Our method of…

机器学习 · 计算机科学 2020-11-16 Troy Luhman , Eric Luhman

We train a feed-forward text-to-3D diffusion generator for human characters using only single-view 2D data for supervision. Existing 3D generative models cannot yet match the fidelity of image or video generative models. State-of-the-art 3D…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Souhaib Attaiki , Paul Guerrero , Duygu Ceylan , Niloy J. Mitra , Maks Ovsjanikov