English
Related papers

Related papers: NoiseAR: AutoRegressing Initial Noise Prior for Di…

200 papers

Diffusion models that can generate high-quality data from randomly sampled Gaussian noises have become the mainstream generative method in both academia and industry. Are randomly sampled Gaussian noises equally good for diffusion models?…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zipeng Qi , Lichen Bai , Haoyi Xiong , Zeke Xie

We propose Diffusion Noise Optimization (DNO), a new method that effectively leverages existing motion diffusion models as motion priors for a wide range of motion-related tasks. Instead of training a task-specific diffusion model for each…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Korrawe Karunratanakul , Konpat Preechakul , Emre Aksan , Thabo Beeler , Supasorn Suwajanakorn , Siyu Tang

Diffusion models have recently exhibited remarkable abilities to synthesize striking image samples since the introduction of denoising diffusion probabilistic models (DDPMs). Their key idea is to disrupt images into noise through a fixed…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zijian Zhang , Zhou Zhao , Jun Yu , Qi Tian

The inference stage of diffusion models can be seen as running a reverse-time diffusion stochastic differential equation, where samples from a Gaussian latent distribution are transformed into samples from a target distribution that usually…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Lorenzo Luzi , Paul M Mayer , Josue Casco-Rodriguez , Ali Siahkoohi , Richard G. Baraniuk

Diffusion models have become a central tool in deep generative modeling, but standard formulations rely on a single network and a single diffusion schedule to transform a simple prior, typically a standard normal distribution, into the…

Machine Learning · Statistics 2025-12-29 Takuro Kutsuna

Autoregressive transformers have recently shown impressive image generation quality and efficiency on par with state-of-the-art diffusion models. Unlike diffusion architectures, autoregressive models can naturally incorporate arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yixiao Chen , Zhiyuan Ma , Guoli Jia , Che Jiang , Jianjun Li , Bowen Zhou

Pretrained language models have significantly advanced performance across various natural language processing tasks. However, adversarial attacks continue to pose a critical challenge to systems built using these models, as they can be…

Computation and Language · Computer Science 2025-05-20 Zhenhao Li , Huichi Zhou , Marek Rei , Lucia Specia

Diffusion models that are based on iterative denoising have been recently proposed and leveraged in various generation tasks like image generation. Whereas, as a way inherently built for continuous data, existing diffusion models still have…

Computation and Language · Computer Science 2023-04-11 Jiaao Chen , Aston Zhang , Mu Li , Alex Smola , Diyi Yang

To fully leverage the capabilities of diffusion models, we are often interested in optimizing downstream reward functions during inference. While numerous algorithms for reward-guided generation have been recently proposed due to their…

Machine Learning · Computer Science 2025-04-18 Masatoshi Uehara , Xingyu Su , Yulai Zhao , Xiner Li , Aviv Regev , Shuiwang Ji , Sergey Levine , Tommaso Biancalani

Flow-based latent generative models such as Stable Diffusion 3 are able to generate images with remarkable quality, even enabling photorealistic text-to-image generation. Their impressive performance suggests that these models should also…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Julius Erbach , Dominik Narnhofer , Andreas Dombos , Bernt Schiele , Jan Eric Lenssen , Konrad Schindler

Image interpolation based on diffusion models is promising in creating fresh and interesting images. Advanced interpolation methods mainly focus on spherical linear interpolation, where images are encoded into the noise space and then…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 PengFei Zheng , Yonggang Zhang , Zhen Fang , Tongliang Liu , Defu Lian , Bo Han

In this work, we build upon our previous publication and use diffusion-based generative models for speech enhancement. We present a detailed overview of the diffusion process that is based on a stochastic differential equation and delve…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-14 Julius Richter , Simon Welker , Jean-Marie Lemercier , Bunlong Lay , Timo Gerkmann

Discrete diffusion models generate sequences by iteratively denoising samples corrupted by categorical noise, offering an appealing alternative to autoregressive decoding for structured and symbolic generation. However, standard training…

Machine Learning · Computer Science 2026-02-04 Huu Binh Ta , Michael Cardei , Alvaro Velasquez , Ferdinando Fioretto

Recent diffusion models provide a promising zero-shot solution to noisy linear inverse problems without retraining for specific inverse problems. In this paper, we reveal that recent methods can be uniformly interpreted as employing a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Xinyu Peng , Ziyang Zheng , Wenrui Dai , Nuoqian Xiao , Chenglin Li , Junni Zou , Hongkai Xiong

Generative diffusion models can provide powerful prior probability models for inverse problems in imaging, but existing implementations suffer from two key limitations: $(i)$ the prior density is represented implicitly, and $(ii)$ they rely…

Machine Learning · Computer Science 2026-05-19 Nicolas Zilberstein , Santiago Segarra , Eero Simoncelli , Florentin Guth

We propose in this paper an analytically new construct of a diffusion model whose drift and diffusion parameters yield an exponentially time-decaying Signal to Noise Ratio in the forward process. In reverse, the construct cleverly carries…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Tanmay Asthana , Yufang Bao , Hamid Krim

Diffusion models demonstrate remarkable capabilities in capturing complex data distributions and have achieved compelling results in many generative tasks. While they have recently been extended to dense prediction tasks such as depth…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Haorui Ji , Taojun Lin , Hongdong Li

Deep generative models, particularly denoising diffusion models, have achieved remarkable success in high-fidelity generation of architected microstructures with desired properties and styles. Nevertheless, these recent methods typically…

Computational Engineering, Finance, and Science · Computer Science 2026-01-13 Weipeng Xu , Ziyuan Xie , Haoju Lin , Xinyu Wang , Guangjin Mou , Tianju Xue

Advances in diffusion models for generative artificial intelligence have recently propagated to the time series (TS) domain, demonstrating state-of-the-art performance on various tasks. However, prior works on TS diffusion models often…

Machine Learning · Computer Science 2024-10-21 Seunghan Lee , Kibok Lee , Taeyoung Park

Diffusion language models hold the promise of fast parallel generation, while autoregressive (AR) models typically excel in quality due to their causal structure aligning naturally with language modeling. This raises a fundamental question:…

Computation and Language · Computer Science 2025-11-13 Jingyu Liu , Xin Dong , Zhifan Ye , Rishabh Mehta , Yonggan Fu , Vartika Singh , Jan Kautz , Ce Zhang , Pavlo Molchanov