中文
相关论文

相关论文: Denoising Task Difficulty-based Curriculum for Tra…

200 篇论文

We present DiffusionBERT, a new generative masked language model based on discrete diffusion models. Diffusion models and many pre-trained language models have a shared training objective, i.e., denoising, making it possible to combine the…

计算与语言 · 计算机科学 2022-12-02 Zhengfu He , Tianxiang Sun , Kuanning Wang , Xuanjing Huang , Xipeng Qiu

Diffusion models generate high-resolution images through iterative stochastic processes. In particular, the denoising method is one of the most popular approaches that predicts the noise in samples and denoises it at each time step. It has…

计算机视觉与模式识别 · 计算机科学 2024-01-22 Juno Hwang , Yong-Hyun Park , Junghyo Jo

Equipping a deep model the abaility of few-shot learning, i.e., learning quickly from only few examples, is a core challenge for artificial intelligence. Gradient-based meta-learning approaches effectively address the challenge by learning…

机器学习 · 计算机科学 2024-01-09 Baoquan Zhang , Chuyao Luo , Demin Yu , Huiwei Lin , Xutao Li , Yunming Ye , Bowen Zhang

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

机器学习 · 计算机科学 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

While foundation models demonstrate impressive performance across various tasks, they remain vulnerable to adversarial inputs. Current research explores various approaches to enhance model robustness, with Diffusion Denoised Smoothing…

机器学习 · 计算机科学 2025-05-22 Yury Belousov , Brian Pulfer , Vitaliy Kinakh , Slava Voloshynovskiy

Building on recent advances in image generation, we present a fully data-driven approach to rendering markup into images. The approach is based on diffusion models, which parameterize the distribution of data using a sequence of denoising…

机器学习 · 计算机科学 2022-10-12 Yuntian Deng , Noriyuki Kojima , Alexander M. Rush

Image noise modeling is a long-standing problem with many applications in computer vision. Early attempts that propose simple models, such as signal-independent additive white Gaussian noise or the heteroscedastic Gaussian noise model…

图像与视频处理 · 电气工程与系统科学 2022-06-03 Ali Maleky , Shayan Kousha , Michael S. Brown , Marcus A. Brubaker

A diffusion model, which is formulated to produce an image using thousands of denoising steps, usually suffers from a slow inference speed. Existing acceleration algorithms simplify the sampling by skipping most steps yet exhibit…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Mengfei Xia , Yujun Shen , Changsong Lei , Yu Zhou , Ran Yi , Deli Zhao , Wenping Wang , Yong-Jin Liu

Diffusion and flow-based models have enabled significant progress in generation tasks across various modalities and have recently found applications in predictive learning. However, unlike typical generation tasks that encourage sample…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Yu Zhang , Xingzhuo Guo , Haoran Xu , Jialong Wu , Mingsheng Long

Large denoising diffusion models, such as Stable Diffusion, have been trained on billions of image-caption pairs to perform text-conditioned image generation. As a byproduct of this training, these models have acquired general knowledge…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Alexandros Graikos , Nebojsa Jojic , Dimitris Samaras

This work aims to improve the efficiency of text-to-image diffusion models. While diffusion models use computationally expensive UNet-based denoising operations in every generation step, we identify that not all operations are equally…

计算机视觉与模式识别 · 计算机科学 2024-02-21 Amirhossein Habibian , Amir Ghodrati , Noor Fathima , Guillaume Sautiere , Risheek Garrepalli , Fatih Porikli , Jens Petersen

Neural Network Potentials (NNPs) have emerged as a powerful tool for modelling atomic interactions with high accuracy and computational efficiency. Recently, denoising diffusion models have shown promise in NNPs by training networks to…

机器学习 · 计算机科学 2025-04-07 Liam Harcombe , Timothy T. Duignan

This paper addresses the problem of generating dynamically admissible trajectories for control tasks using diffusion models, particularly in scenarios where the environment is complex and system dynamics are crucial for practical…

机器人学 · 计算机科学 2025-10-15 Darshan Gadginmath , Fabio Pasqualetti

Denoising diffusion models, a class of generative models, have garnered immense interest lately in various deep-learning problems. A diffusion probabilistic model defines a forward diffusion stage where the input data is gradually perturbed…

图像与视频处理 · 电气工程与系统科学 2023-06-06 Amirhossein Kazerouni , Ehsan Khodapanah Aghdam , Moein Heidari , Reza Azad , Mohsen Fayyaz , Ilker Hacihaliloglu , Dorit Merhof

Training diffusion models for audiovisual sequences allows for a range of generation tasks by learning conditional distributions of various input-output combinations of the two modalities. Nevertheless, this strategy often requires training…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Gwanghyun Kim , Alonso Martinez , Yu-Chuan Su , Brendan Jou , José Lezama , Agrim Gupta , Lijun Yu , Lu Jiang , Aren Jansen , Jacob Walker , Krishna Somandepalli

Denoising diffusion probabilistic models for image inpainting aim to add the noise to the texture of image during the forward process and recover masked regions with unmasked ones of the texture via the reverse denoising process. Despite…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Haipeng Liu , Yang Wang , Biao Qian , Meng Wang , Yong Rui

Neural networks struggle with image classification when biases are learned and misleads correlations, affecting their generalization and performance. Previous methods require attribute labels (e.g. background, color) or utilizes Generative…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Donggeun Ko , Dongjun Lee , Namjun Park , Wonkyeong Shim , Jaekwang Kim

Denoising diffusion models have emerged as a powerful tool for various image generation and editing tasks, facilitating the synthesis of visual content in an unconditional or input-conditional manner. The core idea behind them is learning…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Yi Huang , Jiancheng Huang , Yifan Liu , Mingfu Yan , Jiaxi Lv , Jianzhuang Liu , Wei Xiong , He Zhang , Liangliang Cao , Shifeng Chen

We provide an overview of the diffusion model as a method to generate new samples. Generative models have been recently adopted for tasks such as art generation (Stable Diffusion, Dall-E) and text generation (ChatGPT). Diffusion models in…

机器学习 · 统计学 2025-06-13 Justin Le

Generative diffusion processes are an emerging and effective tool for image and speech generation. In the existing methods, the underlying noise distribution of the diffusion process is Gaussian noise. However, fitting distributions with…

信号处理 · 电气工程与系统科学 2021-10-13 Eliya Nachmani , Robin San Roman , Lior Wolf