中文
相关论文

相关论文: Efficient Diffusion Training through Parallelizati…

200 篇论文

Diffusion models achieve superior performance in image generation tasks. However, it incurs significant computation overheads due to its iterative structure. To address these overheads, we analyze this iterative structure and observe that…

硬件体系结构 · 计算机科学 2025-01-22 Sungbin Kim , Hyunwuk Lee , Wonho Cho , Mincheol Park , Won Woo Ro

This paper concerns the so-called diffusion in the curl of the 2d Gaussian free field, and its generalization to higher dimensions $n \geq 2$, building on the scale-by-scale homogenization approach developed recently by Chatzigeorgiou,…

概率论 · 数学 2025-11-20 Peter S. Morfe , Felix Otto , Christian Wagner

Diffusion-model-based image super-resolution techniques often face a trade-off between realistic image generation and computational efficiency. This issue is exacerbated when inference times by decreasing sampling steps, resulting in less…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Aradhana Mishra , Bumshik Lee

We propose a novel unpaired image-to-image translation method that uses denoising diffusion probabilistic models without requiring adversarial training. Our method, UNpaired Image Translation with Denoising Diffusion Probabilistic Models…

计算机视觉与模式识别 · 计算机科学 2021-04-13 Hiroshi Sasaki , Chris G. Willcocks , Toby P. Breckon

The F\"ollmer process is a Brownian motion conditioned to have a pre-specified distribution at time 1. This process can be interpreted as an "augmented" time-compressed version of the reverse stochastic differential equation (SDE) for the…

机器学习 · 统计学 2026-05-19 Yuta Koike

Diffusion language models (DLMs) generate text through iterative denoising, but inference requires full-sequence attention at every iteration, resulting in substantial redundant computation on masked tokens. Block-wise diffusion can reduce…

机器学习 · 计算机科学 2026-02-03 Fengrui Zuo , Zhiwei Ke , Yiming Liu , Wenqi Lou , Chao Wang , Xuehai Zhou

Diffusion models promise efficient parallel text generation but rely on bidirectional attention, creating a structural mismatch with pre-trained Autoregressive (AR) models. This incompatibility precludes reusing robust AR priors,…

计算与语言 · 计算机科学 2026-05-29 Xiangyu Ma , Teng Xiao , Zuchao Li , Lefei Zhang

Denoising diffusion models are a novel class of generative models that have recently become extremely popular in machine learning. In this paper, we describe how such ideas can also be used to sample from posterior distributions and, more…

统计计算 · 统计学 2023-08-29 Jeremy Heng , Valentin De Bortoli , Arnaud Doucet

We present an adaptive algorithm for the computation of quantities of interest involving the solution of a stochastic elliptic PDE where the diffusion coefficient is parametrized by means of a Karhunen-Lo\`eve expansion. The approximation…

数值分析 · 数学 2023-07-19 Uta Seidler , Michael Griebel

In this work, we propose Dimple, the first Discrete Diffusion Multimodal Large Language Model (DMLLM). We observe that training with a purely discrete diffusion approach leads to significant training instability, suboptimal performance, and…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Runpeng Yu , Xinyin Ma , Xinchao Wang

Action diffusion excels at high-fidelity action generation but incurs heavy computational costs owing to its iterative denoising nature. Despite current technologies showing promise in accelerating diffusion transformers by reusing the…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Kangye Ji , Yuan Meng , Jianbo Zhou , Ye Li , Chen Tang , Zhi Wang

While foundation models demonstrate impressive performance across various tasks, they remain vulnerable to adversarial inputs. Current research explores various approaches to enhance model robustness, with Diffusion Denoised Smoothing…

机器学习 · 计算机科学 2025-05-22 Yury Belousov , Brian Pulfer , Vitaliy Kinakh , Slava Voloshynovskiy

Diffusion probabilistic models have achieved mainstream success in many generative modeling tasks, from image generation to inverse problem solving. A distinct feature of these models is that they correspond to deep hierarchical latent…

机器学习 · 计算机科学 2024-12-30 Yibo Yang , Justus C. Will , Stephan Mandt

In recent years, large-scale pre-trained diffusion models have demonstrated their outstanding capabilities in image and video generation tasks. However, existing models tend to produce visual objects commonly found in the training dataset,…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Changgu Chen , Libing Yang , Xiaoyan Yang , Lianggangxu Chen , Gaoqi He , CHangbo Wang , Yang Li

Diffusion alignment adapts pretrained diffusion models to sample from reward-tilted distributions along the denoising trajectory. This process naturally admits a Sequential Monte Carlo (SMC) interpretation, where the denoising model acts as…

机器学习 · 计算机科学 2026-02-13 Zijing Ou , Jacob Si , Junyi Zhu , Ondrej Bohdal , Mete Ozay , Taha Ceritli , Yingzhen Li

This paper is dedicated to enhancing the computational efficiency of traditional parallel-in-time methods for solving stochastic initial-value problems. The standard parareal algorithm often suffers from slow convergence when applied to…

数值分析 · 数学 2025-10-31 Dou Dai , Qiuqi Li , Huailing Song

Continual learning (CL) aims to train models that can learn a sequence of tasks without forgetting previously acquired knowledge. A core challenge in CL is balancing stability -- preserving performance on old tasks -- and plasticity --…

机器学习 · 计算机科学 2025-05-14 Zhenrong Liu , Janne M. J. Huttunen , Mikko Honkala

Diffusion models have recently been increasingly applied to temporal data such as video, fluid mechanics simulations, or climate data. These methods generally treat subsequent frames equally regarding the amount of noise in the diffusion…

机器学习 · 计算机科学 2024-09-10 David Ruhe , Jonathan Heek , Tim Salimans , Emiel Hoogeboom

Diffusion models have achieved remarkable success in image generation, yet their deployment remains constrained by the heavy computational cost and the need for numerous inference steps. Previous efforts on fewer-step distillation attempt…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Zhuobai Dong , Rui Zhao , Songjie Wu , Junchao Yi , Linjie Li , Zhengyuan Yang , Lijuan Wang , Alex Jinpeng Wang

We have revisited the Brownian motion on the basis of the fractional Langevin equation which turns out to be a particular case of the generalized Langevin equation introduced by Kubo on 1966. The importance of our approach is to model the…

数学物理 · 物理学 2008-06-06 Francesco Mainardi , Paolo Pironi