English
Related papers

Related papers: Efficient Diffusion Training through Parallelizati…

200 papers

Diffusion models achieve superior performance in image generation tasks. However, it incurs significant computation overheads due to its iterative structure. To address these overheads, we analyze this iterative structure and observe that…

Hardware Architecture · Computer Science 2025-01-22 Sungbin Kim , Hyunwuk Lee , Wonho Cho , Mincheol Park , Won Woo Ro

This paper concerns the so-called diffusion in the curl of the 2d Gaussian free field, and its generalization to higher dimensions $n \geq 2$, building on the scale-by-scale homogenization approach developed recently by Chatzigeorgiou,…

Probability · Mathematics 2025-11-20 Peter S. Morfe , Felix Otto , Christian Wagner

Diffusion-model-based image super-resolution techniques often face a trade-off between realistic image generation and computational efficiency. This issue is exacerbated when inference times by decreasing sampling steps, resulting in less…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Aradhana Mishra , Bumshik Lee

We propose a novel unpaired image-to-image translation method that uses denoising diffusion probabilistic models without requiring adversarial training. Our method, UNpaired Image Translation with Denoising Diffusion Probabilistic Models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Hiroshi Sasaki , Chris G. Willcocks , Toby P. Breckon

The F\"ollmer process is a Brownian motion conditioned to have a pre-specified distribution at time 1. This process can be interpreted as an "augmented" time-compressed version of the reverse stochastic differential equation (SDE) for the…

Machine Learning · Statistics 2026-05-19 Yuta Koike

Diffusion language models (DLMs) generate text through iterative denoising, but inference requires full-sequence attention at every iteration, resulting in substantial redundant computation on masked tokens. Block-wise diffusion can reduce…

Machine Learning · Computer Science 2026-02-03 Fengrui Zuo , Zhiwei Ke , Yiming Liu , Wenqi Lou , Chao Wang , Xuehai Zhou

Diffusion models promise efficient parallel text generation but rely on bidirectional attention, creating a structural mismatch with pre-trained Autoregressive (AR) models. This incompatibility precludes reusing robust AR priors,…

Computation and Language · Computer Science 2026-05-29 Xiangyu Ma , Teng Xiao , Zuchao Li , Lefei Zhang

Denoising diffusion models are a novel class of generative models that have recently become extremely popular in machine learning. In this paper, we describe how such ideas can also be used to sample from posterior distributions and, more…

Computation · Statistics 2023-08-29 Jeremy Heng , Valentin De Bortoli , Arnaud Doucet

We present an adaptive algorithm for the computation of quantities of interest involving the solution of a stochastic elliptic PDE where the diffusion coefficient is parametrized by means of a Karhunen-Lo\`eve expansion. The approximation…

Numerical Analysis · Mathematics 2023-07-19 Uta Seidler , Michael Griebel

In this work, we propose Dimple, the first Discrete Diffusion Multimodal Large Language Model (DMLLM). We observe that training with a purely discrete diffusion approach leads to significant training instability, suboptimal performance, and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Runpeng Yu , Xinyin Ma , Xinchao Wang

Action diffusion excels at high-fidelity action generation but incurs heavy computational costs owing to its iterative denoising nature. Despite current technologies showing promise in accelerating diffusion transformers by reusing the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Kangye Ji , Yuan Meng , Jianbo Zhou , Ye Li , Chen Tang , Zhi Wang

While foundation models demonstrate impressive performance across various tasks, they remain vulnerable to adversarial inputs. Current research explores various approaches to enhance model robustness, with Diffusion Denoised Smoothing…

Machine Learning · Computer Science 2025-05-22 Yury Belousov , Brian Pulfer , Vitaliy Kinakh , Slava Voloshynovskiy

Diffusion probabilistic models have achieved mainstream success in many generative modeling tasks, from image generation to inverse problem solving. A distinct feature of these models is that they correspond to deep hierarchical latent…

Machine Learning · Computer Science 2024-12-30 Yibo Yang , Justus C. Will , Stephan Mandt

In recent years, large-scale pre-trained diffusion models have demonstrated their outstanding capabilities in image and video generation tasks. However, existing models tend to produce visual objects commonly found in the training dataset,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Changgu Chen , Libing Yang , Xiaoyan Yang , Lianggangxu Chen , Gaoqi He , CHangbo Wang , Yang Li

Diffusion alignment adapts pretrained diffusion models to sample from reward-tilted distributions along the denoising trajectory. This process naturally admits a Sequential Monte Carlo (SMC) interpretation, where the denoising model acts as…

Machine Learning · Computer Science 2026-02-13 Zijing Ou , Jacob Si , Junyi Zhu , Ondrej Bohdal , Mete Ozay , Taha Ceritli , Yingzhen Li

This paper is dedicated to enhancing the computational efficiency of traditional parallel-in-time methods for solving stochastic initial-value problems. The standard parareal algorithm often suffers from slow convergence when applied to…

Numerical Analysis · Mathematics 2025-10-31 Dou Dai , Qiuqi Li , Huailing Song

Continual learning (CL) aims to train models that can learn a sequence of tasks without forgetting previously acquired knowledge. A core challenge in CL is balancing stability -- preserving performance on old tasks -- and plasticity --…

Machine Learning · Computer Science 2025-05-14 Zhenrong Liu , Janne M. J. Huttunen , Mikko Honkala

Diffusion models have recently been increasingly applied to temporal data such as video, fluid mechanics simulations, or climate data. These methods generally treat subsequent frames equally regarding the amount of noise in the diffusion…

Machine Learning · Computer Science 2024-09-10 David Ruhe , Jonathan Heek , Tim Salimans , Emiel Hoogeboom

Diffusion models have achieved remarkable success in image generation, yet their deployment remains constrained by the heavy computational cost and the need for numerous inference steps. Previous efforts on fewer-step distillation attempt…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Zhuobai Dong , Rui Zhao , Songjie Wu , Junchao Yi , Linjie Li , Zhengyuan Yang , Lijuan Wang , Alex Jinpeng Wang

We have revisited the Brownian motion on the basis of the fractional Langevin equation which turns out to be a particular case of the generalized Langevin equation introduced by Kubo on 1966. The importance of our approach is to model the…

Mathematical Physics · Physics 2008-06-06 Francesco Mainardi , Paolo Pironi