English
Related papers

Related papers: Parallel Sampling of Diffusion Models on $SO(3)$

200 papers

Score-based diffusion models, while achieving remarkable empirical performance, often suffer from low sampling speed, due to extensive function evaluations needed during the sampling phase. Despite a flurry of recent activities towards…

Machine Learning · Computer Science 2024-03-07 Gen Li , Yu Huang , Timofey Efimov , Yuting Wei , Yuejie Chi , Yuxin Chen

Diffusion probabilistic models (DPMs) have exhibited excellent performance for high-fidelity image generation while suffering from inefficient sampling. Recent works accelerate the sampling procedure by proposing fast ODE solvers that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Kaiwen Zheng , Cheng Lu , Jianfei Chen , Jun Zhu

Diffusion-based generative models represent the current state-of-the-art for image generation. However, standard diffusion models are based on Euclidean geometry and do not translate directly to manifold-valued data. In this work, we…

Machine Learning · Computer Science 2023-12-20 Yesukhei Jagvaral , Francois Lanusse , Rachel Mandelbaum

In Diffusion Probabilistic Models (DPMs), the task of modeling the score evolution via a single time-dependent neural network necessitates extended training periods and may potentially impede modeling flexibility and capacity. To counteract…

Machine Learning · Computer Science 2023-06-06 Etrit Haxholli , Marco Lorenzi

We present an novel framework for efficiently and effectively extending the powerful continuous diffusion processes to discrete modeling. Previous approaches have suffered from the discrepancy between discrete data and continuous modeling.…

Machine Learning · Computer Science 2024-10-31 Yuxuan Gu , Xiaocheng Feng , Lei Huang , Yingsheng Wu , Zekun Zhou , Weihong Zhong , Kun Zhu , Bing Qin

Diffusion models offer stable training and state-of-the-art performance for deep generative modeling tasks. Here, we consider their use in the context of multivariate subsurface modeling and probabilistic inversion. We first demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Roberto Miele , Niklas Linde

Diffusion models achieve superior performance in image generation tasks. However, it incurs significant computation overheads due to its iterative structure. To address these overheads, we analyze this iterative structure and observe that…

Hardware Architecture · Computer Science 2025-01-22 Sungbin Kim , Hyunwuk Lee , Wonho Cho , Mincheol Park , Won Woo Ro

We present an acceleration method for sequences of large-scale linear systems, such as the ones arising from the numerical solution of time-dependent partial differential equations coupled with algebraic constraints. We discuss different…

Numerical Analysis · Mathematics 2024-03-29 Margherita Guido , Daniel Kressner , Paolo Ricci

In this paper, we explore provable acceleration of diffusion models without any additional retraining. Focusing on the task of approximating a target data distribution in $\mathbb{R}^d$ to within $\varepsilon$ total-variation distance, we…

Machine Learning · Computer Science 2025-08-14 Gen Li , Yuchen Zhou , Yuting Wei , Yuxin Chen

We show how to use parallelization to speed up sampling from an arbitrary distribution $\mu$ on a product space $[q]^n$, given oracle access to counting queries: $\mathbb{P}_{X\sim \mu}[X_S=\sigma_S]$ for any $S\subseteq [n]$ and $\sigma_S…

Data Structures and Algorithms · Computer Science 2024-08-20 Nima Anari , Ruiquan Gao , Aviad Rubinstein

Diffusion models have revolutionized generative AI, with their inherent capacity to generate highly realistic state-of-the-art synthetic data. However, these models employ an iterative denoising process over computationally intensive layers…

Hardware Architecture · Computer Science 2026-03-10 Tharini Suresh , Salma Afifi , Sudeep Pasricha

Diffusion models (DMs) have achieved state-of-the-art generative performance but suffer from high sampling latency due to their sequential denoising nature. Existing solver-based acceleration methods often face image quality degradation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Beier Zhu , Ruoyu Wang , Tong Zhao , Hanwang Zhang , Chi Zhang

The search for refining 3D LiDAR data has attracted growing interest motivated by recent techniques such as supervised learning or generative model-based methods. Existing approaches have shown the possibilities for using diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sander Elias Magnussen Helgesen , Kazuto Nakashima , Jim Tørresen , Ryo Kurazume

Solving multiscale diffusion problems is often computationally expensive due to the spatial and temporal discretization challenges arising from high-contrast coefficients. To address this issue, a partially explicit temporal splitting…

Numerical Analysis · Mathematics 2026-02-26 Yating Wang , Zhengya Yang , Wing Tat Leung

We introduce a novel, training-free method for sampling differentiable representations (diffreps) using pretrained diffusion models. Rather than merely mode-seeking, our method achieves sampling by "pulling back" the dynamics of the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Yash Savani , Marc Finzi , J. Zico Kolter

Diffusion modeling (DM) has high-quality generative performance, and the sampling problem is an important part of the DM performance. Thanks to efficient differential equation solvers, the sampling speed can be reduced while higher sampling…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Zitong Cheng

In this paper, we propose an efficient, fast, and versatile distillation method to accelerate the generation of pre-trained diffusion models: Flash Diffusion. The method reaches state-of-the-art performances in terms of FID and CLIP-Score…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Clément Chadebec , Onur Tasar , Eyal Benaroche , Benjamin Aubin

Addressing pose ambiguity in 6D object pose estimation from single RGB images presents a significant challenge, particularly due to object symmetries or occlusions. In response, we introduce a novel score-based diffusion method applied to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tsu-Ching Hsiao , Hao-Wei Chen , Hsuan-Kung Yang , Chun-Yi Lee

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

Diffusion models have gained significant popularity in image generation tasks. However, generating high-quality content remains notably slow because it requires running model inference over many time steps. To accelerate these models, we…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Zichen Fan , Steve Dai , Rangharajan Venkatesan , Dennis Sylvester , Brucek Khailany