English
Related papers

Related papers: Parallel Sampling of Diffusion Models on $SO(3)$

200 papers

Current deep learning reconstruction for accelerated cardiac cine MRI suffers from spatial and temporal blurring. We aim to improve image sharpness and motion delineation for cine MRI under high undersampling rates. A spatiotemporal…

Image and Video Processing · Electrical Eng. & Systems 2024-03-14 Shihan Qiu , Shaoyan Pan , Yikang Liu , Lin Zhao , Jian Xu , Qi Liu , Terrence Chen , Eric Z. Chen , Xiao Chen , Shanhui Sun

Sampling from high-dimensional probability distributions is fundamental in machine learning and statistics. As datasets grow larger, computational efficiency becomes increasingly important, particularly in reducing adaptive complexity,…

Data Structures and Algorithms · Computer Science 2025-09-23 Huanjian Zhou , Masashi Sugiyama

Speculative decoding has emerged as a widely adopted method to accelerate large language model inference without sacrificing the quality of the model outputs. While this technique has facilitated notable speed improvements by enabling…

Computation and Language · Computer Science 2025-02-12 Jacob K Christopher , Brian R Bartoldson , Tal Ben-Nun , Michael Cardei , Bhavya Kailkhura , Ferdinando Fioretto

The Cambrian explosion of easily accessible pre-trained diffusion models suggests a demand for methods that combine multiple different pre-trained diffusion models without incurring the significant computational burden of re-training a…

Machine Learning · Computer Science 2025-03-04 Marta Skreta , Lazar Atanackovic , Avishek Joey Bose , Alexander Tong , Kirill Neklyudov

Diffusion models (DMs) are a class of generative models that allow sampling from a distribution learned over a training set. When applied to solving inverse problems, the reverse sampling steps are modified to approximately sample from a…

Image and Video Processing · Electrical Eng. & Systems 2025-05-27 Ismail Alkhouri , Shijun Liang , Cheng-Han Huang , Jimmy Dai , Qing Qu , Saiprasad Ravishankar , Rongrong Wang

Fully-supervised category-level pose estimation aims to determine the 6-DoF poses of unseen instances from known categories, requiring expensive mannual labeling costs. Recently, various self-supervised category-level pose estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Jingtao Sun , Yaonan Wang , Mingtao Feng , Chao Ding , Mike Zheng Shou , Ajmal Saeed Mian

To prepare images for better segmentation, we need preprocessing applications, such as smoothing, to reduce noise. In this paper, we present an enhanced computation method for smoothing 2D object in binary case. Unlike existing approaches,…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-31 Ramzi Mahmoudi , Mohamed Akil

In this paper, we propose a sampling mechanism for adaptive diffusion networks that adaptively changes the amount of sampled nodes based on mean-squared error in the neighborhood of each node. It presents fast convergence during transient…

Signal Processing · Electrical Eng. & Systems 2020-07-16 Daniel Gilio Tiglea , Renato Candido , Magno T. M. Silva

The ability to timely process significant amounts of continuously updated spatial data is mandatory for an increasing number of applications. Parallelism enables such applications to face this data-intensive challenge and allows the devised…

Databases · Computer Science 2014-11-13 Francesco Lettich , Salvatore Orlando , Claudio Silvestri , Christian S. Jensen

With the rapid development of diffusion models and flow-based generative models, there has been a surge of interests in solving noisy linear inverse problems, e.g., super-resolution, deblurring, denoising, colorization, etc, with generative…

Machine Learning · Computer Science 2024-10-22 Xiangming Meng , Yoshiyuki Kabashima

Diffusion models have demonstrated remarkable capabilities in visual content generation but remain challenging to deploy due to their high computational cost during inference. This computational burden primarily arises from the quadratic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Ye Tian , Xin Xia , Yuxi Ren , Shanchuan Lin , Xing Wang , Xuefeng Xiao , Yunhai Tong , Ling Yang , Bin Cui

We present the first framework to solve linear inverse problems leveraging pre-trained latent diffusion models. Previously proposed algorithms (such as DPS and DDRM) only apply to pixel-space diffusion models. We theoretically analyze our…

Machine Learning · Computer Science 2023-07-04 Litu Rout , Negin Raoof , Giannis Daras , Constantine Caramanis , Alexandros G. Dimakis , Sanjay Shakkottai

In this paper, we propose high order numerical methods to solve a 2D advection diffusion equation, in the highly oscillatory regime. We use an integrator strategy that allows the construction of arbitrary high-order schemes {leading} to an…

Numerical Analysis · Mathematics 2024-11-11 Clarissa Astuto

Diffusion models have shown remarkable success across a wide range of generative tasks. However, they often suffer from spatially inconsistent generation, arguably due to the inherent locality of their denoising mechanisms. This can yield…

Machine Learning · Computer Science 2026-02-04 Wenshuai Zhao , Zhiyuan Li , Yi Zhao , Mohammad Hassan Vali , Martin Trapp , Joni Pajarinen , Juho Kannala , Arno Solin

Diffusion models have emerged as powerful generative models, but their high computation cost in iterative sampling remains a significant bottleneck. In this work, we present an in-depth and insightful study of state-of-the-art acceleration…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Weizhi Gao , Zhichao Hou , Junqi Yin , Feiyi Wang , Linyu Peng , Xiaorui Liu

Diffusion models have significantly advanced the state of the art in image, audio, and video generation tasks. However, their applications in practical scenarios are hindered by slow inference speed. Drawing inspiration from the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Chen Xu , Tianhui Song , Weixin Feng , Xubin Li , Tiezheng Ge , Bo Zheng , Limin Wang

Diffusion models have achieved remarkable success as generative models. However, even a well-trained model can accumulate errors throughout the generation process. These errors become particularly problematic when arbitrary guidance is…

Machine Learning · Computer Science 2025-10-14 Youngrok Park , Hojung Jung , Sangmin Bae , Se-Young Yun

We present a new method for making diffusion models faster to sample. The method distills many-step diffusion models into few-step models by matching conditional expectations of the clean data given noisy data along the sampling trajectory.…

Machine Learning · Computer Science 2024-06-07 Tim Salimans , Thomas Mensink , Jonathan Heek , Emiel Hoogeboom

Diffusion probabilistic models have set a new standard for generative fidelity but are hindered by a slow iterative sampling process. A powerful training-free strategy to accelerate this process is Schedule Optimization, which aims to find…

Machine Learning · Computer Science 2026-05-20 Aihua Zhu , Rui Su , Qinglin Zhao , Li Feng , Meng Shen , Shibo He

Diffusion models are the go-to method for Text-to-Image generation, but their iterative denoising processes has high inference latency. Quantization reduces compute time by using lower bitwidths, but applies a fixed precision across all…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Basile Lewandowski , Simon Kurz , Aditya Shankar , Robert Birke , Jian-Jia Chen , Lydia Y. Chen