English
Related papers

Related papers: T-Stitch: Accelerating Sampling in Pre-Trained Dif…

200 papers

Remote sensing change detection is crucial for understanding the dynamics of our planet's surface, facilitating the monitoring of environmental changes, evaluating human impact, predicting future trends, and supporting decision-making. In…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Wele Gedara Chaminda Bandara , Nithin Gopalakrishnan Nair , Vishal M. Patel

Diffusion models (DMs) are a class of generative models that allow sampling from a distribution learned over a training set. When applied to solving inverse problems, the reverse sampling steps are modified to approximately sample from a…

Image and Video Processing · Electrical Eng. & Systems 2025-05-27 Ismail Alkhouri , Shijun Liang , Cheng-Han Huang , Jimmy Dai , Qing Qu , Saiprasad Ravishankar , Rongrong Wang

Training diffusion models is always a computation-intensive task. In this paper, we introduce a novel speed-up method for diffusion model training, called, which is based on a closer look at time steps. Our key findings are: i) Time steps…

Machine Learning · Computer Science 2025-03-26 Kai Wang , Mingjia Shi , Yukun Zhou , Zekai Li , Zhihang Yuan , Yuzhang Shang , Xiaojiang Peng , Hanwang Zhang , Yang You

Current image stitching methods often produce noticeable seams in challenging scenarios such as uneven hue and large parallax. To tackle this problem, we propose the Reference-Driven Inpainting Stitcher (RDIStitcher), which reformulates the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Ziqi Xie , Xiao Lai , Weidong Zhao , Siqi Jiang , Xianhui Liu , Wenlong Hou

Generative modelling paradigms based on denoising diffusion processes have emerged as a leading candidate for conditional sampling in inverse problems. In many real-world applications, we often have access to large, expensively trained…

Efficient text-to-image generation remains a challenging task due to the high computational costs associated with the multi-step sampling in diffusion models. Although distillation of pre-trained diffusion models has been successful in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jeeyung Kim , Ze Wang , Qiang Qiu

Diffusion models are relatively easy to train but require many steps to generate samples. Consistency models are far more difficult to train, but generate samples in a single step. In this paper we propose Multistep Consistency Models: A…

Machine Learning · Computer Science 2024-11-20 Jonathan Heek , Emiel Hoogeboom , Tim Salimans

We study the problem of posterior sampling in discrete-state spaces using discrete diffusion models. While posterior sampling methods for continuous diffusion models have achieved remarkable progress, analogous methods for discrete…

Machine Learning · Computer Science 2025-11-04 Wenda Chu , Zihui Wu , Yifan Chen , Yang Song , Yisong Yue

Denoising Diffusion Probabilistic Models (DDPMs) are a very popular class of deep generative model that have been successfully applied to a diverse range of problems including image and video generation, protein and material synthesis,…

Diffusion Probabilistic Models (DPMs) are generative models showing competitive performance in various domains, including image synthesis and 3D point cloud generation. Sampling from pre-trained DPMs involves multiple neural function…

Machine Learning · Computer Science 2025-05-21 Vinh Tong , Hoang Trung-Dung , Anji Liu , Guy Van den Broeck , Mathias Niepert

Denoising diffusion models (DDMs) offer a flexible framework for sampling from high dimensional data distributions. DDMs generate a path of probability distributions interpolating between a reference Gaussian distribution and a data…

Machine Learning · Statistics 2024-12-12 Christopher Williams , Andrew Campbell , Arnaud Doucet , Saifuddin Syed

Sampling from a distribution $p(x) \propto e^{-\mathcal{E}(x)}$ known up to a normalising constant is an important and challenging problem in statistics. Recent years have seen the rise of a new family of amortised sampling algorithms,…

Machine Learning · Computer Science 2026-05-29 Arran Carter , Sanghyeok Choi , Kirill Tamogashev , Víctor Elvira , Esmeralda S. Whitammer

Diffusion-based models decompose sampling into many small Gaussian denoising steps -- an assumption that breaks down when generation is compressed to a few coarse transitions. Existing few-step methods address this through distillation,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Jiatao Gu , Tianrong Chen , Ying Shen , David Berthelot , Shuangfei Zhai , Josh Susskind

Generative AIBIM, a successful structural design pipeline, has proven its ability to intelligently generate high-quality, diverse, and creative shear wall designs that are tailored to specific physical conditions. However, the current…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Zhili He , Yu-Hsing Wang

The class-conditional image generation based on diffusion models is renowned for generating high-quality and diverse images. However, most prior efforts focus on generating images for general categories, e.g., 1000 classes in ImageNet-1k. A…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Ziying Pan , Kun Wang , Gang Li , Feihong He , Yongxuan Lai

Denoising Diffusion Probabilistic Models (DDPMs) have garnered popularity for data generation across various domains. However, a significant bottleneck is the necessity for whole-network computation during every step of the generative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Shuai Yang , Yukang Chen , Luozhou Wang , Shu Liu , Yingcong Chen

Diffusion models have demonstrated exceptional capabilities in generating high-fidelity images but typically suffer from inefficient sampling. Many solver designs and noise scheduling strategies have been proposed to dramatically improve…

Machine Learning · Statistics 2025-10-01 Tianrong Chen , Huangjie Zheng , David Berthelot , Jiatao Gu , Josh Susskind , Shuangfei Zhai

Despite their ability to generate high-resolution and diverse images from text prompts, text-to-image diffusion models often suffer from slow iterative sampling processes. Model distillation is one of the most effective directions to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Thuan Hoang Nguyen , Anh Tran

In light of the widespread success of generative models, a significant amount of research has gone into speeding up their sampling time. However, generative models are often sampled multiple times to obtain a diverse set incurring a cost…

Machine Learning · Computer Science 2023-11-27 Gabriele Corso , Yilun Xu , Valentin de Bortoli , Regina Barzilay , Tommi Jaakkola

The multi-step sampling mechanism, a key feature of visual diffusion models, has significant potential to replicate the success of OpenAI's Strawberry in enhancing performance by increasing the inference computational cost. Sufficient prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Shitong Shao , Zikai Zhou , Lichen Bai , Haoyi Xiong , Zeke Xie