English
Related papers

Related papers: Efficient Diffusion Training via Min-SNR Weighting…

200 papers

Previous raw image-based low-light image enhancement methods predominantly relied on feed-forward neural networks to learn deterministic mappings from low-light to normally-exposed images. However, they failed to capture critical…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yufei Wang , Yi Yu , Wenhan Yang , Lanqing Guo , Lap-Pui Chau , Alex C. Kot , Bihan Wen

There is a need for fast adaptation in spike sorting algorithms to implement brain-machine interface (BMIs) in different applications. Learning and adapting the functionality of the sorting process in real-time can significantly improve the…

Signal Processing · Electrical Eng. & Systems 2025-09-08 Tao Fang , Majid Zamani

Reinforcement learning (RL) has emerged as a powerful tool for aligning diffusion models with human preferences, typically by optimizing a single reward function under a KL regularization constraint. In practice, however, human preferences…

Machine Learning · Computer Science 2026-04-17 Qi Zhang , Dawei Wang , Shaofeng Zou

Diffusion models are the go-to method for Text-to-Image generation, but their iterative denoising processes has high inference latency. Quantization reduces compute time by using lower bitwidths, but applies a fixed precision across all…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Basile Lewandowski , Simon Kurz , Aditya Shankar , Robert Birke , Jian-Jia Chen , Lydia Y. Chen

This paper presents innovative enhancements to diffusion models by integrating a novel multi-resolution network and time-dependent layer normalization. Diffusion models have gained prominence for their effectiveness in high-fidelity image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Qihao Liu , Zhanpeng Zeng , Ju He , Qihang Yu , Xiaohui Shen , Liang-Chieh Chen

Backpropagation-based approaches aim to align diffusion models with reward functions through end-to-end backpropagation of the reward gradient within the denoising chain, offering a promising perspective. However, due to the computational…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Xiefan Guo , Miaomiao Cui , Liefeng Bo , Di Huang

Diffusion models have emerged as the leading approach for text-to-image generation. However, their iterative sampling process, which gradually morphs random noise into coherent images, introduces significant latency that limits their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Peijie Qiu , Hariharan Ramshankar , Arnau Ramisa , René Vidal , Amit Kumar K C , Vamsi Salaka , Rahul Bhagat

Diffusion models are gaining widespread use in cutting-edge image, video, and audio generation. Score-based diffusion models stand out among these methods, necessitating the estimation of score function of the input data distribution. In…

Machine Learning · Computer Science 2024-05-24 Fangzhao Zhang , Mert Pilanci

Recent diffusion-based generative models achieve remarkable results by training on massive datasets, yet this practice raises concerns about memorization and copyright infringement. A proposed remedy is to train exclusively on noisy data…

Machine Learning · Computer Science 2025-06-04 Haoye Lu , Qifan Wu , Yaoliang Yu

The training of diffusion-based models for image generation is predominantly controlled by a select few Big Tech companies, raising concerns about privacy, copyright, and data authority due to their lack of transparency regarding training…

Machine Learning · Computer Science 2024-06-19 Matthijs de Goede , Bart Cox , Jérémie Decouchant

Text-to-image diffusion models pre-trained on billions of image-text pairs have recently enabled 3D content creation by optimizing a randomly initialized differentiable 3D representation with score distillation. However, the optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Yukun Huang , Jianan Wang , Yukai Shi , Boshi Tang , Xianbiao Qi , Lei Zhang

Machine unlearning in text-to-image diffusion models aims to remove targeted concepts while preserving overall utility. Prior diffusion unlearning methods typically rely on supervised weight edits or global penalties; reinforcement-learning…

Machine Learning · Computer Science 2026-02-17 Mykola Vysotskyi , Zahar Kohut , Mariia Shpir , Taras Rumezhak , Volodymyr Karpiv

Generative diffusion models have emerged as leading models in speech and image generation. However, in order to perform well with a small number of denoising steps, a costly tuning of the set of noise parameters is needed. In this work, we…

Machine Learning · Computer Science 2021-09-14 Robin San-Roman , Eliya Nachmani , Lior Wolf

We propose in this paper an analytically new construct of a diffusion model whose drift and diffusion parameters yield an exponentially time-decaying Signal to Noise Ratio in the forward process. In reverse, the construct cleverly carries…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Tanmay Asthana , Yufang Bao , Hamid Krim

The recent, impressive advances in algorithmic generation of high-fidelity image, audio, and video are largely due to great successes in score-based diffusion models. A key implementing step is score matching, that is, the estimation of the…

Machine Learning · Statistics 2024-09-12 Zehao Dou , Subhodh Kotekal , Zhehao Xu , Harrison H. Zhou

Recent empirical studies have demonstrated that diffusion models can effectively learn the image distribution and generate new samples. Remarkably, these models can achieve this even with a small number of training samples despite a large…

Machine Learning · Computer Science 2025-07-08 Peng Wang , Huijie Zhang , Zekai Zhang , Siyi Chen , Yi Ma , Qing Qu

Using diffusion models to solve inverse problems is a growing field of research. Current methods assume the degradation to be known and provide impressive results in terms of restoration quality and diversity. In this work, we leverage the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Charles Laroche , Andrés Almansa , Eva Coupete

Diffusion-based image super-resolution (SR) methods have demonstrated remarkable performance. Recent advancements have introduced deterministic sampling processes that reduce inference from 15 iterative steps to a single step, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Zihang Liu , Zhenyu Zhang , Hao Tang

Generative models have become a powerful tool for synthesizing training data in computer vision tasks. Current approaches solely focus on aligning generated images with the target dataset distribution. As a result, they capture only the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Zerun Wang , Jiafeng Mao , Xueting Wang , Toshihiko Yamasaki

Diffusion models have gained prominence in generating high-quality sequences of text. Nevertheless, current approaches predominantly represent discrete text within a continuous diffusion space, which incurs substantial computational…

Machine Learning · Computer Science 2023-10-17 Shansan Gong , Mukai Li , Jiangtao Feng , Zhiyong Wu , Lingpeng Kong