English
Related papers

Related papers: Generalized Denoising Diffusion Codebook Models (g…

200 papers

The introduction of diffusion models in anomaly detection has paved the way for more effective and accurate image reconstruction in pathologies. However, the current limitations in controlling noise granularity hinder diffusion models'…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Cosmin I. Bercea , Michael Neumayr , Daniel Rueckert , Julia A. Schnabel

Low-dose computed tomography (CT) images suffer from noise and artifacts due to photon starvation and electronic noise. Recently, some works have attempted to use diffusion models to address the over-smoothness and training instability…

Image and Video Processing · Electrical Eng. & Systems 2024-01-10 Qi Gao , Zilong Li , Junping Zhang , Yi Zhang , Hongming Shan

Diffusion models generate new samples by progressively decreasing the noise from the initially provided random distribution. This inference procedure generally utilizes a trained neural network numerous times to obtain the final output,…

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

Large denoising diffusion models, such as Stable Diffusion, have been trained on billions of image-caption pairs to perform text-conditioned image generation. As a byproduct of this training, these models have acquired general knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Alexandros Graikos , Nebojsa Jojic , Dimitris Samaras

Denoising low-dose computed tomography (CT) images is a critical task in medical image computing. Supervised deep learning-based approaches have made significant advancements in this area in recent years. However, these methods typically…

Image and Video Processing · Electrical Eng. & Systems 2023-07-17 Xuan Liu , Yaoqin Xie , Jun Cheng , Songhui Diao , Shan Tan , Xiaokun Liang

Image denoising is a fundamental and challenging task in the field of computer vision. Most supervised denoising methods learn to reconstruct clean images from noisy inputs, which have intrinsic spectral bias and tend to produce…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Yujin Wang , Lingen Li , Tianfan Xue , Jinwei Gu

Currently, applying diffusion models in pixel space of high resolution images is difficult. Instead, existing approaches focus on diffusion in lower dimensional spaces (latent diffusion), or have multiple super-resolution levels of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Emiel Hoogeboom , Jonathan Heek , Tim Salimans

Masked image modeling (MIM) has emerged as a promising approach for pre-training Vision Transformers (ViTs). MIMs predict masked tokens token-wise to recover target signals that are tokenized from images or generated by pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Taekyung Kim , Byeongho Heo , Dongyoon Han

Diffusion models have achieved state-of-the-art synthesis quality on both visual and audio tasks, and recent works further adapt them to textual data by diffusing on the embedding space. In this paper, we conduct systematic studies of the…

Computation and Language · Computer Science 2024-04-23 Zhujin Gao , Junliang Guo , Xu Tan , Yongxin Zhu , Fang Zhang , Jiang Bian , Linli Xu

Masked Diffusion Models (MDMs) have emerged as one of the most promising paradigms for generative modeling over discrete domains. It is known that MDMs effectively train to decode tokens in a random order, and that this ordering has…

Machine Learning · Computer Science 2025-11-25 Prateek Garg , Bhavya Kohli , Sunita Sarawagi

Deformable image registration aims to precisely align medical images from different modalities or times. Traditional deep learning methods, while effective, often lack interpretability, real-time observability and adjustment capacity during…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yongtai Zhuo , Yiqing Shen

Latent diffusion models (LDMs) enable high-fidelity synthesis by operating in learned latent spaces. However, training state-of-the-art LDMs requires complex staging: a tokenizer must be trained first, before the diffusion model can be…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shivam Duggal , Xingjian Bai , Zongze Wu , Richard Zhang , Eli Shechtman , Antonio Torralba , Phillip Isola , William T. Freeman

Diffusion Models (DMs) utilize an iterative denoising process to transform random noise into synthetic data. Initally proposed with a UNet structure, DMs excel at producing images that are virtually indistinguishable with or without…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yuewei Yang , Jialiang Wang , Xiaoliang Dai , Peizhao Zhang , Hongbo Zhang

Diffusion Models (DMs) are state-of-the-art generative models that learn a reversible corruption process from iterative noise addition and denoising. They are the backbone of many generative AI applications, such as text-to-image…

Cryptography and Security · Computer Science 2024-01-01 Sheng-Yen Chou , Pin-Yu Chen , Tsung-Yi Ho

Timbre transfer techniques aim at converting the sound of a musical piece generated by one instrument into the same one as if it was played by another instrument, while maintaining as much as possible the content in terms of musical…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-31 Luca Comanducci , Fabio Antonacci , Augusto Sarti

Ultrasound images are widespread in medical diagnosis for musculoskeletal, cardiac, and obstetrical imaging due to the efficiency and non-invasiveness of the acquisition methodology. However, the acquired images are degraded by acoustic…

Image and Video Processing · Electrical Eng. & Systems 2023-06-14 Hojat Asgariandehkordi , Sobhan Goudarzi , Adrian Basarab , Hassan Rivaz

Denoising diffusion probabilistic models (DDPMs) can be utilized to recover a clean signal from its degraded observation(s) by conditioning the model on the degraded signal. The degraded signals are themselves contaminated versions of the…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Ching-Hua Lee , Chouchang Yang , Jaejin Cho , Yashas Malur Saidutta , Rakshith Sharma Srinivasa , Yilin Shen , Hongxia Jin

The ultimate aim of image restoration like denoising is to find an exact correlation between the noisy and clear image domains. But the optimization of end-to-end denoising learning like pixel-wise losses is performed in a sample-to-sample…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Kangfu Mei , Vishal M. Patel , Rui Huang

It is widely accepted that medical imaging systems should be objectively assessed via task-based image quality (IQ) measures that ideally account for all sources of randomness in the measured image data, including the variation in the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xichen Xu , Wentao Chen , Weimin Zhou