English
Related papers

Related papers: Mask, Stitch, and Re-Sample: Enhancing Robustness …

200 papers

Diffusion models have enabled remarkably high-quality medical image generation, yet it is challenging to enforce anatomical constraints in generated images. To this end, we propose a diffusion model-based method that supports…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Nicholas Konz , Yuwen Chen , Haoyu Dong , Maciej A. Mazurowski

The vast applications of deep generative models are anchored in three core capabilities -- generating new instances, reconstructing inputs, and learning compact representations -- across various data types, such as discrete text/protein…

Machine Learning · Computer Science 2024-06-06 Guangyi Liu , Yu Wang , Zeyu Feng , Qiyu Wu , Liping Tang , Yuan Gao , Zhen Li , Shuguang Cui , Julian McAuley , Zichao Yang , Eric P. Xing , Zhiting Hu

Computed tomography (CT) serves as an effective tool for lung cancer screening, diagnosis, treatment, and prognosis, providing a rich source of features to quantify temporal and spatial tumor changes. Nonetheless, the diversity of CT…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Md Selim , Jie Zhang , Faraneh Fathi , Michael A. Brooks , Ge Wang , Guoqiang Yu , Jin Chen

In this work, we address the limitations of denoising diffusion models (DDMs) in image restoration tasks, particularly the shape and color distortions that can compromise image quality. While DDMs have demonstrated a promising performance…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Xinlong Cheng , Tiantian Cao , Guoan Cheng , Bangxuan Huang , Xinghan Tian , Ye Wang , Xiaoyu He , Weixin Li , Tianfan Xue , Xuan Dong

In this paper, we present the Directly Denoising Diffusion Model (DDDM): a simple and generic approach for generating realistic images with few-step sampling, while multistep sampling is still preserved for better performance. DDDMs require…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Dan Zhang , Jingjing Wang , Feng Luo

The tremendous progress in neural image generation, coupled with the emergence of seemingly omnipotent vision-language models has finally enabled text-based interfaces for creating and editing images. Handling generic images requires a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Omri Avrahami , Ohad Fried , Dani Lischinski

In this work, we address the challenge of multi-task image generation with limited data for denoising diffusion probabilistic models (DDPM), a class of generative models that produce high-quality images by reversing a noisy diffusion…

Machine Learning · Computer Science 2023-11-29 Delaram Pirhayatifard , Mohammad Taha Toghani , Guha Balakrishnan , César A. Uribe

Diffusion probabilistic model (DPM) recently becomes one of the hottest topic in computer vision. Its image generation application such as Imagen, Latent Diffusion Models and Stable Diffusion have shown impressive generation capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Junde Wu , Rao Fu , Huihui Fang , Yu Zhang , Yehui Yang , Haoyi Xiong , Huiying Liu , Yanwu Xu

Diffusion models have been leveraged to perform adversarial purification and thus provide both empirical and certified robustness for a standard model. On the other hand, different robustly trained smoothed models have been studied to…

Machine Learning · Computer Science 2023-08-29 Jiawei Zhang , Zhongzhu Chen , Huan Zhang , Chaowei Xiao , Bo Li

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

Time series anomaly detection (TSAD) has been an important area of research for decades, with reconstruction-based methods, mostly based on generative models, gaining popularity and demonstrating success. Diffusion models have recently…

Machine Learning · Computer Science 2026-03-02 Kohei Obata , Zheng Chen , Yasuko Matsubara , Lingwei Zhu , Yasushi Sakurai

Despite significant progress in generative modelling, existing diffusion models often struggle to produce anatomically precise female pelvic images, limiting their application in gynaecological imaging, where data scarcity and patient…

Image and Video Processing · Electrical Eng. & Systems 2025-08-26 Johanna P. Müller , Anika Knupfer , Pedro Blöss , Edoardo Berardi Vittur , Bernhard Kainz , Jana Hutter

Volumetric optical microscopy using non-diffracting beams enables rapid imaging of 3D volumes by projecting them axially to 2D images but lacks crucial depth information. Addressing this, we introduce MicroDiffusion, a pioneering tool…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Mude Hui , Zihao Wei , Hongru Zhu , Fei Xia , Yuyin Zhou

This study introduces Polyp-DDPM, a diffusion-based method for generating realistic images of polyps conditioned on masks, aimed at enhancing the segmentation of gastrointestinal (GI) tract polyps. Our approach addresses the challenges of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Zolnamar Dorjsembe , Hsing-Kuo Pao , Furen Xiao

Inverse problems exist in many disciplines of science and engineering. In computer vision, for example, tasks such as inpainting, deblurring, and super resolution can be effectively modeled as inverse problems. Recently, denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Shayan Mohajer Hamidi , En-Hui Yang

Diffusion Probabilistic Models (DPMs) have emerged as a powerful class of deep generative models, achieving remarkable performance in image synthesis tasks. However, these models face challenges in terms of widespread adoption due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Kidist Amde Mekonnen , Nicola Dall'Asen , Paolo Rota

A diffusion probabilistic model (DPM), which constructs a forward diffusion process by gradually adding noise to data points and learns the reverse denoising process to generate new samples, has been shown to handle complex data…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Zhengxiong Luo , Dayou Chen , Yingya Zhang , Yan Huang , Liang Wang , Yujun Shen , Deli Zhao , Jingren Zhou , Tieniu Tan

Recent advances in diffusion models have enabled high-quality synthesis of specific subjects, such as identities or objects. This capability, while unlocking new possibilities in content creation, also introduces significant privacy risks,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Tae-Young Lee , Juwon Seo , Jong Hwan Ko , Gyeong-Moon Park

Generative artificial intelligence (AI) has been playing an important role in various domains. Leveraging its high capability to generate high-fidelity and diverse synthetic data, generative AI is widely applied in diagnostic tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Yifan Jiang , Ahmad Shariftabrizi , Venkata SK. Manem

This paper investigates the performance of diffusion models for video anomaly detection (VAD) within the most challenging but also the most operational scenario in which the data annotations are not used. As being sparse, diverse,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Anil Osman Tur , Nicola Dall'Asen , Cigdem Beyan , Elisa Ricci