English
Related papers

Related papers: Cascaded Multi-path Shortcut Diffusion Model for M…

200 papers

Adjoint-based design optimizations are usually computationally expensive and those costs scale with resolution. To address this, researchers have proposed machine learning approaches for inverse design that can predict higher-resolution…

Machine Learning · Computer Science 2024-08-19 Milad Habibi , Mark Fuge

Recently, diffusion models have demonstrated impressive capabilities in text-guided and image-conditioned image generation. However, existing diffusion models cannot simultaneously generate an image and a panoptic segmentation of objects…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Yinghan Long , Kaushik Roy

We introduce a Cascaded Diffusion Model (Cas-DM) that improves a Denoising Diffusion Probabilistic Model (DDPM) by effectively incorporating additional metric functions in training. Metric functions such as the LPIPS loss have been proven…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Jie An , Zhengyuan Yang , Jianfeng Wang , Linjie Li , Zicheng Liu , Lijuan Wang , Jiebo Luo

The tremendous progress in neural image generation, coupled with the emergence of seemingly omnipotent vision-language models has finally enabled text-based interfaces for creating and editing images. Handling generic images requires a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Omri Avrahami , Ohad Fried , Dani Lischinski

Diffusion models (DMs) have demonstrated great potential in the field of adversarial robustness, where DM-based defense methods can achieve superior defense capability without adversarial training. However, they all require huge…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Hefei Mei , Minjing Dong , Chang Xu

Scarcity of annotated data, particularly for rare or atypical morphologies, present significant challenges for cell and nuclei segmentation in computational pathology. While manual annotation is labor-intensive and costly, synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Dominik Winter , Mai Bui , Monica Azqueta Gavaldon , Nicolas Triltsch , Marco Rosati , Nicolas Brieu

Currently, medical image domain translation operations show a high demand from researchers and clinicians. Amongst other capabilities, this task allows the generation of new medical images with sufficiently high image quality, making them…

Image and Video Processing · Electrical Eng. & Systems 2024-03-08 Cristiana Tiago , Sten Roar Snare , Jurica Sprem , Kristin McLeod

Due to the three-dimensional nature of CT- or MR-scans, generative modeling of medical images is a particularly challenging task. Existing approaches mostly apply patch-wise, slice-wise, or cascaded generation techniques to fit the…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Paul Friedrich , Julia Wolleb , Florentin Bieder , Alicia Durrer , Philippe C. Cattin

Diffusion models (DMs) have been adopted across diverse fields with its remarkable abilities in capturing intricate data distributions. In this paper, we propose a Fast Diffusion Model (FDM) to significantly speed up DMs from a stochastic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Zike Wu , Pan Zhou , Kenji Kawaguchi , Hanwang Zhang

Diffusion models have shown significant progress in image translation tasks recently. However, due to their stochastic nature, there's often a trade-off between style transformation and content preservation. Current strategies aim to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Gihyun Kwon , Jong Chul Ye

Image rescaling aims to learn the optimal low-resolution (LR) image that can be accurately reconstructed to its original high-resolution (HR) counterpart, providing an efficient image processing and storage method for ultra-high definition…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ce Wang , Zhenyu Hu , Wanjie Sun , Zhenzhong Chen

Positron Emission Tomography (PET) and Computed Tomography (CT) are essential for diagnosing, staging, and monitoring various diseases, particularly cancer. Despite their importance, the use of PET/CT systems is limited by the necessity for…

Image and Video Processing · Electrical Eng. & Systems 2024-10-30 Dac Thai Nguyen , Trung Thanh Nguyen , Huu Tien Nguyen , Thanh Trung Nguyen , Huy Hieu Pham , Thanh Hung Nguyen , Thao Nguyen Truong , Phi Le Nguyen

Collective insights from a group of experts have always proven to outperform an individual's best diagnostic for clinical tasks. For the task of medical image segmentation, existing research on AI-based alternatives focuses more on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Aimon Rahman , Jeya Maria Jose Valanarasu , Ilker Hacihaliloglu , Vishal M Patel

The diffusion model has recently emerged as a potent approach in computer vision, demonstrating remarkable performances in the field of generative artificial intelligence. Capable of producing high-quality synthetic images, diffusion models…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Abdullah , Tao Huang , Ickjai Lee , Euijoon Ahn

Medical image translation is the process of converting from one imaging modality to another, in order to reduce the need for multiple image acquisitions from the same patient. This can enhance the efficiency of treatment by reducing the…

Image and Video Processing · Electrical Eng. & Systems 2024-12-03 Juhyung Ha , Jong Sung Park , David Crandall , Eleftherios Garyfallidis , Xuhong Zhang

Non-contrast CT (NCCT) imaging may reduce image contrast and anatomical visibility, potentially increasing diagnostic uncertainty. In contrast, contrast-enhanced CT (CECT) facilitates the observation of regions of interest (ROI). Leading…

Image and Video Processing · Electrical Eng. & Systems 2024-11-18 Tingyi Lin , Pengju Lyu , Jie Zhang , Yuqing Wang , Cheng Wang , Jianjun Zhu

Seismic imaging from sparsely acquired data faces challenges such as low image quality, discontinuities, and migration swing artifacts. Existing convolutional neural network (CNN)-based methods struggle with complex feature distributions…

Geophysics · Physics 2024-08-01 Xingchen Shi , Shijun Cheng , Weijian Mao , Wei Ouyang

The generation of realistic medical images from text descriptions has significant potential to address data scarcity challenges in healthcare AI while preserving patient privacy. This paper presents a comprehensive study of text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Mikhail Chaichuk , Sushant Gautam , Steven Hicks , Elena Tutubalina

Accurately translating medical images between different modalities, such as Computed Tomography (CT) to Magnetic Resonance Imaging (MRI), has numerous downstream clinical and machine learning applications. While several methods have been…

Image and Video Processing · Electrical Eng. & Systems 2025-12-03 Yuwen Chen , Nicholas Konz , Hanxue Gu , Haoyu Dong , Yaqian Chen , Lin Li , Jisoo Lee , Maciej A. Mazurowski

We propose a cascaded 3D diffusion model framework to synthesize high-fidelity 3D PET/CT volumes directly from demographic variables, addressing the growing need for realistic digital twins in oncologic imaging, virtual trials, and…

Image and Video Processing · Electrical Eng. & Systems 2025-05-29 Siyeop Yoon , Sifan Song , Pengfei Jin , Matthew Tivnan , Yujin Oh , Sekeun Kim , Dufan Wu , Xiang Li , Quanzheng Li