English
Related papers

Related papers: Cross-conditioned Diffusion Model for Medical Imag…

200 papers

Denoising Diffusion Models (DDMs) are widely used for high-quality image generation and medical image segmentation but often rely on Unet-based architectures, leading to high computational overhead, especially with high-resolution images.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Avni Mittal , John Kalkhof , Anirban Mukhopadhyay , Arnav Bhavsar

Multi-modal magnetic resonance imaging (MRI) is essential in clinics for comprehensive diagnosis and surgical planning. Nevertheless, the segmentation of multi-modal MR images tends to be time-consuming and challenging. Convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2019-08-07 Cheng Li , Hui Sun , Zaiyi Liu , Meiyun Wang , Hairong Zheng , Shanshan Wang

Consistency Models (CMs) have showed a promise in creating visual content efficiently and with high quality. However, the way to add new conditional controls to the pretrained CMs has not been explored. In this technical report, we consider…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Jie Xiao , Kai Zhu , Han Zhang , Zhiheng Liu , Yujun Shen , Yu Liu , Xueyang Fu , Zheng-Jun Zha

Medical image-to-image (I2I) translation enables virtual scanning, i.e. the synthesis of a target imaging modality from a source one without additional acquisitions. Despite growing interest, most proposed methods operate on 2D slices, are…

MRI synthesis promises to mitigate the challenge of missing MRI modality in clinical practice. Diffusion model has emerged as an effective technique for image synthesis by modelling complex and variable data distributions. However, most…

Image and Video Processing · Electrical Eng. & Systems 2023-03-27 Lan Jiang , Ye Mao , Xi Chen , Xiangfeng Wang , Chao Li

Strong generative models can accurately learn channel distributions. This could save recurring costs for physical measurements of the channel. Moreover, the resulting differentiable channel model supports training neural encoders by…

Information Theory · Computer Science 2024-06-12 Muah Kim , Rick Fritschek , Rafael F. Schaefer

Deep generative models have significantly advanced medical imaging analysis by enhancing dataset size and quality. Beyond mere data augmentation, our research in this paper highlights an additional, significant capacity of deep generative…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Xiaodan Xing , Junzhi Ning , Yang Nan , Guang Yang

Recently, diffusion models were applied to a wide range of image analysis tasks. We build on a method for image-to-image translation using denoising diffusion implicit models and include a regression problem and a segmentation problem for…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Julia Wolleb , Robin Sandkühler , Florentin Bieder , Philippe C. Cattin

We introduce Transfusion, a recipe for training a multi-modal model over discrete and continuous data. Transfusion combines the language modeling loss function (next token prediction) with diffusion to train a single transformer over…

Artificial Intelligence · Computer Science 2024-08-21 Chunting Zhou , Lili Yu , Arun Babu , Kushal Tirumala , Michihiro Yasunaga , Leonid Shamis , Jacob Kahn , Xuezhe Ma , Luke Zettlemoyer , Omer Levy

Paired multi-modality medical images, can provide complementary information to help physicians make more reasonable decisions than single modality medical images. But they are difficult to generate due to multiple factors in practice (e.g.,…

Image and Video Processing · Electrical Eng. & Systems 2021-05-20 Junxiao Chen , Jia Wei , Rui Li

Dynamic contrast-enhanced (DCE) MRI is essential for breast cancer diagnosis and treatment. However, its reliance on contrast agents introduces safety concerns, contraindications, increased cost, and workflow complexity. To this end, we…

Image and Video Processing · Electrical Eng. & Systems 2025-09-16 Sebastian Ibarra , Javier del Riego , Alessandro Catanese , Julian Cuba , Julian Cardona , Nataly Leon , Jonathan Infante , Karim Lekadir , Oliver Diaz , Richard Osuala

Predicting counterfactual outcomes in longitudinal data, where sequential treatment decisions heavily depend on evolving patient states, is critical yet notoriously challenging due to complex time-dependent confounding and inadequate…

Machine Learning · Statistics 2026-04-15 Farbod Alinezhad , Jianfei Cao , Gary J. Young , Brady Post

Magnetic resonance imaging (MRI) is a powerful medical imaging modality, but long acquisition times limit throughput, patient comfort, and clinical accessibility. Diffusion-based generative models serve as strong image priors for reducing…

Machine Learning · Computer Science 2026-02-13 Sriram Ravula , Brett Levac , Yamin Arefeen , Ajil Jalal , Alexandros G. Dimakis , Jonathan I. Tamir

Multimodal medical image fusion (MMIF) extracts the most meaningful information from multiple source images, enabling a more comprehensive and accurate diagnosis. Achieving high-quality fusion results requires a careful balance of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Dan He , Weisheng Li , Guofen Wang , Yuping Huang , Shiqiang Liu

The tremendous progress in neural image generation, coupled with the emergence of seemingly omnipotent vision-language models has finally enabled text-based interfaces for creating and editing images. Handling generic images requires a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Omri Avrahami , Ohad Fried , Dani Lischinski

Efficiently utilizing discriminative features is crucial for convolutional neural networks to achieve remarkable performance in medical image segmentation and is also important for model generalization across multiple domains, where letting…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Ran Gu , Jiangshan Lu , Jingyang Zhang , Wenhui Lei , Xiaofan Zhang , Guotai Wang , Shaoting Zhang

Diffusion models (DMs) excel in unconditional generation, as well as on applications such as image editing and restoration. The success of DMs lies in the iterative nature of diffusion: diffusion breaks down the complex process of mapping…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Beomsu Kim , Jaemin Kim , Jeongsol Kim , Jong Chul Ye

Multimodal image-to-image translation (I2IT) aims to learn a conditional distribution that explores multiple possible images in the target domain given an input image in the source domain. Conditional generative adversarial networks (cGANs)…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Zhiwen Zuo , Lei Zhao , Zhizhong Wang , Haibo Chen , Ailin Li , Qijiang Xu , Wei Xing , Dongming Lu

Automatically generating one medical imaging modality from another is known as medical image translation, and has numerous interesting applications. This paper presents an interpretable generative modelling approach to medical image…

Image and Video Processing · Electrical Eng. & Systems 2020-05-08 Mikael Brudfors , John Ashburner , Parashkev Nachev , Yael Balbastre

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer