English
Related papers

Related papers: CardioDiT: Latent Diffusion Transformers for 4D Ca…

200 papers

Sounding Video Generation (SVG) remains a challenging task due to the inherent structural misalignment between audio and video, as well as the high computational cost of multimodal data processing. In this paper, we introduce ProAV-DiT, a…

Multimedia · Computer Science 2025-11-18 Jiahui Sun , Weining Wang , Mingzhen Sun , Yirong Yang , Xinxin Zhu , Jing Liu

Diffusion models have recently emerged as powerful frameworks for generating high-quality images. While recent studies have explored their application to time series forecasting, these approaches face significant challenges in cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Weilin Ruan , Siru Zhong , Haomin Wen , Yuxuan Liang

Recent advances in generative models for medical imaging have shown promise in representing multiple modalities. However, the variability in modality availability across datasets limits the general applicability of the synthetic data they…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Sven Lüpke , Yousef Yeganeh , Ehsan Adeli , Nassir Navab , Azade Farshad

In vivo cardiac diffusion tensor imaging (cDTI) is a promising Magnetic Resonance Imaging (MRI) technique for evaluating the micro-structure of myocardial tissue in the living heart, providing insights into cardiac function and enabling the…

Accurate 3D aortic construction is crucial for clinical diagnosis, preoperative planning, and computational fluid dynamics (CFD) simulations, as it enables the estimation of critical hemodynamic parameters such as blood flow velocity,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Delin An , Pan Du , Jian-Xun Wang , Chaoli Wang

Multi-modal images play a crucial role in comprehensive evaluations in medical image analysis providing complementary information for identifying clinically important biomarkers. However, in clinical practice, acquiring multiple modalities…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Jonghun Kim , Hyunjin Park

Diffusion Transformer (DiT), an emerging diffusion model for visual generation, has demonstrated superior performance but suffers from substantial computational costs. Our investigations reveal that these costs primarily stem from the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Wangbo Zhao , Yizeng Han , Jiasheng Tang , Kai Wang , Hao Luo , Yibing Song , Gao Huang , Fan Wang , Yang You

Computed Tomography (CT) scans are the standard-of-care for the visualization and diagnosis of many clinical ailments, and are needed for the treatment planning of external beam radiotherapy. Unfortunately, the availability of CT scanners…

Image and Video Processing · Electrical Eng. & Systems 2024-08-28 Yiran Sun , Hana Baroudi , Tucker Netherton , Laurence Court , Osama Mawlawi , Ashok Veeraraghavan , Guha Balakrishnan

This paper presents a novel motion feature guided diffusion model for unpaired video-to-video translation (MFD-V2V), designed to synthesize dynamic, high-contrast cine cardiac magnetic resonance (CMR) from lower-contrast, artifact-prone…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Swakshar Deb , Nian Wu , Frederick H. Epstein , Miaomiao Zhang

Conditional image-to-video (cI2V) generation aims to synthesize a new plausible video starting from an image (e.g., a person's face) and a condition (e.g., an action class label like smile). The key challenge of the cI2V task lies in the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Haomiao Ni , Changhao Shi , Kai Li , Sharon X. Huang , Martin Renqiang Min

In this article, we present a Latent Diffusion Model (LDM) for the generation of brain Magnetic Resonance Imaging (MRI), conditioning its generation based on pathology (Healthy, Glioblastoma, Sclerosis, Dementia) and acquisition modality…

MRI synthesis promises to mitigate the challenge of missing MRI modality in clinical practice. Diffusion model has emerged as an effective technique for image synthesis by modelling complex and variable data distributions. However, most…

Image and Video Processing · Electrical Eng. & Systems 2023-03-27 Lan Jiang , Ye Mao , Xi Chen , Xiangfeng Wang , Chao Li

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

Diffusion models have quickly risen in popularity for their ability to model complex distributions and perform effective posterior sampling. Unfortunately, the iterative nature of these generative models makes them computationally expensive…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tristan S. W. Stevens , Oisín Nolan , Jean-Luc Robert , Ruud J. G. van Sloun

Deep learning and generative models are advancing rapidly, with synthetic data increasingly being integrated into training pipelines for downstream analysis tasks. However, in medical imaging, their adoption remains constrained by the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Kyeonghun Kim , Jaehyeok Bae , Youngung Han , Joo Young Bae , Seoyoung Ju , Junsu Lim , Gyeongmin Kim , Nam-Joon Kim , Woo Kyoung Jeong , Ken Ying-Kai Liao , Won Jae Lee , Pa Hong , Hyuk-Jae Lee

We present JointDiT, a diffusion transformer that models the joint distribution of RGB and depth. By leveraging the architectural benefit and outstanding image prior of the state-of-the-art diffusion transformer, JointDiT not only generates…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Kwon Byung-Ki , Qi Dai , Lee Hyoseok , Chong Luo , Tae-Hyun Oh

The diffusion model has recently emerged as a potent approach in computer vision, demonstrating remarkable performances in the field of generative artificial intelligence. Capable of producing high-quality synthetic images, diffusion models…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Abdullah , Tao Huang , Ickjai Lee , Euijoon Ahn

Objective: While recent advances in text-conditioned generative models have enabled the synthesis of realistic medical images, progress has been largely confined to 2D modalities such as chest X-rays. Extending text-to-image generation to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Daniele Molino , Camillo Maria Caruso , Filippo Ruffini , Paolo Soda , Valerio Guarrasi

Temporal modeling on regular respiration-induced motions is crucial to image-guided clinical applications. Existing methods cannot simulate temporal motions unless high-dose imaging scans including starting and ending frames exist…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Xin You , Minghui Zhang , Hanxiao Zhang , Jie Yang , Nassir Navab

Latent diffusion models have proven to be state-of-the-art in the creation and manipulation of visual outputs. However, as far as we know, the generation of depth maps jointly with RGB is still limited. We introduce LDM3D-VR, a suite of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Gabriela Ben Melech Stan , Diana Wofk , Estelle Aflalo , Shao-Yen Tseng , Zhipeng Cai , Michael Paulitsch , Vasudev Lal