English
Related papers

Related papers: Scalable Diffusion Transformer for Conditional 4D …

200 papers

We present a novel 3D shape completion framework that unifies multimodal conditioning, leveraging both 2D images and 3D partial scans through a latent diffusion model. Shapes are represented as Truncated Signed Distance Functions (TSDFs)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Simon Schaefer , Juan D. Galvis , Xingxing Zuo , Stefan Leutengger

Latent variable generative models have emerged as powerful tools for generative tasks including image and video synthesis. These models are enabled by pretrained autoencoders that map high resolution data into a compressed lower dimensional…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia

Data scarcity in medical imaging poses significant challenges due to privacy concerns. Diffusion models, a recent generative modeling technique, offer a potential solution by generating synthetic and realistic data. However, questions…

Image and Video Processing · Electrical Eng. & Systems 2024-12-24 Abdullah al Nomaan Nafi , Md. Alamgir Hossain , Rakib Hossain Rifat , Md Mahabub Uz Zaman , Md Manjurul Ahsan , Shivakumar Raman

Vision Transformers and U-Net architectures have been widely adopted in the implementation of Diffusion Models. However, each architecture presents specific challenges while realizing them on-device. Vision Transformers require positional…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Sanchar Palit , Sathya Veera Reddy Dendi , Mallikarjuna Talluri , Raj Narayana Gadde

Functional magnetic resonance imaging (fMRI) is an emerging neuroimaging modality that is commonly modeled as networks of Regions of Interest (ROIs) and their connections, named functional connectivity, for understanding the brain functions…

Neurons and Cognition · Quantitative Biology 2024-10-01 Haokai Zhao , Haowei Lou , Lina Yao , Yu Zhang

We present LTM3D, a Latent Token space Modeling framework for conditional 3D shape generation that integrates the strengths of diffusion and auto-regressive (AR) models. While diffusion-based methods effectively model continuous latent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Xin Kang , Zihan Zheng , Lei Chu , Yue Gao , Jiahao Li , Hao Pan , Xuejin Chen , Yan Lu

Discriminative classifiers have become a foundational tool in deep learning for medical imaging, excelling at learning separable features of complex data distributions. However, these models often need careful design, augmentation, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Gian Mario Favero , Parham Saremi , Emily Kaczmarek , Brennan Nichyporuk , Tal Arbel

Real-world data generation often involves complex inter-dependencies among instances, violating the IID-data hypothesis of standard learning paradigms and posing a challenge for uncovering the geometric structures for learning desired…

Machine Learning · Computer Science 2023-05-30 Qitian Wu , Chenxiao Yang , Wentao Zhao , Yixuan He , David Wipf , Junchi Yan

Latent diffusion models for image generation have crossed a quality threshold which enabled them to achieve mass adoption. Recently, a series of works have made advancements towards replicating this success in the 3D domain, introducing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Anchit Gupta , Wenhan Xiong , Yixin Nie , Ian Jones , Barlas Oğuz

3D brain MRI studies often examine subtle morphometric differences between cohorts that are hard to detect visually. Given the high cost of MRI acquisition, these studies could greatly benefit from image syntheses, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Binxu Li , Wei Peng , Mingjie Li , Ehsan Adeli , Kilian M. Pohl

Magnetic Resonance Imaging (MRI) is a critical tool in modern medical diagnostics, yet its prolonged acquisition time remains a critical limitation, especially in time-sensitive clinical scenarios. While undersampling strategies can…

Image and Video Processing · Electrical Eng. & Systems 2025-10-09 Mohammed Alsubaie , Wenxi Liu , Linxia Gu , Ovidiu C. Andronesi , Sirani M. Perera , Xianqi Li

Diffusion models, as powerful generative models, have found a wide range of applications and shown great potential in solving image reconstruction problems. Some works attempted to solve MRI reconstruction with diffusion models, but these…

Image and Video Processing · Electrical Eng. & Systems 2025-06-09 Xingjian Tang , Jingwei Guan , Linge Li , Ran Shi , Youmei Zhang , Mengye Lyu , Li Yan

The acquisition of annotated datasets with paired images and segmentation masks is a critical challenge in domains such as medical imaging, remote sensing, and computer vision. Manual annotation demands significant resources, faces ethical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Rupak Bose , Chinedu Innocent Nwoye , Aditya Bhat , Nicolas Padoy

This paper introduces an innovative methodology for producing high-quality 3D lung CT images guided by textual information. While diffusion-based generative models are increasingly used in medical imaging, current state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yanwu Xu , Li Sun , Wei Peng , Shuyue Jia , Katelyn Morrison , Adam Perer , Afrooz Zandifar , Shyam Visweswaran , Motahhare Eslami , Kayhan Batmanghelich

In the realm of image synthesis, achieving fidelity to a reference image while adhering to conditional prompts remains a significant challenge. This paper proposes a novel approach that integrates a diffusion model with latent space…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Kshitij Pathania

A conditional latent-diffusion based framework for solving the electromagnetic inverse scattering problem associated with microwave imaging is introduced. This generative machine-learning model explicitly mirrors the non-uniqueness of the…

Image and Video Processing · Electrical Eng. & Systems 2025-10-30 Shirin Chehelgami , Joe LoVetri , Vahab Khoshdel

Neural diffusion processes provide a scalable, non-Gaussian approach to modelling distributions over functions, but existing formulations are limited to single-task inference and do not capture dependencies across related tasks. In many…

Machine Learning · Computer Science 2026-01-19 Joseph Rawson , Domniki Ladopoulou , Petros Dellaportas

Synthesizing realistic microstructure images conditioned on processing parameters is crucial for understanding process-structure relationships in materials design. However, this task remains challenging due to limited training micrographs…

Materials Science · Physics 2025-11-21 Hoang Cuong Phan , Minh Tien Tran , Chihun Lee , Hoheok Kim , Sehyeok Oh , Dong-Kyu Kim , Ho Won Lee

Diffusion models have demonstrated remarkable success in various domains, including molecular generation. However, conditional molecular generation remains a fundamental challenge due to an intrinsic trade-off between targeting specific…

Machine Learning · Computer Science 2024-11-04 Hojung Jung , Youngrok Park , Laura Schmid , Jaehyeong Jo , Dongkyu Lee , Bongsang Kim , Se-Young Yun , Jinwoo Shin

Magnetic Resonance Imaging (MRI) is a crucial diagnostic tool, but high-resolution scans are often slow and expensive due to extensive data acquisition requirements. Traditional MRI reconstruction methods aim to expedite this process by…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Emmanuelle Bourigault , Abdullah Hamdi , Amir Jamaludin