English
Related papers

Related papers: Scalable Diffusion Transformer for Conditional 4D …

200 papers

MRI provides superior soft tissue contrast without ionizing radiation; however, the absence of electron density information limits its direct use for dose calculation. As a result, current radiotherapy workflows rely on combined MRI and CT…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Zolnamar Dorjsembe , Hung-Yi Chen , Furen Xiao , Hsing-Kuo Pao

We present a novel approach for generating 360-degree high-quality, spatio-temporally coherent human videos from a single image. Our framework combines the strengths of diffusion transformers for capturing global correlations across…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Ruizhi Shao , Youxin Pang , Zerong Zheng , Jingxiang Sun , Yebin Liu

Recent advances in deep learning-based joint source-channel coding (DJSCC) have shown promise for end-to-end semantic image transmission. However, most existing schemes primarily focus on optimizing pixel-wise metrics, which often fail to…

Signal Processing · Electrical Eng. & Systems 2024-12-24 Pujing Yang , Guangyi Zhang , Yunlong Cai

We propose a new class of generative diffusion models, called functional diffusion. In contrast to previous work, functional diffusion works on samples that are represented by functions with a continuous domain. Functional diffusion can be…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Biao Zhang , Peter Wonka

Diffusion tensor imaging (DTI) provides crucial insights into the microstructure of the human brain, but it can be time-consuming to acquire compared to more readily available T1-weighted (T1w) magnetic resonance imaging (MRI). To address…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shaorong Zhang , Tamoghna Chattopadhyay , Sophia I. Thomopoulos , Jose-Luis Ambite , Paul M. Thompson , Greg Ver Steeg

Large generative diffusion models have revolutionized text-to-image generation and offer immense potential for conditional generation tasks such as image enhancement, restoration, editing, and compositing. However, their widespread adoption…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Kangfu Mei , Mauricio Delbracio , Hossein Talebi , Zhengzhong Tu , Vishal M. Patel , Peyman Milanfar

Face restoration under complex degradations still remains an ill-posed inverse problem due to severe information loss. Although diffusion models benefit from strong generative priors, most methods still condition only on low-quality inputs,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zirui Wang , Xianhui Lin , Yi Dong , Bo Wei , Gangjian Zhang , Siteng Ma , Zebiao Zheng , Xing Liu , Hong Gu , Minjing Dong

We present an end-to-end Transformer based Latent Diffusion model for image synthesis. On the ImageNet class conditioned generation task we show that a Transformer based Latent Diffusion model achieves a 14.1FID which is comparable to the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Princy Chahal

Diffusion Magnetic Resonance Imaging (dMRI) is an imaging technique with exquisite sensitivity to the microstructural properties of heterogeneous media. The conventionally adopted acquisition schemes involving single pulsed field gradients…

Biological Physics · Physics 2023-01-04 Deneb Boito , Cem Yolcu , Evren Özarslan

Recent studies have introduced a new class of generative models for synthesizing implicit neural representations (INRs) that capture arbitrary continuous signals in various domains. These models opened the door for domain-agnostic…

Machine Learning · Computer Science 2024-03-21 Dogyun Park , Sihyeon Kim , Sojin Lee , Hyunwoo J. Kim

Reinforcement learning combined with imitation learning has significantly advanced biomimetic quadrupedal locomotion. However, scaling these frameworks to massive, multi-source datasets exposes fundamental bottlenecks. First, traditional…

Robotics · Computer Science 2026-05-13 Jianhui Chen , Ruixin Zhan , Liu Liu , Yang Cai , Ziqiao Li

Deploying emotion recognition systems in real-world environments where devices must be small, low-power, and private remains a significant challenge. This is especially relevant for applications such as tension monitoring, conflict…

We introduce FLEX (FLow EXpert), a backbone architecture for generative modeling of spatio-temporal physical systems using diffusion models. FLEX operates in the residual space rather than on raw data, a modeling choice that we motivate…

Machine Learning · Computer Science 2025-05-26 N. Benjamin Erichson , Vinicius Mikuni , Dongwei Lyu , Yang Gao , Omri Azencot , Soon Hoe Lim , Michael W. Mahoney

There is substantial interest in developing artificial intelligence systems to support radiologists across tasks ranging from segmentation to report generation. Existing computed tomography (CT) foundation models have largely focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Rubén Moreno-Aguado , Alba Magallón , Victor Moreno , Yingying Fang , Guang Yang

Diffusion models create data from noise by inverting the forward paths of data towards noise and have emerged as a powerful generative modeling technique for high-dimensional, perceptual data such as images and videos. Rectified flow is a…

In this work, we propose DiffWave, a versatile diffusion probabilistic model for conditional and unconditional waveform generation. The model is non-autoregressive, and converts the white noise signal into structured waveform through a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-01 Zhifeng Kong , Wei Ping , Jiaji Huang , Kexin Zhao , Bryan Catanzaro

This paper presents the Large Vision Diffusion Transformer (LaVin-DiT), a scalable and unified foundation model designed to tackle over 20 computer vision tasks in a generative framework. Unlike existing large vision models directly adapted…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Zhaoqing Wang , Xiaobo Xia , Runnan Chen , Dongdong Yu , Changhu Wang , Mingming Gong , Tongliang Liu

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam

We introduce a novel diffusion transformer, LazyDiffusion, that generates partial image updates efficiently. Our approach targets interactive image editing applications in which, starting from a blank canvas or an image, a user specifies a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yotam Nitzan , Zongze Wu , Richard Zhang , Eli Shechtman , Daniel Cohen-Or , Taesung Park , Michaël Gharbi

This study introduces a novel approach for image reconstruction based on a diffusion model conditioned on the native data domain. Our method is applied to multi-coil MRI and quantitative MRI reconstruction, leveraging the domain-conditioned…

Machine Learning · Computer Science 2023-09-06 Wanyu Bian , Albert Jang , Fang Liu