English
Related papers

Related papers: Scalable Diffusion Transformer for Conditional 4D …

200 papers

Finding an appropriate representation of dynamic activities in the brain is crucial for many downstream applications. Due to its highly dynamic nature, temporally averaged fMRI (functional magnetic resonance imaging) can only provide a…

Machine Learning · Computer Science 2022-08-18 Sikun Lin , Shuyun Tang , Scott Grafton , Ambuj Singh

Diffusion models have shown exceptional scaling properties in the image synthesis domain, and initial attempts have shown similar benefits for applying diffusion to unconditional text synthesis. Denoising diffusion models attempt to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-17 Matthew Baas , Kevin Eloff , Herman Kamper

Spatial profiling technologies in biology, such as imaging mass cytometry (IMC) and spatial transcriptomics (ST), generate high-dimensional, multi-channel data with strong spatial alignment and complex inter-channel relationships.…

Machine Learning · Computer Science 2025-07-08 Haoran Zhang , Mingyuan Zhou , Wesley Tansey

Despite significant progress in generative modelling, existing diffusion models often struggle to produce anatomically precise female pelvic images, limiting their application in gynaecological imaging, where data scarcity and patient…

Image and Video Processing · Electrical Eng. & Systems 2025-08-26 Johanna P. Müller , Anika Knupfer , Pedro Blöss , Edoardo Berardi Vittur , Bernhard Kainz , Jana Hutter

Computational modeling of single-cell gene expression is crucial for understanding cellular processes, but generating realistic expression profiles remains a major challenge. This difficulty arises from the count nature of gene expression…

Magnetic Resonance Imaging (MRI) produces excellent soft tissue contrast, albeit it is an inherently slow imaging modality. Promising deep learning methods have recently been proposed to reconstruct accelerated MRI scans. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2024-04-17 Yilmaz Korkmaz , Tolga Cukur , Vishal M. Patel

While conditional diffusion models have achieved remarkable success in various applications, they require abundant data to train from scratch, which is often infeasible in practice. To address this issue, transfer learning has emerged as an…

Machine Learning · Computer Science 2025-10-28 Ziheng Cheng , Tianyu Xie , Shiyue Zhang , Cheng Zhang

Conditional diffusion models have made impressive progress in the field of image processing, but the characteristics of constructing data distribution pathways make it difficult to exploit the intrinsic correlation between tasks in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chengjie Huang , Jiafeng Yan , Jing Li , Lu Bai

As a dominant force in text-to-image generation tasks, Diffusion Probabilistic Models (DPMs) face a critical challenge in controllability, struggling to adhere strictly to complex, multi-faceted instructions. In this work, we aim to address…

Machine Learning · Computer Science 2024-02-27 Xuantong Liu , Tianyang Hu , Wenjia Wang , Kenji Kawaguchi , Yuan Yao

Functional magnetic resonance imaging (fMRI) is a neuroimaging modality that captures the blood oxygen level in a subject's brain while the subject either rests or performs a variety of functional tasks under different conditions. Given…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Sam Nguyen , Brenda Ng , Alan D. Kaplan , Priyadip Ray

Limited visibility of distribution network power flows at the low voltage level presents challenges to both distribution network operators from a planning perspective and distribution system operators from a congestion management…

Systems and Control · Electrical Eng. & Systems 2026-02-11 Alistair Brash , Junyi Lu , Bruce Stephen , Blair Brown , Robert Atkinson , Craig Michie , Fraser MacIntyre , Christos Tachtatzis

Diffusion models have recently shown promise in offline RL. However, these methods often suffer from high training costs and slow convergence, particularly when using transformer-based denoising backbones. While several optimization…

Machine Learning · Computer Science 2025-06-23 Zhiying Qiu , Tao Lin

We introduce LlamaGen, a new family of image generation models that apply original ``next-token prediction'' paradigm of large language models to visual generation domain. It is an affirmative answer to whether vanilla autoregressive…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Peize Sun , Yi Jiang , Shoufa Chen , Shilong Zhang , Bingyue Peng , Ping Luo , Zehuan Yuan

Advancements in language foundation models have primarily fueled the recent surge in artificial intelligence. In contrast, generative learning of non-textual modalities, especially videos, significantly trails behind language modeling. This…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Lijun Yu

Generative models have emerged as powerful tools in medical imaging, enabling tasks such as segmentation, anomaly detection, and high-quality synthetic data generation. These models typically rely on learning meaningful latent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jordi Malé , Juan Fortea , Mateus Rozalem-Aranha , Neus Martínez-Abadías , Xavier Sevillano

Diffusion models have demonstrated remarkable success in various image generation tasks, but their performance is often limited by the uniform processing of inputs across varying conditions and noise levels. To address this limitation, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Minglei Shi , Ziyang Yuan , Haotian Yang , Xintao Wang , Mingwu Zheng , Xin Tao , Wenliang Zhao , Wenzhao Zheng , Jie Zhou , Jiwen Lu , Pengfei Wan , Di Zhang , Kun Gai

Human motion synthesis is an important task in computer graphics and computer vision. While focusing on various conditioning signals such as text, action class, or audio to guide the generation process, most existing methods utilize…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Kebing Xue , Hyewon Seo

Generative models have demonstrated strong performance in conditional settings and can be viewed as a form of data compression, where the condition serves as a compact representation. However, their limited controllability and…

Machine Learning · Computer Science 2025-07-04 Xiao Li , Liangji Zhu , Anand Rangarajan , Sanjay Ranka

Neural receivers have demonstrated strong performance in wireless communication systems. However, their effectiveness typically depends on access to large-scale, scenario-specific channel data for training, which is often difficult to…

Information Theory · Computer Science 2025-11-04 Xingyu Zhou , Le Liang , Xinjie Li , Jing Zhang , Peiwen Jiang , Xiao Li , Shi Jin

Adaptive physics-informed super-resolution diffusion is developed for non-invasive virtual diagnostics of the 6D phase space density of charged particle beams. An adaptive variational autoencoder (VAE) embeds initial beam condition images…

Machine Learning · Computer Science 2025-01-14 Alexander Scheinker