English
Related papers

Related papers: SpaDiT: Diffusion Transformer for Spatial Gene Exp…

200 papers

The advancements in generative modeling, particularly the advent of diffusion models, have sparked a fundamental question: how can these models be effectively used for discriminative tasks? In this work, we find that generative models can…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Mihir Prabhudesai , Tsung-Wei Ke , Alexander C. Li , Deepak Pathak , Katerina Fragkiadaki

Predicting spatial gene expression from routine H\&E enables large-scale molecular profiling, yet current models treat this as isolated pointwise tasks, thereby overlooking essential biological structures like gene coordination and spatial…

Machine Learning · Computer Science 2026-05-19 Qi Si , Penglei Wang , Yushuai Wu , Yifeng Jiao , Xuyang Liu , Xin Guo , Yuan Qi , Yuan Cheng

We present JointDiT, a diffusion transformer that models the joint distribution of RGB and depth. By leveraging the architectural benefit and outstanding image prior of the state-of-the-art diffusion transformer, JointDiT not only generates…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Kwon Byung-Ki , Qi Dai , Lee Hyoseok , Chong Luo , Tae-Hyun Oh

We introduce GeoDiT, a diffusion transformer designed for text-to-satellite image generation with point-based control. Existing controlled satellite image generative models often require pixel-level maps that are time-consuming to acquire,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Srikumar Sastry , Dan Cher , Brian Wei , Aayush Dhakal , Subash Khanal , Dev Gupta , Nathan Jacobs

Depth estimation is a critical task in computer vision, with applications in autonomous navigation, robotics, and augmented reality. Event cameras, which encode temporal changes in light intensity as asynchronous binary spikes, offer unique…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xin Zhang , Liangxiu Han , Tam Sobeih , Lianghao Han , Darren Dancey

We introduce GrounDiT, a novel training-free spatial grounding technique for text-to-image generation using Diffusion Transformers (DiT). Spatial grounding with bounding boxes has gained attention for its simplicity and versatility,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Phillip Y. Lee , Taehoon Yoon , Minhyuk Sung

Diffusion Transformers (DiT) have emerged as a widely adopted backbone for high-fidelity image and video generation, yet their iterative denoising process incurs high computational costs. Existing training-free acceleration methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Hanshuai Cui , Zhiqing Tang , Qianli Ma , Zhi Yao , Weijia Jia

Generative diffusion models have achieved remarkable success in producing high-quality images. However, these models typically operate in continuous intensity spaces, diffusing independently across pixels and color channels. As a result,…

Graphics · Computer Science 2025-05-20 Javier E. Santos , Agnese Marcato , Roman Colman , Nicholas Lubbers , Yen Ting Lin

Tumour heterogeneity in breast cancer poses challenges in predicting outcome and response to therapy. Spatial transcriptomics technologies may address these challenges, as they provide a wealth of information about gene expression at the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-19 Md Mamunur Rahaman , Ewan K. A. Millar , Erik Meijering

Understanding the dynamic nature of biological systems is fundamental to deciphering cellular behavior, developmental processes, and disease progression. Single-cell RNA sequencing (scRNA-seq) has provided static snapshots of gene…

Quantitative Methods · Quantitative Biology 2025-05-02 Zhenyi Zhang , Yuhao Sun , Qiangwei Peng , Tiejun Li , Peijie Zhou

Recent text-to-image diffusion models are able to generate convincing results of unprecedented quality. However, it is nearly impossible to control the shapes of different regions/objects or their layout in a fine-grained fashion. Previous…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Omri Avrahami , Thomas Hayes , Oran Gafni , Sonal Gupta , Yaniv Taigman , Devi Parikh , Dani Lischinski , Ohad Fried , Xi Yin

Spatial Transcriptomics (ST) profiles thousands of gene expression values at discrete spots with precise coordinates on tissue sections, preserving spatial context essential for clinical and pathological studies. With rising sequencing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yishun Zhu , Jiaxin Qi , Jian Wang , Yuhua Zheng , Jianqiang Huang

PET imaging is widely employed for observing biological metabolic activities within the human body. However, numerous benign conditions can cause increased uptake of radiopharmaceuticals, confounding differentiation from malignant tumors.…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Ran Hong , Yuxia Huang , Lei Liu , Zhonghui Wu , Bingxuan Li , Xuemei Wang , Qiegen Liu

Recent advances in generative AI have opened promising avenues for steganography, which can securely protect sensitive information for individuals operating in hostile environments, such as journalists, activists, and whistleblowers.…

Machine Learning · Computer Science 2025-03-11 Aqib Mahfuz , Georgia Channing , Mark van der Wilk , Philip Torr , Fabio Pizzati , Christian Schroeder de Witt

Tokenizers are a key component of state-of-the-art generative image models, extracting the most important features from the signal while reducing data dimension and redundancy. Most current tokenizers are based on KL-regularized variational…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Théophane Vallaeys , Jakob Verbeek , Matthieu Cord

Recent advances in diffusion transformers (DiTs) have set new standards in image generation, yet remain impractical for on-device deployment due to their high computational and memory costs. In this work, we present an efficient DiT…

Acquiring accurate channel state information (CSI) is critical for reliable and efficient wireless communication, but challenges such as high pilot overhead and channel aging hinder timely and accurate CSI acquisition. CSI prediction, which…

Signal Processing · Electrical Eng. & Systems 2025-10-14 Mehdi Sattari , Javad Aliakbari , Alexandre Graell i Amat , Tommy Svensson

The harnessing of machine learning, especially deep generative models, has opened up promising avenues in the field of synthetic DNA sequence generation. Whilst Generative Adversarial Networks (GANs) have gained traction for this…

Machine Learning · Computer Science 2023-12-27 Zehui Li , Yuhao Ni , Tim August B. Huygelen , Akashaditya Das , Guoxuan Xia , Guy-Bart Stan , Yiren Zhao

In this study, we introduce a novel method for generating new synthetic samples that are independent and identically distributed (i.i.d.) from high-dimensional real-valued probability distributions, as defined implicitly by a set of Ground…

Machine Learning · Statistics 2024-07-09 Hamidreza Behjoo , Michael Chertkov

Generative models for de novo protein backbone design have achieved remarkable success in creating novel protein structures. However, these diffusion-based approaches remain computationally intensive and slower than desired for large-scale…

Machine Learning · Computer Science 2026-02-09 Shentong Mo , Lanqing Li
‹ Prev 1 3 4 5 6 7 10 Next ›