English
Related papers

Related papers: Category-based Galaxy Image Generation via Diffusi…

200 papers

Recent developments in generative models and large-scale datasets have substantially advanced 3D world generation, facilitating a broad range of domains including spatial intelligence, embodied intelligence, and autonomous driving. While…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Hanxin Zhu , Cong Wang , Peiyan Tu , Jiayi Luo , Tianyu He , Xin Jin , Zhibo Chen

The harnessing of machine learning, especially deep generative models, has opened up promising avenues in the field of synthetic DNA sequence generation. Whilst Generative Adversarial Networks (GANs) have gained traction for this…

Machine Learning · Computer Science 2023-12-27 Zehui Li , Yuhao Ni , Tim August B. Huygelen , Akashaditya Das , Guoxuan Xia , Guy-Bart Stan , Yiren Zhao

Text-conditioned image generation models have recently shown immense qualitative success using denoising diffusion processes. However, unlike discriminative vision-and-language models, it is a non-trivial task to subject these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Benno Krojer , Elinor Poole-Dayan , Vikram Voleti , Christopher Pal , Siva Reddy

Glaucoma is a progressive optic neuropathy characterized by structural damage to the optic nerve head and functional changes in the visual field. Detecting glaucoma early is crucial to preventing loss of eyesight. However, medical datasets…

Image and Video Processing · Electrical Eng. & Systems 2024-12-09 Youssof Nawar , Nouran Soliman , Moustafa Wassel , Mohamed ElHabebe , Noha Adly , Marwan Torki , Ahmed Elmassry , Islam Ahmed

Contemporary diffusion models built upon U-Net or Diffusion Transformer (DiT) architectures have revolutionized image generation through transformer-based attention mechanisms. The prevailing paradigm has commonly employed self-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 ZiYi Dong , Chengxing Zhou , Weijian Deng , Pengxu Wei , Xiangyang Ji , Liang Lin

Anatomical atlases are widely used for population studies and analysis. Conditional atlases target a specific sub-population defined via certain conditions, such as demographics or pathologies, and allow for the investigation of…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Sophie Starck , Vasiliki Sideri-Lampretsa , Bernhard Kainz , Martin J. Menten , Tamara T. Mueller , Daniel Rueckert

Self-supervised learning (SSL) has revolutionized representation learning in Remote Sensing (RS), advancing Geospatial Foundation Models (GFMs) to leverage vast unlabeled satellite imagery for diverse downstream tasks. Currently, GFMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yuru Jia , Valerio Marsocci , Ziyang Gong , Xue Yang , Maarten Vergauwen , Andrea Nascetti

Diffusion-based models demonstrate impressive generation capabilities. However, they also have a massive number of parameters, resulting in enormous model sizes, thus making them unsuitable for deployment on resource-constraint devices.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Avideep Mukherjee , Soumya Banerjee , Piyush Rai , Vinay P. Namboodiri

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

Machine Learning · Computer Science 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

Current perceptive models heavily depend on resource-intensive datasets, prompting the need for innovative solutions. Leveraging recent advances in diffusion models, synthetic data, by constructing image inputs from various annotations,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yibo Wang , Ruiyuan Gao , Kai Chen , Kaiqiang Zhou , Yingjie Cai , Lanqing Hong , Zhenguo Li , Lihui Jiang , Dit-Yan Yeung , Qiang Xu , Kai Zhang

Diffusion models have significantly advanced generative AI, but they encounter difficulties when generating complex combinations of multiple objects. As the final result heavily depends on the initial seed, accurately ensuring the desired…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Federico Betti , Lorenzo Baraldi , Lorenzo Baraldi , Rita Cucchiara , Nicu Sebe

We introduce GeoDiT, a diffusion transformer designed for text-to-satellite image generation with point-based control. Existing controlled satellite image generative models often require pixel-level maps that are time-consuming to acquire,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Srikumar Sastry , Dan Cher , Brian Wei , Aayush Dhakal , Subash Khanal , Dev Gupta , Nathan Jacobs

Layout Generation aims to synthesize plausible arrangements from given elements. Currently, the predominant methods in layout generation are Generative Adversarial Networks (GANs) and diffusion models, each presenting its own set of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Zhaoxing Gan , Guangnan Ye

Along with the nearing completion of the Square Kilometre Array (SKA), comes an increasing demand for accurate and reliable automated solutions to extract valuable information from the vast amount of data it will allow acquiring. Automated…

Video diffusion models are able to generate high-quality videos by learning strong spatial-temporal priors on large-scale datasets. In this paper, we aim to investigate whether such priors derived from a generative process are suitable for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Zejia Weng , Xitong Yang , Zhen Xing , Zuxuan Wu , Yu-Gang Jiang

We introduce a simple but effective unsupervised method for generating realistic and diverse images. We train a class-conditional GAN model without using manually annotated class labels. Instead, our model is conditional on labels…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Steven Liu , Tongzhou Wang , David Bau , Jun-Yan Zhu , Antonio Torralba

The reconstruction of X-rays CT images from sparse or limited-angle geometries is a highly challenging task. The lack of data typically results in artifacts in the reconstructed image and may even lead to object distortions. For this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Davide Evangelista , Pasquale Cascarano , Elena Loli Piccolomini

Recent generative models show impressive results in photo-realistic image generation. However, artifacts often inevitably appear in the generated results, leading to downgraded user experience and reduced performance in downstream tasks.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Yueqin Yin , Lianghua Huang , Yu Liu , Kaiqi Huang

Generative models have the potential to accelerate key steps in the discovery of novel molecular therapeutics and materials. Diffusion models have recently emerged as a powerful approach, excelling at unconditional sample generation and,…

Biomolecules · Quantitative Biology 2024-07-17 Leo Klarner , Tim G. J. Rudner , Garrett M. Morris , Charlotte M. Deane , Yee Whye Teh

In this work, we investigate the capability of generating images from pre-trained diffusion models at much higher resolutions than the training image sizes. In addition, the generated images should have arbitrary image aspect ratios. When…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Yingqing He , Shaoshu Yang , Haoxin Chen , Xiaodong Cun , Menghan Xia , Yong Zhang , Xintao Wang , Ran He , Qifeng Chen , Ying Shan