English
Related papers

Related papers: Improving text-conditioned latent diffusion for ca…

200 papers

Generative adversarial networks (GANs) are a class of unsupervised machine learning algorithms that can produce realistic images from randomly-sampled vectors in a multi-dimensional space. Until recently, it was not possible to generate…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Andrew Beers , James Brown , Ken Chang , J. Peter Campbell , Susan Ostmo , Michael F. Chiang , Jayashree Kalpathy-Cramer

Image generation models trained on large datasets can synthesize high-quality images but often produce spatially inconsistent and distorted images due to limited information about the underlying structures and spatial layouts. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Hyundo Lee , Suhyung Choi , Inwoo Hwang , Byoung-Tak Zhang

Diffusion models have recently emerged as powerful generative priors for solving inverse problems. However, training diffusion models in the pixel space are both data-intensive and computationally demanding, which restricts their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Bowen Song , Soo Min Kwon , Zecheng Zhang , Xinyu Hu , Qing Qu , Liyue Shen

Recent advancements in diffusion models have significantly impacted the trajectory of generative machine learning research, with many adopting the strategy of fine-tuning pre-trained models using domain-specific text-to-image datasets.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Mischa Dombrowski , Hadrien Reynaud , Johanna P. Müller , Matthew Baugh , Bernhard Kainz

Diffusion models have become the go-to method for text-to-image generation, producing high-quality images from pure noise. However, the inner workings of diffusion models is still largely a mystery due to their black-box nature and complex,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Berk Tinaz , Zalan Fabian , Mahdi Soltanolkotabi

Stable diffusion, a generative model used in text-to-image synthesis, frequently encounters resolution-induced composition problems when generating images of varying sizes. This issue primarily stems from the model being trained on pairs of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Qingping Zheng , Yuanfan Guo , Jiankang Deng , Jianhua Han , Ying Li , Songcen Xu , Hang Xu

Data augmentation is crucial in training deep models, preventing them from overfitting to limited data. Recent advances in generative AI, e.g., diffusion models, have enabled more sophisticated augmentation techniques that produce data…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Soroush Abbasi Koohpayegani , Anuj Singh , K L Navaneet , Hamed Pirsiavash , Hadi Jamali-Rad

Spatial Transcriptomics (ST) allows a high-resolution measurement of RNA sequence abundance by systematically connecting cell morphology depicted in Hematoxylin and Eosin (H&E) stained histology images to spatially resolved gene…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Sichen Zhu , Yuchen Zhu , Molei Tao , Peng Qiu

While deep learning techniques have proven successful in image-related tasks, the exponentially increased data storage and computation costs become a significant challenge. Dataset distillation addresses these challenges by synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Zhe Li , Weitong Zhang , Sarah Cechnicka , Bernhard Kainz

Obtaining annotated table structure data for complex tables is a challenging task due to the inherent diversity and complexity of real-world document layouts. The scarcity of publicly available datasets with comprehensive annotations for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Syed Jawwad Haider Hamdani , Saifullah Saifullah , Stefan Agne , Andreas Dengel , Sheraz Ahmed

We introduce nested diffusion models, an efficient and powerful hierarchical generative framework that substantially enhances the generation quality of diffusion models, particularly for images of complex scenes. Our approach employs a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xiao Zhang , Ruoxi Jiang , Rebecca Willett , Michael Maire

Neural rendering techniques promise efficient photo-realistic image synthesis while at the same time providing rich control over scene parameters by learning the physical image formation process. While several supervised methods have been…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Hassan Abu Alhaija , Siva Karthik Mustikovela , Justus Thies , Varun Jampani , Matthias Nießner , Andreas Geiger , Carsten Rother

Foundation models in digital pathology use massive datasets to learn useful compact feature representations of complex histology images. However, there is limited transparency into what drives the correlation between dataset size and…

With the rapid adoption of diffusion models, synthetic data generation has emerged as a promising approach for addressing the growing demand for large-scale image datasets. However, images generated purely by diffusion models often exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Thejas Venkatesh , Suguna Varshini Velury

Advancements in AI for medical imaging offer significant potential. However, their applications are constrained by the limited availability of data and the reluctance of medical centers to share it due to patient privacy concerns.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Marvin Seyfarth , Salman Ul Hassan Dar , Isabelle Ayx , Matthias Alexander Fink , Stefan O. Schoenberg , Hans-Ulrich Kauczor , Sandy Engelhardt

Generative AI, in general, and synthetic visual data generation, in specific, hold much promise for benefiting surgical training by providing photorealism to simulation environments. Current training methods primarily rely on reading…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Ivan Iliash , Simeon Allmendinger , Felix Meissen , Niklas Kühl , Daniel Rückert

Lung cancer has been one of the leading causes of cancer-related deaths worldwide for years. With the emergence of deep learning, computer-assisted diagnosis (CAD) models based on learning algorithms can accelerate the nodule screening…

Image and Video Processing · Electrical Eng. & Systems 2023-05-03 Xuan Zhao , Benjamin Hou

Autoencoders empower state-of-the-art image and video generative models by compressing pixels into a latent space through visual tokenization. Although recent advances have alleviated the performance degradation of autoencoders under high…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Dongxu Liu , Jiahui Zhu , Yuang Peng , Haomiao Tang , Yuwei Chen , Chunrui Han , Zheng Ge , Daxin Jiang , Mingxue Liao

We show that high quality, diverse and realistic-looking diffusion-weighted magnetic resonance images can be synthesized using deep generative models. Based on professional neuroradiologists' evaluations and diverse metrics with respect to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Alejandro Ungría Hirte , Moritz Platscher , Thomas Joyce , Jeremy J. Heit , Eric Tranvinh , Christian Federau

Generating desired images conditioned on given text descriptions has received lots of attention. Recently, diffusion models and autoregressive models have demonstrated their outstanding expressivity and gradually replaced GAN as the favored…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Xiaozhou You , Jian Zhang