English
Related papers

Related papers: Diffusion Model with Clustering-based Conditioning…

200 papers

Denoising Diffusion Probabilistic Models (DDPMs) have achieved remarkable success in various image generation tasks compared with Generative Adversarial Nets (GANs). Recent work on semantic image synthesis mainly follows the de facto…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Wengang Zhou , Weilun Wang , Jianmin Bao , Dongdong Chen , Dong Chen , Lu Yuan , Houqiang Li

This paper introduces an innovative methodology for producing high-quality 3D lung CT images guided by textual information. While diffusion-based generative models are increasingly used in medical imaging, current state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yanwu Xu , Li Sun , Wei Peng , Shuyue Jia , Katelyn Morrison , Adam Perer , Afrooz Zandifar , Shyam Visweswaran , Motahhare Eslami , Kayhan Batmanghelich

Denoising diffusion probabilistic models (DDPMs) are a recent family of generative models that achieve state-of-the-art results. In order to obtain class-conditional generation, it was suggested to guide the diffusion process by gradients…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Bahjat Kawar , Roy Ganz , Michael Elad

Recent empirical studies have demonstrated that diffusion models can effectively learn the image distribution and generate new samples. Remarkably, these models can achieve this even with a small number of training samples despite a large…

Machine Learning · Computer Science 2025-07-08 Peng Wang , Huijie Zhang , Zekai Zhang , Siyi Chen , Yi Ma , Qing Qu

The scale and quality of a dataset significantly impact the performance of deep models. However, acquiring large-scale annotated datasets is both a costly and time-consuming endeavor. To address this challenge, dataset expansion…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Haowei Zhu , Ling Yang , Jun-Hai Yong , Hongzhi Yin , Jiawei Jiang , Meng Xiao , Wentao Zhang , Bin Wang

The increased demand for 3D data in AR/VR, robotics and gaming applications, gave rise to powerful generative pipelines capable of synthesizing high-quality 3D objects. Most of these models rely on the Score Distillation Sampling (SDS)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Ziyu Wan , Despoina Paschalidou , Ian Huang , Hongyu Liu , Bokui Shen , Xiaoyu Xiang , Jing Liao , Leonidas Guibas

Although neural networks achieve promising performance in many tasks, they may still fail when encountering some examples and bring about risks to applications. To discover risky samples, previous literature attempts to search for patterns…

Machine Learning · Computer Science 2025-12-23 Han Yu , Hao Zou , Xingxuan Zhang , Zhengyi Wang , Yue He , Kehan Li , Peng Cui

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which uses a single pre-training stage to address both…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Soumik Mukhopadhyay , Matthew Gwilliam , Vatsal Agarwal , Namitha Padmanabhan , Archana Swaminathan , Srinidhi Hegde , Tianyi Zhou , Abhinav Shrivastava

Generative diffusion models trained on large-scale datasets have achieved remarkable progress in image synthesis. In favor of their ability to supplement missing details and generate aesthetically pleasing contents, recent works have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Junhao Cheng , Wei-Ting Chen , Xi Lu , Ming-Hsuan Yang

Harnessing the power of diffusion models to synthesize auxiliary training data based on latent space features has proven effective in enhancing out-of-distribution (OOD) detection performance. However, extracting effective features outside…

Machine Learning · Computer Science 2025-11-25 Qilin Liao , Shuo Yang , Bo Zhao , Ping Luo , Hengshuang Zhao

In this paper, we explore the feasibility of using generative models, specifically Progressive Growing GANs (PG-GANs) and Stable Diffusion fine-tuning, to generate synthetic chest X-ray images for medical diagnosis purposes. Due to ethical…

Image and Video Processing · Electrical Eng. & Systems 2023-05-31 Muhammad Danyal Malik , Danish Humair

Deep learning methods have impacted almost every research field, demonstrating notable successes in medical imaging tasks such as denoising and super-resolution. However, the prerequisite for deep learning is data at scale, but data sharing…

Medical Physics · Physics 2024-02-16 Yongyi Shi , Wenjun Xia , Chuang Niu , Christopher Wiedeman , Ge Wang

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

Federated Class Incremental Learning (FCIL) is a critical yet largely underexplored issue that deals with the dynamic incorporation of new classes within federated learning (FL). Existing methods often employ generative adversarial networks…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Naibo Wang , Yuchen Deng , Wenjie Feng , Jianwei Yin , See-Kiong Ng

Cataract surgery is a frequently performed procedure that demands automation and advanced assistance systems. However, gathering and annotating data for training such systems is resource intensive. The publicly available data also comprises…

Generative diffusion models offer a natural choice for data augmentation when training complex vision models. However, ensuring reliability of their generative content as augmentation samples remains an open challenge. Despite a number of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Khawar Islam , Naveed Akhtar

For the past few years, deep generative models have increasingly been used in biological research for a variety of tasks. Recently, they have proven to be valuable for uncovering subtle cell phenotypic differences that are not directly…

Image and Video Processing · Electrical Eng. & Systems 2026-01-28 Anis Bourou , Thomas Boyer , Kévin Daupin , Véronique Dubreuil , Aurélie De Thonel , Valérie Mezger , Auguste Genovesio

Recent advances in synthetic imaging open up opportunities for obtaining additional data in the field of surgical imaging. This data can provide reliable supplements supporting surgical applications and decision-making through computer…

Image and Video Processing · Electrical Eng. & Systems 2023-12-07 Simeon Allmendinger , Patrick Hemmer , Moritz Queisner , Igor Sauer , Leopold Müller , Johannes Jakubik , Michael Vössing , Niklas Kühl

Diffusion models have recently become the de-facto approach for generative modeling in the 2D domain. However, extending diffusion models to 3D is challenging due to the difficulties in acquiring 3D ground truth data for training. On the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jiatao Gu , Qingzhe Gao , Shuangfei Zhai , Baoquan Chen , Lingjie Liu , Josh Susskind

Seismic imaging from sparsely acquired data faces challenges such as low image quality, discontinuities, and migration swing artifacts. Existing convolutional neural network (CNN)-based methods struggle with complex feature distributions…

Geophysics · Physics 2024-08-01 Xingchen Shi , Shijun Cheng , Weijian Mao , Wei Ouyang