English
Related papers

Related papers: Efficient Semantic Diffusion Architectures for Mod…

200 papers

In this study we develop dimension-reduction techniques to accelerate diffusion model inference in the context of synthetic data generation. The idea is to integrate compressed sensing into diffusion models (hence, CSDM): First, compress…

Machine Learning · Statistics 2025-09-30 Zhengyi Guo , Jiatu Li , Wenpin Tang , David D. Yao

Diffusion models are powerful generative models that map noise to data using stochastic processes. However, for many applications such as image editing, the model input comes from a distribution that is not random noise. As such, diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Linqi Zhou , Aaron Lou , Samar Khanna , Stefano Ermon

Generative image models have achieved remarkable progress in both natural and medical imaging. In the medical context, these techniques offer a potential solution to data scarcity-especially for low-prevalence anomalies that impair the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Gregory Schuit , Denis Parra , Cecilia Besa

Modern biomedical image analysis using deep learning often encounters the challenge of limited annotated data. To overcome this issue, deep generative models can be employed to synthesize realistic biomedical images. In this regard, we…

Image and Video Processing · Electrical Eng. & Systems 2026-02-23 Yuli Wu , Weidong He , Dennis Eschweiler , Ningxin Dou , Zixin Fan , Shengli Mi , Peter Walter , Johannes Stegmaier

Denoising Diffusion Probabilistic Models (DDPMs) have demonstrated significant achievements in various image and video generation tasks, including the domain of medical imaging. However, generating echocardiography videos based on semantic…

Image and Video Processing · Electrical Eng. & Systems 2023-10-12 Phi Nguyen Van , Duc Tran Minh , Hieu Pham Huy , Long Tran Quoc

Acquiring large quantities of data and annotations is known to be effective for developing high-performing deep learning models, but is difficult and expensive to do in the healthcare context. Adding synthetic training data using generative…

Image and Video Processing · Electrical Eng. & Systems 2023-10-06 Menghan Yu , Sourabh Kulhare , Courosh Mehanian , Charles B Delahunt , Daniel E Shea , Zohreh Laverriere , Ishan Shah , Matthew P Horning

Deep learning models have emerged as a powerful tool for various medical applications. However, their success depends on large, high-quality datasets that are challenging to obtain due to privacy concerns and costly annotation. Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Milad Yazdani , Yasamin Medghalchi , Pooria Ashrafian , Ilker Hacihaliloglu , Dena Shahriari

Ultrasound video classification enables automated diagnosis and has emerged as an important research area. However, publicly available ultrasound video datasets remain scarce, hindering progress in developing effective video classification…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Tingxiu Chen , Yilei Shi , Zixuan Zheng , Bingcong Yan , Jingliang Hu , Xiao Xiang Zhu , Lichao Mou

In this paper, a novel semantic communication framework empowered by generative artificial intelligence (GAI) is proposed, to enhance the robustness against both channel noise and transmission data distribution shifts. A theoretical…

Machine Learning · Computer Science 2025-07-18 Xiucheng Wang , Honggang Jia , Nan Cheng

In this paper, we present an effective data augmentation framework leveraging the Large Language Model (LLM) and Diffusion Model (DM) to tackle the challenges inherent in data-scarce scenarios. Recently, DMs have opened up the possibility…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Kyuheon Jung , Yongdeuk Seo , Seongwoo Cho , Jaeyoung Kim , Hyun-seok Min , Sungchul Choi

Deep Generative Models (DGMs) are widely used to create innovative designs across multiple industries, ranging from fashion to the automotive sector. In addition to generating images of high visual quality, the task of structural design…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Jiajie Fan , Laure Vuaille , Thomas Bäck , Hao Wang

Diffusion-based models have shown great promise in molecular generation but often require a large number of sampling steps to generate valid samples. In this paper, we introduce a novel Straight-Line Diffusion Model (SLDM) to tackle this…

Machine Learning · Computer Science 2025-06-10 Yuyan Ni , Shikun Feng , Haohan Chi , Bowen Zheng , Huan-ang Gao , Wei-Ying Ma , Zhi-Ming Ma , Yanyan Lan

Deep learning (DL) methods typically require large datasets to effectively learn data distributions. However, in the medical field, data is often limited in quantity, and acquiring labeled data can be costly. To mitigate this data scarcity,…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Marina Domínguez , Yordanka Velikova , Nassir Navab , Mohammad Farid Azampour

Latent diffusion models (LDMs) exhibit an impressive ability to produce realistic images, yet the inner workings of these models remain mysterious. Even when trained purely on images without explicit depth information, they typically output…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yida Chen , Fernanda Viégas , Martin Wattenberg

Automatic layout generation that can synthesize high-quality layouts is an important tool for graphic design in many applications. Though existing methods based on generative models such as Generative Adversarial Networks (GANs) and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Shang Chai , Liansheng Zhuang , Fengying Yan

Fashionable image generation aims to synthesize images of diverse fashion prevalent around the globe, helping fashion designers in real-time visualization by giving them a basic customized structure of how a specific design preference would…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Krishna Sri Ipsit Mantri , Nevasini Sasikumar

Diffusion models have recently gained unprecedented attention in the field of image synthesis due to their remarkable generative capabilities. Notwithstanding their prowess, these models often incur substantial computational costs,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xinyin Ma , Gongfan Fang , Xinchao Wang

Diffusion models have revolutionized image generation, yet several challenges restrict their application to large-image domains, such as digital pathology and satellite imagery. Given that it is infeasible to directly train a model on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Srikar Yellapragada , Alexandros Graikos , Kostas Triaridis , Prateek Prasanna , Rajarsi R. Gupta , Joel Saltz , Dimitris Samaras

Deep generative models have demonstrated remarkable success in medical image synthesis. However, ensuring conditioning faithfulness and high-quality synthetic images for direct or counterfactual generation remains a challenge. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Fangrui Huang , Alan Wang , Binxu Li , Bailey Trang , Ridvan Yesiloglu , Tianyu Hua , Wei Peng , Ehsan Adeli

Lidar point cloud synthesis based on generative models offers a promising solution to augment deep learning pipelines, particularly when real-world data is scarce or lacks diversity. By enabling flexible object manipulation, this synthesis…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zhengkang Xiang , Zizhao Li , Amir Khodabandeh , Kourosh Khoshelham