English
Related papers

Related papers: Latent Space Synergy: Text-Guided Data Augmentatio…

200 papers

Medical image segmentation has been significantly advanced with the rapid development of deep learning (DL) techniques. Existing DL-based segmentation models are typically discriminative; i.e., they aim to learn a mapping from the input…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Tao Chen , Chenhui Wang , Zhihao Chen , Yiming Lei , Hongming Shan

Medical image data is less accessible than in other domains due to privacy and regulatory constraints. In addition, labeling requires costly, time-intensive manual image annotation by clinical experts. To overcome these challenges,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-11 Fangyijie Wang , Kevin Whelan , Félix Balado , Kathleen M. Curran , Guénolé Silvestre

In recent years, significant progress has been made in collecting large-scale datasets to improve segmentation and autonomous driving models. These large-scale datasets are often dominated by common environmental conditions such as "Clear…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Harsh Goel , Sai Shankar Narasimhan , Oguzhan Akcin , Sandeep Chinchali

We introduce MedCondDiff, a diffusion-based framework for multi-organ medical image segmentation that is efficient and anatomically grounded. The model conditions the denoising process on semantic priors extracted by a Pyramid Vision…

Image and Video Processing · Electrical Eng. & Systems 2025-12-02 Ruirui Huang , Jiacheng Li

Deep learning based medical image recognition systems often require a substantial amount of training data with expert annotations, which can be expensive and time-consuming to obtain. Recently, synthetic augmentation techniques have been…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Jiarong Ye , Haomiao Ni , Peng Jin , Sharon X. Huang , Yuan Xue

This paper reports on the development of \textbf{a novel style guided diffusion model (SGDiff)} which overcomes certain weaknesses inherent in existing models for image synthesis. The proposed SGDiff combines image modality with a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Zhengwentai Sun , Yanghong Zhou , Honghong He , P. Y. Mok

This paper proposes a novel diffusion-based model, CompoDiff, for solving zero-shot Composed Image Retrieval (ZS-CIR) with latent diffusion. This paper also introduces a new synthetic dataset, named SynthTriplets18M, with 18.8 million…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Geonmo Gu , Sanghyuk Chun , Wonjae Kim , HeeJae Jun , Yoohoon Kang , Sangdoo Yun

Colonoscopy is a vital tool for the early diagnosis of colorectal cancer, which is one of the main causes of cancer-related mortality globally; hence, it is deemed an essential technique for the prevention and early detection of colorectal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Ojonugwa Oluwafemi Ejiga Peter , Akingbola Oluwapemiisin , Amalahu Chetachi , Adeniran Opeyemi , Fahmi Khalifa , Md Mahmudur Rahman

Accurate quantification of the extent of lung pathological patterns (fibrosis, ground-glass opacity, emphysema, consolidation) is prerequisite for diagnosis and follow-up of interstitial lung diseases. However, segmentation is challenging…

Image and Video Processing · Electrical Eng. & Systems 2025-01-08 Rezkellah Noureddine Khiati , Pierre-Yves Brillet , Radu Ispas , Catalin Fetita

Deep learning algorithms require extensive data to achieve robust performance. However, data availability is often restricted in the medical domain due to patient privacy concerns. Synthetic data presents a possible solution to these…

This technical report outlines our method for generating a synthetic dataset for semantic segmentation using a latent diffusion model. Our approach eliminates the need for additional models specifically trained on segmentation data and is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Felix Stillger , Frederik Hasecke , Tobias Meisen

The burgeoning field of camouflaged object detection (COD) seeks to identify objects that blend into their surroundings. Despite the impressive performance of recent models, we have identified a limitation in their robustness, where…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Xue-Jing Luo , Shuo Wang , Zongwei Wu , Christos Sakaridis , Yun Cheng , Deng-Ping Fan , Luc Van Gool

We present SinDiffusion, leveraging denoising diffusion models to capture internal distribution of patches from a single natural image. SinDiffusion significantly improves the quality and diversity of generated samples compared with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Weilun Wang , Jianmin Bao , Wengang Zhou , Dongdong Chen , Dong Chen , Lu Yuan , Houqiang Li

Synthetic Electronic Health Record (EHR) time-series generation is crucial for advancing clinical machine learning models, as it helps address data scarcity by providing more training data. However, most existing approaches focus primarily…

Machine Learning · Computer Science 2025-04-25 Bowen Deng , Chang Xu , Hao Li , Yuhao Huang , Min Hou , Jiang Bian

The scarcity of annotated surgical data poses a significant challenge for developing deep learning systems in computer-assisted interventions. While diffusion models can synthesize realistic images, they often suffer from data memorization,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Danush Kumar Venkatesh , Stefanie Speidel

This paper introduces an innovative methodology for producing high-quality 3D lung CT images guided by textual information. While diffusion-based generative models are increasingly used in medical imaging, current state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yanwu Xu , Li Sun , Wei Peng , Shuyue Jia , Katelyn Morrison , Adam Perer , Afrooz Zandifar , Shyam Visweswaran , Motahhare Eslami , Kayhan Batmanghelich

Widely adopted medical image segmentation methods, although efficient, are primarily deterministic and remain poorly amenable to natural language prompts. Thus, they lack the capability to estimate multiple proposals, human interaction, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yuan Lin , Murong Xu , Marc Hölle , Chinmay Prabhakar , Andreas Maier , Vasileios Belagiannis , Bjoern Menze , Suprosanna Shit

Deep learning methods have impacted almost every research field, demonstrating notable successes in medical imaging tasks such as denoising and super-resolution. However, the prerequisite for deep learning is data at scale, but data sharing…

Medical Physics · Physics 2024-02-16 Yongyi Shi , Wenjun Xia , Chuang Niu , Christopher Wiedeman , Ge Wang

The performance of medical image segmentation is increasingly defined by the efficiency of data utilization rather than merely the volume of raw data. Accurate segmentation, particularly for complex pathologies like meningiomas, demands…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yunhao Xu , Fuquan Zong , Yexuan Xing , Chulong Zhang , Guang Yang , Shilong Yang , Xiaokun Liang , Juan Yu

Building upon Diff-A-Riff, a latent diffusion model for musical instrument accompaniment generation, we present a series of improvements targeting quality, diversity, inference speed, and text-driven control. First, we upgrade the…

Sound · Computer Science 2024-10-31 Javier Nistal , Marco Pasini , Stefan Lattner