中文
相关论文

相关论文: Semantic-aware Data Augmentation for Text-to-image…

200 篇论文

Data augmentation is a central component of joint embedding self-supervised learning (SSL). Approaches that work for natural images may not always be effective in medical imaging tasks. This study systematically investigated the impact of…

图像与视频处理 · 电气工程与系统科学 2025-06-12 Blake VanBerlo , Alexander Wong , Jesse Hoey , Robert Arntfield

Deep generative models are becoming increasingly powerful, now generating diverse high fidelity photo-realistic samples given text prompts. Have they reached the point where models of natural images can be used for generative data…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Shekoofeh Azizi , Simon Kornblith , Chitwan Saharia , Mohammad Norouzi , David J. Fleet

We propose spatially-adaptive normalization, a simple but effective layer for synthesizing photorealistic images given an input semantic layout. Previous methods directly feed the semantic layout as input to the deep network, which is then…

计算机视觉与模式识别 · 计算机科学 2019-11-06 Taesung Park , Ming-Yu Liu , Ting-Chun Wang , Jun-Yan Zhu

Recent advances in data augmentation enable one to translate images by learning the mapping between a source domain and a target domain. Existing methods tend to learn the distributions by training a model on a variety of datasets, with…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Boyi Li , Yin Cui , Tsung-Yi Lin , Serge Belongie

Accurate interpretation and visualization of human instructions are crucial for text-to-image (T2I) synthesis. However, current models struggle to capture semantic variations from word order changes, and existing evaluations, relying on…

计算与语言 · 计算机科学 2025-04-18 Xiangru Zhu , Penglei Sun , Yaoxian Song , Yanghua Xiao , Zhixu Li , Chengyu Wang , Jun Huang , Bei Yang , Xiaoxiao Xu

Data Augmentation (DA) -- generating extra training samples beyond original training set -- has been widely-used in today's unbiased VQA models to mitigate the language biases. Current mainstream DA strategies are synthetic-based methods,…

计算机视觉与模式识别 · 计算机科学 2022-09-16 Long Chen , Yuhang Zheng , Jun Xiao

Vision transformer has demonstrated great potential in abundant vision tasks. However, it also inevitably suffers from poor generalization capability when the distribution shift occurs in testing (i.e., out-of-distribution data). To…

计算机视觉与模式识别 · 计算机科学 2022-12-07 Xin Li , Cuiling Lan , Guoqiang Wei , Zhibo Chen

Text-to-image (T2I) models have ushered in a new era of real-world image super-resolution (Real-ISR) due to their rich internal implicit knowledge for multimodal learning. Although bringing high-level semantic priors and dense pixel…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Xinrui Li , Jinrong Zhang , Jianlong Wu , Chong Chen , Liqiang Nie , Zhouchen Lin

Stable Diffusion (SD) has gained a lot of attention in recent years in the field of Generative AI thus helping in synthesizing medical imaging data with distinct features. The aim is to contribute to the ongoing effort focused on overcoming…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Ayman Abaid , Muhammad Ali Farooq , Niamh Hynes , Peter Corcoran , Ihsan Ullah

Data augmentation is crucial for pixel-wise annotation tasks like semantic segmentation, where labeling requires significant effort and intensive labor. Traditional methods, involving simple transformations such as rotations and flips,…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Quang-Huy Che , Duc-Tri Le , Bich-Nga Pham , Duc-Khai Lam , Vinh-Tiep Nguyen

Existing audio-driven visual dubbing methods have achieved great success. Despite this, we observe that the semantic ambiguity between spatial and temporal domains significantly degrades the synthesis stability for the dynamic faces. We…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Zijun Ding , Mingdie Xiong , Congcong Zhu , Jingrun Chen

Data augmentation is one of the most prevalent tools in deep learning, underpinning many recent advances, including those from classification, generative models, and representation learning. The standard approach to data augmentation…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Brandon Trabucco , Kyle Doherty , Max Gurinas , Ruslan Salakhutdinov

We propose an on-the-fly data augmentation method for automatic speech recognition (ASR) that uses alignment information to generate effective training samples. Our method, called Aligned Data Augmentation (ADA) for ASR, replaces…

计算与语言 · 计算机科学 2023-06-13 Tsz Kin Lam , Mayumi Ohta , Shigehiko Schamoni , Stefan Riezler

Data augmentation has been demonstrated as an effective strategy for improving model generalization and data efficiency. However, due to the discrete nature of natural language, designing label-preserving transformations for text data tends…

计算与语言 · 计算机科学 2020-10-20 Yanru Qu , Dinghan Shen , Yelong Shen , Sandra Sajeev , Jiawei Han , Weizhu Chen

One of the key shortcomings in current text-to-image (T2I) models is their inability to consistently generate images which faithfully follow the spatial relationships specified in the text prompt. In this paper, we offer a comprehensive…

Data augmentation methods enrich datasets with augmented data to improve the performance of neural networks. Recently, automated data augmentation methods have emerged, which automatically design augmentation strategies. Existing work…

计算机视觉与模式识别 · 计算机科学 2021-11-02 Misgana Negassi , Diane Wagner , Alexander Reiterer

Deep image matting methods have achieved increasingly better results on benchmarks (e.g., Composition-1k/alphamatting.com). However, the robustness, including robustness to trimaps and generalization to images from different domains, is…

计算机视觉与模式识别 · 计算机科学 2022-01-19 Yutong Dai , Brian Price , He Zhang , Chunhua Shen

While recent advancements in generative modeling have significantly improved text-image alignment, some residual misalignment between text and image representations still remains. Some approaches address this issue by fine-tuning models in…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Jaa-Yeon Lee , Byunghee Cha , Jeongsol Kim , Jong Chul Ye

Image alignment and image restoration are classical computer vision tasks. However, there is still a lack of datasets that provide enough data to train and evaluate end-to-end deep learning models. Obtaining ground-truth data for image…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Monika Kwiatkowski , Simon Matern , Olaf Hellwich

Semantic segmentation suffers from significant performance degradation when the trained network is applied to a different domain. To address this issue, unsupervised domain adaptation (UDA) has been extensively studied. Despite the…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Wangkai Li , Rui Sun , Huayu Mai , Tianzhu Zhang