English
Related papers

Related papers: Semantic-aware Data Augmentation for Text-to-image…

200 papers

Although sequence-to-sequence models often achieve good performance in semantic parsing for i.i.d. data, their performance is still inferior in compositional generalization. Several data augmentation methods have been proposed to alleviate…

Computation and Language · Computer Science 2022-05-04 Jingfeng Yang , Le Zhang , Diyi Yang

The ability to efficiently search for images is essential for improving the user experiences across various products. Incorporating user feedback, via multi-modal inputs, to navigate visual search can help tailor retrieved results to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Surgan Jandial , Pinkesh Badjatiya , Pranit Chawla , Ayush Chopra , Mausoom Sarkar , Balaji Krishnamurthy

Recent advancements in image mixing and generative data augmentation have shown promise in enhancing image classification. However, these techniques face the challenge of balancing semantic fidelity with diversity. Specifically, image…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Ruoxin Chen , Zhe Wang , Ke-Yue Zhang , Shuang Wu , Jiamu Sun , Shouli Wang , Taiping Yao , Shouhong Ding

Automatic speech recognition (ASR) for conversational code-switching speech remains challenging due to the scarcity of realistic, high-quality labeled speech data. This paper explores multilingual text-to-speech (TTS) models as an effective…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-06 Yue Heng Yeo , Yuchen Hu , Shreyas Gopal , Yizhou Peng , Hexin Liu , Eng Siong Chng

Existing detectors are often trained on biased datasets, leading to the possibility of overfitting on non-causal image attributes that are spuriously correlated with real/synthetic labels. While these biased features enhance performance on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Ruoxin Chen , Junwei Xi , Zhiyuan Yan , Ke-Yue Zhang , Shuang Wu , Jingyi Xie , Xu Chen , Lei Xu , Isabel Guan , Taiping Yao , Shouhong Ding

Recent advances in text-to-image (T2I) models, especially diffusion-based architectures, have significantly improved the visual quality of generated images. However, these models continue to struggle with a critical limitation: maintaining…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yifan Shen , Yangyang Shu , Hye-young Paik , Yulei Sui

Text-to-Image (T2I) has been prevalent in recent years, with most common condition tasks having been optimized nicely. Besides, counterfactual Text-to-Image is obstructing us from a more versatile AIGC experience. For those scenes that are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Sifan Li , Ming Tao , Hao Zhao , Ling Shao , Hao Tang

Data augmentation is one of the most common tools in deep learning, underpinning many recent advances including tasks such as classification, detection, and semantic segmentation. The standard approach to data augmentation involves simple…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Fulong Ma , Weiqing Qi , Guoyang Zhao , Ming Liu , Jun Ma

Data Augmentation (DA) is frequently used to provide additional training data without extra human annotation automatically. However, data augmentation may introduce noisy data that impairs training. To guarantee the quality of augmented…

Computation and Language · Computer Science 2024-02-01 Tianqing Fang , Wenxuan Zhou , Fangyu Liu , Hongming Zhang , Yangqiu Song , Muhao Chen

Synthetic data, an appealing alternative to extensive expert-annotated data for medical image segmentation, consistently fails to improve segmentation performance despite its visual realism. The reason being that synthetic and real medical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 OFM Riaz Rahman Aranya , Kevin Desai

Data augmentation (DA) is a crucial technique for enhancing the sample efficiency of visual reinforcement learning (RL) algorithms. Notably, employing simple observation transformations alone can yield outstanding performance without extra…

Machine Learning · Computer Science 2023-10-30 Guozheng Ma , Linrui Zhang , Haoyu Wang , Lu Li , Zilin Wang , Zhen Wang , Li Shen , Xueqian Wang , Dacheng Tao

Data augmentation is an essential technique in improving the generalization of deep neural networks. The majority of existing image-domain augmentations either rely on geometric and structural transformations, or apply different kinds of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Morgan Heisler , Amin Banitalebi-Dehkordi , Yong Zhang

Text data augmentation is a widely used strategy for mitigating data sparsity in natural language processing (NLP), particularly in low-resource settings where limited samples hinder effective semantic modeling. While augmentation can…

Computation and Language · Computer Science 2025-07-17 Payal Bhattad , Sai Manoj Pudukotai Dinakarrao , Anju Gupta

Recent years have seen significant progress in Text-To-Audio (TTA) synthesis, enabling users to enrich their creative workflows with synthetic audio generated from natural language prompts. Despite this progress, the effects of data, model…

Sound · Computer Science 2025-07-02 Sang-gil Lee , Zhifeng Kong , Arushi Goel , Sungwon Kim , Rafael Valle , Bryan Catanzaro

Recently, Transformers have gained significant popularity in image restoration tasks such as image super-resolution and denoising, owing to their superior performance. However, balancing performance and computational burden remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Leheng Zhang , Wei Long , Yawei Li , Xingyu Zhou , Xiaorui Zhao , Shuhang Gu

The standard approach to tackling computer vision problems is to train deep convolutional neural network (CNN) models using large-scale image datasets which are representative of the target task. However, in many scenarios, it is often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Alhassan Mumuni , Fuseini Mumuni , Nana Kobina Gerrar

With the rapid advancement of text-to-image (T2I) generation models, assessing the semantic alignment between generated images and text descriptions has become a significant research challenge. Current methods, including those based on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Xinli Yue , JianHui Sun , Junda Lu , Liangchao Yao , Fan Xia , Tianyi Wang , Fengyun Rao , Jing Lyu , Yuetang Deng

Deep learning-based methods have reached state of the art performances, relying on large quantity of available data and computational power. Such methods still remain highly inappropriate when facing a major open machine learning problem,…

Computer Vision and Pattern Recognition · Computer Science 2018-10-05 Ghouthi Boukli Hacene , Vincent Gripon , Nicolas Farrugia , Matthieu Arzel , Michel Jezequel

Saliency prediction models are constrained by the limited diversity and quantity of labeled data. Standard data augmentation techniques such as rotating and cropping alter scene composition, affecting saliency. We propose a novel data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Bahar Aydemir , Deblina Bhattacharjee , Tong Zhang , Mathieu Salzmann , Sabine Süsstrunk

Data Augmentation (DA) -- enriching training data by adding synthetic samples -- is a technique widely adopted in Computer Vision (CV) and Natural Language Processing (NLP) tasks to improve models performance. Yet, DA has struggled to gain…

Machine Learning · Computer Science 2024-01-24 Chao Wang , Alessandro Finamore , Pietro Michiardi , Massimo Gallo , Dario Rossi