English
Related papers

Related papers: Semantic-aware Data Augmentation for Text-to-image…

200 papers

Owe to the powerful generative priors, the pre-trained text-to-image (T2I) diffusion models have become increasingly popular in solving the real-world image super-resolution problem. However, as a consequence of the heavy quality…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Rongyuan Wu , Tao Yang , Lingchen Sun , Zhengqiang Zhang , Shuai Li , Lei Zhang

Document-level neural machine translation (DocNMT) aims to generate translations that are both coherent and cohesive, in contrast to its sentence-level counterpart. However, due to its longer input length and limited availability of…

Computation and Language · Computer Science 2024-01-30 Minghao Wu , Yufei Wang , George Foster , Lizhen Qu , Gholamreza Haffari

Data augmentation is an effective way to diversify corpora in machine translation, but previous methods may introduce semantic inconsistency between original and augmented data because of irreversible operations and random subword sampling…

Computation and Language · Computer Science 2025-02-21 Jiashu Yao , Heyan Huang , Zeming Liu , Yuhang Guo

For the task of image classification, neural networks primarily rely on visual patterns. In robust networks, we would expect for visually similar classes to be represented similarly. We consider the problem of when semantically similar…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Natalie Abreu , Nathan Vaska , Victoria Helus

This paper investigates an open research problem of generating text-image pairs to improve the training of fine-grained image-to-text cross-modal retrieval task, and proposes a novel framework for paired data augmentation by uncovering the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Hao Wang , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

Based on recent advances in natural language modeling and those in text generation capabilities, we propose a novel data augmentation method for text classification tasks. We use a powerful pre-trained neural network model to artificially…

Computation and Language · Computer Science 2019-11-28 Ateret Anaby-Tavor , Boaz Carmeli , Esther Goldbraich , Amir Kantor , George Kour , Segev Shlomov , Naama Tepper , Naama Zwerdling

Mixup-based data augmentation has been validated to be a critical stage in the self-training framework for unsupervised domain adaptive semantic segmentation (UDA-SS), which aims to transfer knowledge from a well-annotated (source) domain…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zheng Chen , Zhengming Ding , Jason M. Gregory , Lantao Liu

Using synthetic data for training neural networks that achieve good performance on real-world data is an important task as it can reduce the need for costly data annotation. Yet, synthetic and real world data have a domain gap. Reducing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Shahaf Ettedgui , Shady Abu-Hussein , Raja Giryes

In this paper, we apply Semi-Supervised Learning (SSL) along with Data Augmentation (DA) for improving the accuracy of End-to-End ASR. We focus on the consistency regularization principle, which has been successfully applied to image…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-29 Felix Weninger , Franco Mana , Roberto Gemello , Jesús Andrés-Ferrer , Puming Zhan

The advent of accessible Generative AI tools enables anyone to create and spread synthetic images on social media, often with the intention to mislead, thus posing a significant threat to online information integrity. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Efthymia Amarantidou , Christos Koutlis , Symeon Papadopoulos , Panagiotis C. Petrantonakis

Generating images from textual descriptions has recently attracted a lot of interest. While current models can generate photo-realistic images of individual objects such as birds and human faces, synthesising images with multiple objects is…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Stanislav Frolov , Shailza Jolly , Jörn Hees , Andreas Dengel

Translating information between text and image is a fundamental problem in artificial intelligence that connects natural language processing and computer vision. In the past few years, performance in image caption generation has seen…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Hao Dong , Jingqing Zhang , Douglas McIlwraith , Yike Guo

Recent advances in text-to-image diffusion models have achieved remarkable success in generating high-quality, realistic images from textual descriptions. However, these approaches have faced challenges in precisely aligning the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Zutao Jiang , Guian Fang , Jianhua Han , Guansong Lu , Hang Xu , Shengcai Liao , Xiaojun Chang , Xiaodan Liang

Generating consistent and high-quality images from given texts is essential for visual-language understanding. Although impressive results have been achieved in generating high-quality images, text-image consistency is still a major concern…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Zhaorui Tan , Xi Yang , Zihan Ye , Qiufeng Wang , Yuyao Yan , Anh Nguyen , Kaizhu Huang

Domain generalization (DG) aims to enhance the model robustness against domain shifts without accessing target domains. A prevalent category of methods for DG is data augmentation, which focuses on generating virtual samples to simulate…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jintao Guo , Lei Qi , Yinghuan Shi , Yang Gao

Understanding the intention of the users and recognizing the semantic entities from their sentences, aka natural language understanding (NLU), is the upstream task of many natural language processing tasks. One of the main challenges is to…

Computation and Language · Computer Science 2022-09-07 Jiaxing Xu , Jianbin Cui , Jiangneng Li , Wenge Rong , Noboru Matsuda

Deep learning-based website fingerprinting has emerged as an effective technique for inferring the websites users visit. Although existing methods achieve strong performance on closed-world datasets, they often fail to generalize to…

Machine Learning · Computer Science 2026-05-13 Youquan Xian , Xueying Zeng , Lingjia Meng , Lei Cui , Runhan Song , Wei Wang , Zhengquan Ding , Peng Liu , Zhiyu Hao

In this paper, we present an effective data augmentation framework leveraging the Large Language Model (LLM) and Diffusion Model (DM) to tackle the challenges inherent in data-scarce scenarios. Recently, DMs have opened up the possibility…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Kyuheon Jung , Yongdeuk Seo , Seongwoo Cho , Jaeyoung Kim , Hyun-seok Min , Sungchul Choi

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

Machine Learning · Computer Science 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

Data augmentation have been intensively used in training deep neural network to improve the generalization, whether in original space (e.g., image space) or representation space. Although being successful, the connection between the…

Machine Learning · Computer Science 2020-06-30 Qian Li , Qingyuan Hu , Yong Qi , Saiyu Qi , Jie Ma , Jian Zhang