English
Related papers

Related papers: Cross-Modal Generative Augmentation for Visual Que…

200 papers

Training of generative models especially Generative Adversarial Networks can easily diverge in low-data setting. To mitigate this issue, we propose a novel implicit data augmentation approach which facilitates stable training and synthesize…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Mengyu Dai , Haibin Hang , Xiaoyang Guo

Leveraging pre-trained visual language models has become a widely adopted approach for improving performance in downstream visual question answering (VQA) applications. However, in the specialized field of medical VQA, the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Gang Liu , Hongyang Li , Zerui He , Shenjun Zhong

Deep generative models are effective methods of modeling data. However, it is not easy for a single generative model to faithfully capture the distributions of complex data such as images. In this paper, we propose an approach for boosting…

Machine Learning · Computer Science 2019-05-14 Fan Bao , Hang Su , Jun Zhu

We explore spatiotemporal data augmentation using video foundation models to diversify both camera viewpoints and scene dynamics. Unlike existing approaches based on simple geometric transforms or appearance perturbations, our method…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Jinfan Zhou , Lixin Luo , Sungmin Eum , Heesung Kwon , Jeong Joon Park

Data augmentation is a series of techniques that generate high-quality artificial data by manipulating existing data samples. By leveraging data augmentation techniques, AI models can achieve significantly improved applicability in tasks…

Machine Learning · Computer Science 2025-10-16 Zaitian Wang , Pengfei Wang , Kunpeng Liu , Pengyang Wang , Yanjie Fu , Chang-Tien Lu , Charu C. Aggarwal , Jian Pei , Yuanchun Zhou

Neural approaches have become very popular in Question Answering (QA), however, they require a large amount of annotated data. In this work, we propose a novel approach that combines data augmentation via question-answer generation with…

Computation and Language · Computer Science 2024-09-16 Maximilian Kimmich , Andrea Bartezzaghi , Jasmina Bogojeska , Cristiano Malossi , Ngoc Thang Vu

Multimodal learning for generative models often refers to the learning of abstract concepts from the commonality of information in multiple modalities, such as vision and language. While it has proven effective for learning generalisable…

Machine Learning · Computer Science 2021-04-22 Yuge Shi , Brooks Paige , Philip H. S. Torr , N. Siddharth

This paper investigates methods for improving generative data augmentation for deep learning. Generative data augmentation leverages the synthetic samples produced by generative models as an additional dataset for classification with small…

Machine Learning · Computer Science 2023-10-24 Shin'ya Yamaguchi , Daiki Chijiwa , Sekitoshi Kanai , Atsutoshi Kumagai , Hisashi Kashima

In real-world machine learning systems, labels are often derived from user behaviors that the system wishes to encourage. Over time, new models must be trained as new training examples and features become available. However, feedback loops…

Machine Learning · Computer Science 2023-11-01 Victoria Lin , Louis-Philippe Morency , Dimitrios Dimitriadis , Srinagesh Sharma

Supervised deep learning methods for segmentation require large amounts of labelled training data, without which they are prone to overfitting, not generalizing well to unseen images. In practice, obtaining a large number of annotations…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Krishna Chaitanya , Neerav Karani , Christian Baumgartner , Olivio Donati , Anton Becker , Ender Konukoglu

In the ever-evolving landscape of social network advertising, the volume and accuracy of data play a critical role in the performance of predictive models. However, the development of robust predictive algorithms is often hampered by the…

Social and Information Networks · Computer Science 2024-11-13 Qikai Yang , Panfeng Li , Xinhe Xu , Zhicheng Ding , Wenjing Zhou , Yi Nian

Recent advances in using retrieval components over external knowledge sources have shown impressive results for a variety of downstream tasks in natural language processing. Here, we explore the use of unstructured external knowledge…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Shir Gur , Natalia Neverova , Chris Stauffer , Ser-Nam Lim , Douwe Kiela , Austin Reiter

Recent works have shown that generative data augmentation, where synthetic samples generated from deep generative models complement the training dataset, benefit NLP tasks. In this work, we extend this approach to the task of dialog state…

Computation and Language · Computer Science 2020-10-08 Kang Min Yoo , Hanbit Lee , Franck Dernoncourt , Trung Bui , Walter Chang , Sang-goo Lee

Generative models excel in creating realistic images, yet their dependency on extensive datasets for training presents significant challenges, especially in domains where data collection is costly or challenging. Current data-efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuta Mimura

Recently, variational auto-encoder (VAE) based approaches have made impressive progress on improving the diversity of generated responses. However, these methods usually suffer the cost of decreased relevance accompanied by diversity…

Computation and Language · Computer Science 2020-04-28 Zeyang Lei , Zekang Li , Jinchao Zhang , Fandong Meng , Yang Feng , Yujiu Yang , Cheng Niu , Jie Zhou

Cultural heritage applications and advanced machine learning models are creating a fruitful synergy to provide effective and accessible ways of interacting with artworks. Smart audio-guides, personalized art-related content and gamification…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Dario Cioni , Lorenzo Berlincioni , Federico Becattini , Alberto del Bimbo

In this paper, we explore and compare multiple solutions to the problem of data augmentation in image classification. Previous work has demonstrated the effectiveness of data augmentation through simple techniques, such as cropping,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Luis Perez , Jason Wang

As deep neural networks become more adept at traditional tasks, many of the most exciting new challenges concern multimodality---observations that combine diverse types, such as image and text. In this paper, we introduce a family of…

Machine Learning · Computer Science 2019-12-12 Mike Wu , Noah Goodman

This paper proposes a dataset augmentation method by fine-tuning pre-trained diffusion models. Generating images using a pre-trained diffusion model with textual conditioning often results in domain discrepancy between real data and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Abdullah Al Rahat , Hemanth Venkateswara

Data augmentation is an essential part of the training process applied to deep learning models. The motivation is that a robust training process for deep learning models depends on large annotated datasets, which are expensive to be…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Toan Tran , Trung Pham , Gustavo Carneiro , Lyle Palmer , Ian Reid