English
Related papers

Related papers: Training on Synthetic Data Beats Real Data in Mult…

200 papers

We study, from an empirical standpoint, the efficacy of synthetic data in real-world scenarios. Leveraging synthetic data for training perception models has become a key strategy embraced by the community due to its efficiency, scalability,…

Machine Learning · Computer Science 2024-03-26 Che-Jui Chang , Danrui Li , Seonghyeon Moon , Mubbasir Kapadia

Analyzing medical data to find abnormalities is a time-consuming and costly task, particularly for rare abnormalities, requiring tremendous efforts from medical experts. Artificial intelligence has become a popular tool for the automatic…

Relation Extraction (RE) from tables is the task of identifying relations between pairs of columns of a table. Generally, RE models for this task require labelled tables for training. These labelled tables can also be generated artificially…

Computation and Language · Computer Science 2021-09-07 Gaurav Singh , Siffi Singh , Joshua Wong , Amir Saffari

One of the biggest challenges in machine learning is data collection. Training data is an important part since it determines how the model will behave. In object classification, capturing a large number of images per object and in different…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 August Baaz , Yonan Yonan , Kevin Hernandez-Diaz , Fernando Alonso-Fernandez , Felix Nilsson

Recent advancements in generative models have unlocked the capabilities to render photo-realistic data in a controllable fashion. Trained on the real data, these generative models are capable of producing realistic samples with minimal to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Abhay Rawat , Shubham Dokania , Astitva Srivastava , Shuaib Ahmed , Haiwen Feng , Rahul Tallamraju

Recent text-to-image generation models have shown promising results in generating high-fidelity photo-realistic images. Though the results are astonishing to human eyes, how applicable these generated images are for recognition tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Ruifei He , Shuyang Sun , Xin Yu , Chuhui Xue , Wenqing Zhang , Philip Torr , Song Bai , Xiaojuan Qi

Utility companies increasingly rely on drone imagery for post-event and routine inspection, but training accurate defect-type classifiers remains difficult because defect examples are rare and inspection datasets are often limited or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Xuesong Wang , Caisheng Wang

Despite recent advances in synthetic data generation, the scientific community still lacks a unified consensus on its usefulness. It is commonly believed that synthetic data can be used for both data exchange and boosting machine learning…

Machine Learning · Computer Science 2023-06-28 Dionysis Manousakas , Sergül Aydöre

Synthetic data generation is an appealing tool for augmenting and enriching datasets, playing a crucial role in advancing artificial intelligence (AI) and machine learning (ML). Not only does synthetic data help build robust AI/ML datasets…

Systems and Control · Electrical Eng. & Systems 2026-03-20 José Pulido , Francesc Wilhelmi , Sergio Fortes , Alfonso Fernández-Durán , Lorenzo Galati Giordano , Raquel Barco

Recent research has highlighted the risk of generative model collapse, where performance progressively degrades when continually trained on self-generated data. However, existing exploration on model collapse is limited to single, unimodal…

Machine Learning · Computer Science 2025-05-15 Zizhao Hu , Mohammad Rostami , Jesse Thomason

Training on model-generated synthetic data is a promising approach for finetuning LLMs, but it remains unclear when it helps or hurts. In this paper, we investigate this question for math reasoning via an empirical study, followed by…

Machine Learning · Computer Science 2024-06-21 Amrith Setlur , Saurabh Garg , Xinyang Geng , Naman Garg , Virginia Smith , Aviral Kumar

Synthetic data augmentation via large language models (LLMs) allows researchers to leverage additional training data, thus enhancing the performance of downstream tasks, especially when real-world data is scarce. However, the generated data…

Machine Learning · Computer Science 2025-03-25 Hsun-Yu Kuo , Yin-Hsiang Liao , Yu-Chieh Chao , Wei-Yun Ma , Pu-Jen Cheng

Recent advances in deep learning have significantly increased the performance of face recognition systems. The performance and reliability of these models depend heavily on the amount and quality of the training data. However, the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-19 Adam Kortylewski , Andreas Schneider , Thomas Gerig , Bernhard Egger , Andreas Morel-Forster , Thomas Vetter

Citation parsing, particularly with deep neural networks, suffers from a lack of training data as available datasets typically contain only a few thousand training instances. Manually labelling citation strings is very time-consuming, hence…

Machine Learning · Computer Science 2020-04-28 Mark Grennan , Joeran Beel

Handling imbalance in class distribution when building a classifier over tabular data has been a problem of long-standing interest. One popular approach is augmenting the training dataset with synthetically generated data. While classical…

Machine Learning · Computer Science 2025-02-20 Annie D'souza , Swetha M , Sunita Sarawagi

Despite recent advances in text-to-image generation, using synthetically generated data seldom brings a significant boost in performance for supervised learning. Oftentimes, synthetic datasets do not faithfully recreate the data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Jae Myung Kim , Stephan Alaniz , Cordelia Schmid , Zeynep Akata

We present a systematic investigation of Multi-modal Retrieval Augmented Multi-modal Generation (M$^2$RAG), a novel task that enables foundation models to process multi-modal web content and generate multi-modal responses, which exhibits…

Computation and Language · Computer Science 2025-05-26 Zi-Ao Ma , Tian Lan , Rong-Cheng Tu , Yong Hu , Yu-Shi Zhu , Tong Zhang , Heyan Huang , Zhijing Wu , Xian-Ling Mao

Automatically generated synthetic training examples have been shown to improve performance in machine reading comprehension (MRC). Compared to human annotated gold standard data, synthetic training data has unique properties, such as high…

Computation and Language · Computer Science 2020-10-27 Yanda Chen , Md Arafat Sultan , Vittorio Castelli

Actuarial ratemaking depends on high-quality data, yet access to such data is often limited by the cost of obtaining new data, privacy concerns, etc. In this paper, we explore synthetic-data generation as a potential solution to these…

Machine Learning · Statistics 2026-03-10 Yevhen Havrylenko , Meelis Käärik , Artur Tuttar

Recently, the use of synthetic training data has been on the rise as it offers correctly labelled datasets at a lower cost. The downside of this technique is that the so-called domain gap between the real target images and synthetic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Bram Vanherle , Steven Moonen , Frank Van Reeth , Nick Michiels