English
Related papers

Related papers: What Makes Good Synthetic Training Data for Zero-S…

200 papers

Synthetic data is often positioned as a solution to replace sensitive fixed-size datasets with a source of unlimited matching data, freed from privacy concerns. There has been much progress in synthetic data generation over the last decade,…

Machine Learning · Computer Science 2025-06-09 Graham Cormode , Samuel Maddock , Enayat Ullah , Shripad Gade

In the recent years, singing voice separation systems showed increased performance due to the use of supervised training. The design of training datasets is known as a crucial factor in the performance of such systems. We investigate on how…

Sound · Computer Science 2019-06-07 Laure Prétet , Romain Hennequin , Jimena Royo-Letelier , Andrea Vaglio

One of the biggest challenges in machine learning is data collection. Training data is an important part since it determines how the model will behave. In object classification, capturing a large number of images per object and in different…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 August Baaz , Yonan Yonan , Kevin Hernandez-Diaz , Fernando Alonso-Fernandez , Felix Nilsson

Deep learning is now the gold standard in computer vision-based quality inspection systems. In order to detect defects, supervised learning is often utilized, but necessitates a large amount of annotated images, which can be costly:…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Pierre Gutierrez , Maria Luschkova , Antoine Cordier , Mustafa Shukor , Mona Schappert , Tim Dahmen

With the advent of generative modeling techniques, synthetic data and its use has penetrated across various domains from unstructured data such as image, text to structured dataset modeling healthcare outcome, risk decisioning in financial…

Machine Learning · Computer Science 2021-05-11 Aman Gupta , Deepak Bhatt , Anubha Pandey

Synthetic samples from diffusion models are promising for leveraging in training discriminative models as replications of real training datasets. However, we found that the synthetic datasets degrade classification performance over real…

Artificial Intelligence · Computer Science 2023-11-23 Shin'ya Yamaguchi , Takuma Fukuda

Synthetic data generation is gaining increasing popularity in different computer vision applications. Existing state-of-the-art face recognition models are trained using large-scale face datasets, which are crawled from the Internet and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Hatef Otroshi Shahreza , Sébastien Marcel

When the amount of parallel sentences available to train a neural machine translation is scarce, a common practice is to generate new synthetic training samples from them. A number of approaches have been proposed to produce synthetic…

Computation and Language · Computer Science 2024-01-30 Víctor M. Sánchez-Cartagena , Miquel Esplà-Gomis , Juan Antonio Pérez-Ortiz , Felipe Sánchez-Martínez

Supervised training of speech recognition models requires access to transcribed audio data, which often is not possible due to confidentiality issues. Our approach to this problem is to generate synthetic audio from a text-only corpus using…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-01 Yanis Perrin , Gilles Boulianne

The usage of both off-the-shelf and end-to-end trained deep networks have significantly improved performance of visual tracking on RGB videos. However, the lack of large labeled datasets hampers the usage of convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2018-12-26 Lichao Zhang , Abel Gonzalez-Garcia , Joost van de Weijer , Martin Danelljan , Fahad Shahbaz Khan

Recent advances in generating synthetic data that allow to add principled ways of protecting privacy -- such as Differential Privacy -- are a crucial step in sharing statistical information in a privacy preserving way. But while the focus…

Machine Learning · Statistics 2021-10-04 Christian Arnold , Marcel Neunhoeffer

Simulation is increasingly being used for generating large labelled datasets in many machine learning problems. Recent methods have focused on adjusting simulator parameters with the goal of maximising accuracy on a validation task, usually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Harkirat Singh Behl , Atılım Güneş Baydin , Ran Gal , Philip H. S. Torr , Vibhav Vineet

Deep learning methods typically require vast amounts of training data to reach their full potential. While some publicly available datasets exists, domain specific data always needs to be collected and manually labeled, an expensive, time…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Stefan Hinterstoisser , Olivier Pauly , Hauke Heibel , Martina Marek , Martin Bokeloh

Multimodal self-supervised representation learning has consistently proven to be a highly effective method in medical image analysis, offering strong task performance and producing biologically informed insights. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Lucas Farndale , Chris Walsh , Robert Insall , Ke Yuan

We consider the problem of reconstructing a dynamic scene observed from a stereo camera. Most existing methods for depth from stereo treat different stereo frames independently, leading to temporally inconsistent depth predictions. Temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Nikita Karaev , Ignacio Rocco , Benjamin Graham , Natalia Neverova , Andrea Vedaldi , Christian Rupprecht

Aerial-view human detection has a large demand for large-scale data to capture more diverse human appearances compared to ground-view human detection. Therefore, synthetic data can be a good resource to expand data, but the domain gap with…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Hyungtae Lee , Yan Zhang , Yi-Ting Shen , Heesung Kwon , Shuvra S. Bhattacharyya

This paper presents a new challenge that calls for zero-shot text-to-speech (TTS) systems to augment speech data for the downstream task, personalized speech enhancement (PSE), as part of the Generative Data Augmentation workshop at ICASSP…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-24 Jae-Sung Bae , Anastasia Kuznetsova , Dinesh Manocha , John Hershey , Trausti Kristjansson , Minje Kim

The impressive capabilities of recent language models can be largely attributed to the multi-trillion token pretraining datasets that they are trained on. However, model developers fail to disclose their construction methodology which has…

Model collapse in synthetic data indicates that iterative training on self-generated data leads to a gradual decline in performance. With the proliferation of AI models, synthetic data will fundamentally reshape the web data ecosystem.…

Computation and Language · Computer Science 2025-05-29 Xuekai Zhu , Daixuan Cheng , Hengli Li , Kaiyan Zhang , Ermo Hua , Xingtai Lv , Ning Ding , Zhouhan Lin , Zilong Zheng , Bowen Zhou

Automating quality inspection with computer vision techniques is often a very data-demanding task. Specifically, supervised deep learning requires a large amount of annotated images for training. In practice, collecting and annotating such…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Antoine Cordier , Pierre Gutierrez , Victoire Plessis