English
Related papers

Related papers: What Makes Good Synthetic Training Data for Zero-S…

200 papers

Synthetic image data generation represents a promising avenue for training deep learning models, particularly in the realm of transfer learning, where obtaining real images within a specific domain can be prohibitively expensive due to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Yuhang Li , Xin Dong , Chen Chen , Jingtao Li , Yuxin Wen , Michael Spranger , Lingjuan Lyu

Despite recent advances in stereo matching, the extension to intricate underwater settings remains unexplored, primarily owing to: 1) the reduced visibility, low contrast, and other adverse effects of underwater images; 2) the difficulty in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Qingxuan Lv , Junyu Dong , Yuezun Li , Sheng Chen , Hui Yu , Shu Zhang , Wenhan Wang

Learning-based stereo matching has recently achieved promising results, yet still suffers difficulties in establishing reliable matches in weakly matchable regions that are textureless, non-Lambertian, or occluded. In this paper, we address…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Jingyang Zhang , Yao Yao , Zixin Luo , Shiwei Li , Tianwei Shen , Tian Fang , Long Quan

Synthetic data generation is an appealing tool for augmenting and enriching datasets, playing a crucial role in advancing artificial intelligence (AI) and machine learning (ML). Not only does synthetic data help build robust AI/ML datasets…

Systems and Control · Electrical Eng. & Systems 2026-03-20 José Pulido , Francesc Wilhelmi , Sergio Fortes , Alfonso Fernández-Durán , Lorenzo Galati Giordano , Raquel Barco

The ultimate goal of Dataset Distillation is to synthesize a small synthetic dataset such that a model trained on this synthetic set will perform equally well as a model trained on the full, real dataset. Until now, no method of Dataset…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ziyao Guo , Kai Wang , George Cazenavette , Hui Li , Kaipeng Zhang , Yang You

This paper extensively investigates the effectiveness of synthetic training data to improve the capabilities of vision-and-language models for grounding textual descriptions to image regions. We explore various strategies to best generate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Ruozhen He , Ziyan Yang , Paola Cascante-Bonilla , Alexander C. Berg , Vicente Ordonez

The industry is rich in cases when we are required to make forecasting for large amounts of time series at once. However, we might be in a situation where we can not afford to train a separate model for each of them. Such issue in time…

Machine Learning · Computer Science 2024-03-06 Kseniia Kuvshinova , Olga Tsymboi , Alina Kostromina , Dmitry Simakov , Elizaveta Kovtun

Recent advances in foundation models have enabled audio-generative models that produce high-fidelity sounds associated with music, events, and human actions. Despite the success achieved in modern audio-generative models, the conventional…

Sound · Computer Science 2024-08-30 Tiantian Feng , Dimitrios Dimitriadis , Shrikanth Narayanan

Time series forecasting is critical in numerous real-world applications, requiring accurate predictions of future values based on observed patterns. While traditional forecasting techniques work well in in-domain scenarios with ample data,…

Machine Learning · Computer Science 2024-11-26 Liran Nochumsohn , Michal Moshkovitz , Orly Avner , Dotan Di Castro , Omri Azencot

Exploiting the recent advancements in artificial intelligence, showcased by ChatGPT and DALL-E, in real-world applications necessitates vast, domain-specific, and publicly accessible datasets. Unfortunately, the scarcity of such datasets…

Machine Learning · Computer Science 2023-05-17 Cyril Picard , Jürg Schiffmann , Faez Ahmed

Imitation learning from large multi-task demonstration datasets has emerged as a promising path for building generally-capable robots. As a result, 1000s of hours have been spent on building such large-scale datasets around the globe.…

Synthetic data becomes crucial for large language model training, but its effectiveness is highly inconsistent. We provide an information-theoretic account of this inconsistency: synthetic data improves a model only when the…

Machine Learning · Computer Science 2026-05-19 Hanyu Li , Zhengqi Sun , Xiaotie Deng

Recent complementary strands of research have shown that leveraging information on the data source through encoding their properties into embeddings can lead to performance increase when training a single model on heterogeneous data…

Computation and Language · Computer Science 2021-03-08 Rob van der Goot , Ahmet Üstün , Barbara Plank

*Data Synthesis* is a promising way to train a small model with very little labeled data. One approach for data synthesis is to leverage the rich knowledge from large language models to synthesize pseudo training examples for small models,…

Computation and Language · Computer Science 2023-10-23 Ruida Wang , Wangchunshu Zhou , Mrinmaya Sachan

We draw a formal connection between using synthetic training data to optimize neural network parameters and approximate, Bayesian, model-based reasoning. In particular, training a neural network using synthetic data can be viewed as…

Machine Learning · Computer Science 2017-03-03 Tuan Anh Le , Atilim Gunes Baydin , Robert Zinkov , Frank Wood

Synthetic data is becoming increasingly integral in data-scarce fields such as medical imaging, serving as a substitute for real data. However, its inherent statistical characteristics can significantly impact downstream tasks, potentially…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Krishan Agyakari Raja Babu , Rachana Sathish , Mrunal Pattanaik , Rahul Venkataramani

Stereo image and video generation, stereo geometry estimation, and condition-controlled view synthesis require paired data in which the variables that determine binocular geometry -- camera baseline, intrinsics, scene depth, and camera…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yangzhi Cui , Feng Qiao , Nathan Jacobs

Multi-modal foundation models such as CLIP have showcased impressive zero-shot capabilities. However, their applicability in resource-constrained environments is limited due to their large number of parameters and high inference time. While…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Niclas Popp , Jan Hendrik Metzen , Matthias Hein

Synthetic data has emerged as a cost-effective alternative to real data for training artificial neural networks (ANN). However, the disparity between synthetic and real data results in a domain gap. That gap leads to poor performance and…

Machine Learning · Computer Science 2025-09-03 Paul Wachter , Lukas Niehaus , Julius Schöning

As synthetic data becomes increasingly popular in machine learning tasks, numerous methods--without formal differential privacy guarantees--use synthetic data for training. These methods often claim, either explicitly or implicitly, to…

Cryptography and Security · Computer Science 2025-02-19 Yunpeng Zhao , Jie Zhang