English
Related papers

Related papers: Beyond Real Data: Synthetic Data through the Lens …

200 papers

Machine learning models are increasingly trained or fine-tuned on synthetic data. Recursively training on such data has been observed to significantly degrade performance in a wide range of tasks, often characterized by a progressive drift…

Machine Learning · Statistics 2026-02-19 Nail B. Khelifa , Richard E. Turner , Ramji Venkataramanan

Time-series data presents limitations stemming from data quality issues, bias and vulnerabilities, and generalization problem. Integrating universal data synthesis methods holds promise in improving generalization. However, current methods…

Machine Learning · Computer Science 2024-02-02 Fanzhe Fu , Junru Chen , Jing Zhang , Carl Yang , Lvbin Ma , Yang Yang

Predictive models that generalize well under distributional shift are often desirable and sometimes crucial to building robust and reliable machine learning applications. We focus on distributional shift that arises in causal inference from…

Machine Learning · Statistics 2018-02-27 Fredrik D. Johansson , Nathan Kallus , Uri Shalit , David Sontag

Evaluating the performance of machine learning models on diverse and underrepresented subgroups is essential for ensuring fairness and reliability in real-world applications. However, accurately assessing model performance becomes…

Machine Learning · Computer Science 2023-10-26 Boris van Breugel , Nabeel Seedat , Fergus Imrie , Mihaela van der Schaar

In today's business landscape, organizations need to find the right balance between using their customers' data ethically to power AI solutions and being compliant regarding data privacy and data usage regulations. In this paper, we discuss…

Computers and Society · Computer Science 2025-03-18 Aditi Godbole

Synthetic datasets have long been thought of as second-rate, to be used only when "real" data collected directly from the real world is unavailable. But this perspective assumes that raw data is clean, unbiased, and trustworthy, which it…

Databases · Computer Science 2019-05-07 Luke Rodriguez , Bill Howe

Many ground-breaking advancements in machine learning can be attributed to the availability of a large volume of rich data. Unfortunately, many large-scale datasets are highly sensitive, such as healthcare data, and are not widely available…

Machine Learning · Computer Science 2020-12-09 James Jordon , Alan Wilson , Mihaela van der Schaar

Learning methods using synthetic data have attracted attention as an effective approach for increasing the diversity of training data while reducing collection costs, thereby improving the robustness of model discrimination. However, many…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Koshiro Nagano , Ryo Fujii , Ryo Hachiuma , Fumiaki Sato , Taiki Sekii , Hideo Saito

Practitioners in diverse fields such as healthcare, economics and education are eager to apply machine learning to improve decision making. The cost and impracticality of performing experiments and a recent monumental increase in electronic…

Machine Learning · Computer Science 2023-08-01 Fredrik D. Johansson , Uri Shalit , Nathan Kallus , David Sontag

Machine learning has significant potential for optimizing various industrial processes. However, data acquisition remains a major challenge as it is both time-consuming and costly. Synthetic data offers a promising solution to augment…

Artificial Intelligence · Computer Science 2025-11-12 Georg Rottenwalter , Marcel Tilly , Christian Bielenberg , Katharina Obermeier

Synthetic data has gained significant momentum thanks to sophisticated machine learning tools that enable the synthesis of high-dimensional datasets. However, many generation techniques do not give the data controller control over what…

Cryptography and Security · Computer Science 2022-11-22 Florimond Houssiau , Samuel N. Cohen , Lukasz Szpruch , Owen Daniel , Michaela G. Lawrence , Robin Mitra , Henry Wilde , Callum Mole

Recent successes of massively overparameterized models have inspired a new line of work investigating the underlying conditions that enable overparameterized models to generalize well. This paper considers a framework where the possibly…

Machine Learning · Computer Science 2023-12-06 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

In many manufacturing settings, annotating data for machine learning and computer vision is costly, but synthetic data can be generated at significantly lower cost. Substituting the real-world data with synthetic data is therefore appealing…

Machine Learning · Computer Science 2024-06-28 Lukas Malte Kemeter , Rasmus Hvingelby , Paulina Sierak , Tobias Schön , Bishwajit Gosswam

Distributed learning is an effective way to analyze big data. In distributed regression, a typical approach is to divide the big data into multiple blocks, apply a base regression algorithm on each of them, and then simply average the…

Machine Learning · Computer Science 2017-08-08 Zhengchu Guo , Lei Shi , Qiang Wu

We present a case that the newly emerging field of synthetic data in the area of recommender systems should prioritize `doing data right'. We consider this catchphrase to have two aspects: First, we should not repeat the mistakes of the…

Information Retrieval · Computer Science 2021-10-08 Manel Slokom , Martha Larson

Although many recent works have investigated generalizable NeRF-based novel view synthesis for unseen scenes, they seldom consider the synthetic-to-real generalization, which is desired in many practical applications. In this work, we first…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Hao Yang , Lanqing Hong , Aoxue Li , Tianyang Hu , Zhenguo Li , Gim Hee Lee , Liwei Wang

Synthetic image data generation represents a promising avenue for training deep learning models, particularly in the realm of transfer learning, where obtaining real images within a specific domain can be prohibitively expensive due to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Yuhang Li , Xin Dong , Chen Chen , Jingtao Li , Yuxin Wen , Michael Spranger , Lingjuan Lyu

Recently, the use of synthetic training data has been on the rise as it offers correctly labelled datasets at a lower cost. The downside of this technique is that the so-called domain gap between the real target images and synthetic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Bram Vanherle , Steven Moonen , Frank Van Reeth , Nick Michiels

Data augmentation has been widely applied as an effective methodology to improve generalization in particular when training deep neural networks. Recently, researchers proposed a few intensive data augmentation techniques, which indeed…

Machine Learning · Computer Science 2019-11-22 Zhuoxun He , Lingxi Xie , Xin Chen , Ya Zhang , Yanfeng Wang , Qi Tian

A significant impediment to progress in research on bias in machine learning (ML) is the availability of relevant datasets. This situation is unlikely to change much given the sensitivity of such data. For this reason, there is a role for…

Machine Learning · Computer Science 2021-08-05 William Blanzeisky , Pádraig Cunningham , Kenneth Kennedy