English
Related papers

Related papers: Living Synthetic Benchmarks: A Neutral and Cumulat…

200 papers

Score-based generative models (SGMs) have demonstrated unparalleled sampling quality and diversity in numerous fields, such as image generation, voice synthesis, and tabular data synthesis, etc. Inspired by those outstanding results, we…

Machine Learning · Computer Science 2025-11-27 Haksoo Lim , Jaehoon Lee , Sewon Park , Minjung Kim , Noseong Park

Tabular data is common yet typically incomplete, small in volume, and access-restricted due to privacy concerns. Synthetic data generation offers potential solutions. Many metrics exist for evaluating the quality of synthetic tabular data;…

Machine Learning · Computer Science 2024-04-01 Scott Cheng-Hsin Yang , Baxter Eaves , Michael Schmidt , Ken Swanson , Patrick Shafto

The machine learning community has mainly relied on real data to benchmark algorithms as it provides compelling evidence of model applicability. Evaluation on synthetic datasets can be a powerful tool to provide a better understanding of a…

Machine Learning · Computer Science 2022-11-01 Florence Regol , Anja Kroon , Mark Coates

Software Reliability Growth Models (SRGMs) are widely used to predict software reliability based on defect discovery data collected during testing or operational phases. However, their predictive accuracy often degrades in data-scarce…

Software Engineering · Computer Science 2025-09-23 Taehyoun Kim , Duksan Ryu , Jongmoon Baik

Synthesizing relational data has started to receive more attention from researchers, practitioners, and industry. The task is more difficult than synthesizing a single table due to the added complexity of relationships between tables. For…

Databases · Computer Science 2024-10-07 Valter Hudovernik , Martin Jurkovič , Erik Štrumbelj

Modeling and simulation of complex systems is key to explore systems dynamics. Many scientific approaches were developed to represent dynamic structure systems but most of these approaches are efficient for some kinds of systems and…

Software Engineering · Computer Science 2024-04-08 Aya Attia , Clément Foucher , Luiz Fernando Lavado Villa

Several families of continual learning techniques have been proposed to alleviate catastrophic interference in deep neural network training on non-stationary data. However, a comprehensive comparison and analysis of limitations remains…

Machine Learning · Computer Science 2021-12-14 Timm Hess , Martin Mundt , Iuliia Pliushch , Visvanathan Ramesh

Deep metric learning aims to learn embeddings that contain semantic similarity information among data points. To learn better embeddings, methods to generate synthetic hard samples have been proposed. Existing methods of synthetic hard…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Geonmo Gu , Byungsoo Ko

Privacy-preserving synthetic data offers a promising solution to harness segregated data in high-stakes domains where information is compartmentalized for regulatory, privacy, or institutional reasons. This survey provides a comprehensive…

Cryptography and Security · Computer Science 2025-03-28 Viktor Schlegel , Anil A Bharath , Zilong Zhao , Kevin Yee

Given the inherent class imbalance issue within student performance datasets, samples belonging to the edges of the target class distribution pose a challenge for predictive machine learning algorithms to learn. In this paper, we introduce…

Machine Learning · Computer Science 2021-01-05 Dom Huh

Large language models (LLMs) are widely adopted to generate synthetic datasets for various natural language processing (NLP) tasks, such as text classification and summarization. However, accurately measuring the diversity of these…

Computation and Language · Computer Science 2025-08-15 Yuchang Zhu , Huizhe Zhang , Bingzhe Wu , Jintang Li , Zibin Zheng , Peilin Zhao , Liang Chen , Yatao Bian

Automated, data-driven quality management systems, which facilitate the transformation of data into useable information, are desired to enhance decision-making processes. Integration of accurate, reliable, and straightforward approaches…

Other Computer Science · Computer Science 2019-03-27 Wenying Ji

Benchmarking has driven scientific progress in Evolutionary Computation, yet current practices fall short of real-world needs. Widely used synthetic suites such as BBOB and CEC isolate algorithmic phenomena but poorly reflect the structure,…

Stochastic hybrid systems have received significant attentions as a relevant modelling framework describing many systems, from engineering to the life sciences: they enable the study of numerous applications, including transportation…

Logic in Computer Science · Computer Science 2022-03-11 Abolfazl Lavaei , Sadegh Soudjani , Alessandro Abate , Majid Zamani

Generating synthetic data through generative models is gaining interest in the ML community and beyond, promising a future where datasets can be tailored to individual needs. Unfortunately, synthetic data is usually not perfect, resulting…

Machine Learning · Computer Science 2023-07-11 Boris van Breugel , Zhaozhi Qian , Mihaela van der Schaar

Recent advances in generative AI have led to remarkable interest in using systems that rely on large language models (LLMs) for practical applications. However, meaningful evaluation of these systems in real-world scenarios comes with a…

Artificial Intelligence · Computer Science 2025-07-22 Ethan M. Rudd , Christopher Andrews , Philip Tully

Recent developments have created differentiable physics simulators designed for machine learning pipelines that can be accelerated on a GPU. While these can simulate biomechanical models, these opportunities have not been exploited for…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 R. James Cotton

Training models to high-end performance requires availability of large labeled datasets, which are expensive to get. The goal of our work is to automatically synthesize labeled datasets that are relevant for a downstream task. We propose…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Amlan Kar , Aayush Prakash , Ming-Yu Liu , Eric Cameracci , Justin Yuan , Matt Rusiniak , David Acuna , Antonio Torralba , Sanja Fidler

A common and effective means for improving language model capabilities involves finetuning a ``student'' language model's parameters on generations from a more proficient ``teacher'' model. Termed ``synthetic data'', these generations are…

Recent advancements in generative AI have made it possible to create synthetic datasets that can be as accurate as real-world data for training AI models, powering statistical insights, and fostering collaboration with sensitive datasets…

Machine Learning · Computer Science 2025-01-08 Amy Steier , Lipika Ramaswamy , Andre Manoel , Alexa Haushalter