English
Related papers

Related papers: Synthetic Data for Feature Selection

200 papers

In the current data driven era, synthetic data, artificially generated data that resembles the characteristics of real world data without containing actual personal information, is gaining prominence. This is due to its potential to…

Machine Learning · Computer Science 2023-09-06 Tshilidzi Marwala , Eleonore Fournier-Tombs , Serge Stinckwich

Recent advances in generative modelling have led many to see synthetic data as the go-to solution for a range of problems around data access, scarcity, and under-representation. In this paper, we study three prominent use cases: (1) Sharing…

Machine Learning · Computer Science 2026-02-04 Bogdan Kulynych , Theresa Stadler , Jean Louis Raisaro , Carmela Troncoso

Exploiting the recent advancements in artificial intelligence, showcased by ChatGPT and DALL-E, in real-world applications necessitates vast, domain-specific, and publicly accessible datasets. Unfortunately, the scarcity of such datasets…

Machine Learning · Computer Science 2023-05-17 Cyril Picard , Jürg Schiffmann , Faez Ahmed

In today's business landscape, organizations need to find the right balance between using their customers' data ethically to power AI solutions and being compliant regarding data privacy and data usage regulations. In this paper, we discuss…

Computers and Society · Computer Science 2025-03-18 Aditi Godbole

The public availability of collections containing user preferences is of vital importance for performing offline evaluations in the field of recommender systems. However, the number of rating datasets is limited because of the costs…

Information Retrieval · Computer Science 2019-09-04 Diego Monti , Giuseppe Rizzo , Maurizio Morisio

The emergence of generative AI models has dramatically expanded the availability and use of synthetic data across scientific, industrial, and policy domains. While these developments open new possibilities for data analysis, they also raise…

Machine Learning · Statistics 2026-03-06 Ahmad Abdel-Azim , Ruoyu Wang , Xihong Lin

We are surrounded by huge amounts of large-scale high dimensional data. It is desirable to reduce the dimensionality of data for many learning tasks due to the curse of dimensionality. Feature selection has shown its effectiveness in many…

Machine Learning · Computer Science 2016-11-08 Jundong Li , Huan Liu

This paper provides a detailed survey of synthetic data techniques. We first discuss the expected goals of using synthetic data in data augmentation, which can be divided into four parts: 1) Improving Diversity, 2) Data Balancing, 3)…

Machine Learning · Computer Science 2024-07-08 Hsin-Yu Chang , Pei-Yu Chen , Tun-Hsiang Chou , Chang-Sheng Kao , Hsuan-Yun Yu , Yen-Ting Lin , Yun-Nung Chen

To assist in the development of machine learning methods for automated classification of spectroscopic data, we have generated a universal synthetic dataset that can be used for model validation. This dataset contains artificial spectra…

Machine Learning · Computer Science 2022-06-15 Jan Schuetzke , Nathan J. Szymanski , Markus Reischl

In order to analyze a trained model performance and identify its weak spots, one has to set aside a portion of the data for testing. The test set has to be large enough to detect statistically significant biases with respect to all the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Ran Shadmi , Jonathan Laserson , Gil Elbaz

As observational datasets become larger and more complex, so too are the questions being asked of these data. Data simulations, i.e., synthetic data with properties (pixelization, noise, PSF, artifacts, etc.) akin to real data, are…

Instrumentation and Methods for Astrophysics · Physics 2019-10-25 Molly S. Peeples , Bjorn Emonts , Mark Kyprianou , Matthew T. Penny , Gregory F. Snyder , Christopher C. Stark , Michael Troxel , Neil T. Zimmerman , John ZuHone

Generating synthetic data through generative models is gaining interest in the ML community and beyond. In the past, synthetic data was often regarded as a means to private data release, but a surge of recent papers explore how its…

Machine Learning · Computer Science 2023-04-10 Boris van Breugel , Mihaela van der Schaar

Machine learning applications are becoming increasingly pervasive in our society. Since these decision-making systems rely on data-driven learning, risk is that they will systematically spread the bias embedded in data. In this paper, we…

Machine Learning · Statistics 2023-02-09 Alessandro Castelnovo , Riccardo Crupi , Nicole Inverardi , Daniele Regoli , Andrea Cosentini

In general, to draw robust conclusions from a dataset, all the analyzed population must be represented on said dataset. Having a dataset that does not fulfill this condition normally leads to selection bias. Additionally, graphs have been…

Machine Learning · Computer Science 2022-05-30 Axel Wassington , Sergi Abadal

Synthetic data has gained significant momentum thanks to sophisticated machine learning tools that enable the synthesis of high-dimensional datasets. However, many generation techniques do not give the data controller control over what…

Cryptography and Security · Computer Science 2022-11-22 Florimond Houssiau , Samuel N. Cohen , Lukasz Szpruch , Owen Daniel , Michaela G. Lawrence , Robin Mitra , Henry Wilde , Callum Mole

This explainer document aims to provide an overview of the current state of the rapidly expanding work on synthetic data technologies, with a particular focus on privacy. The article is intended for a non-technical audience, though some…

Feature selection is a problem of finding efficient features among all features in which the final feature set can improve accuracy and reduce complexity. In feature selection algorithms search strategies are key aspects. Since feature…

Machine Learning · Computer Science 2016-01-27 Mohadeseh Montazeri , Hamid Reza Naji , Mitra Montazeri , Ahmad Faraahi

In the rapidly evolving field of artificial intelligence, the creation and utilization of synthetic datasets have become increasingly significant. This report delves into the multifaceted aspects of synthetic data, particularly emphasizing…

Machine Learning · Computer Science 2024-01-04 Shuang Hao , Wenfeng Han , Tao Jiang , Yiping Li , Haonan Wu , Chunlin Zhong , Zhangjun Zhou , He Tang

Synthetic data are becoming a critical tool for building artificially intelligent systems. Simulators provide a way of generating data systematically and at scale. These data can then be used either exclusively, or in conjunction with real…

Artificial Intelligence · Computer Science 2023-04-07 Daniel McDuff , Theodore Curran , Achuta Kadambi

A common approach to synthetic data is to sample from a fitted model. We show that under general assumptions, this approach results in a sample with inefficient estimators and whose joint distribution is inconsistent with the true…

Statistics Theory · Mathematics 2026-02-18 Jordan Awan , Zhanrui Cai