English
Related papers

Related papers: An information theoretic limit to data amplificati…

200 papers

We extend Generative Adversarial Networks (GANs) to the semi-supervised context by forcing the discriminator network to output class labels. We train a generative model G and a discriminator D on a dataset with inputs belonging to one of N…

Machine Learning · Statistics 2016-10-25 Augustus Odena

We introduce the concept of deceptive diffusion -- training a generative AI model to produce adversarial images. Whereas a traditional adversarial attack algorithm aims to perturb an existing image to induce a misclassificaton, the…

Machine Learning · Computer Science 2024-07-01 Lucas Beerens , Catherine F. Higham , Desmond J. Higham

Adversarial data augmentation has shown promise for training robust deep neural networks against unforeseen data shifts or corruptions. However, it is difficult to define heuristics to generate effective fictitious target distributions…

Machine Learning · Computer Science 2020-12-21 Long Zhao , Ting Liu , Xi Peng , Dimitris Metaxas

Experimental design is crucial for inference where limitations in the data collection procedure are present due to cost or other restrictions. Optimal experimental designs determine parameters that in some appropriate sense make the data…

Machine Learning · Statistics 2016-03-11 Panagiotis Tsilifis , Roger G. Ghanem , Paris Hajali

With the advent of Deep Learning (DL) techniques, especially Generative Adversarial Networks (GANs), data augmentation and generation are quickly evolving domains that have raised much interest recently. However, the DL techniques are data…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Umair Javaid , John A. Lee

Implicit generative models have the capability to learn arbitrary complex data distributions. On the downside, training requires telling apart real data from artificially-generated ones using adversarial discriminators, leading to unstable…

Machine Learning · Computer Science 2024-02-27 José Manuel de Frutos , Pablo M. Olmos , Manuel A. Vázquez , Joaquín Míguez

Limited data availability in machine learning significantly impacts performance and generalization. Traditional augmentation methods enhance moderately sufficient datasets. GANs struggle with convergence when generating diverse samples.…

Machine Learning · Computer Science 2024-10-02 Vahid Jebraeeli , Bo Jiang , Hamid Krim , Derya Cansever

Synthetic data generation, a cornerstone of Generative Artificial Intelligence, promotes a paradigm shift in data science by addressing data scarcity and privacy while enabling unprecedented performance. As synthetic data becomes more…

Machine Learning · Statistics 2024-03-12 Xiaotong Shen , Yifei Liu , Rex Shen

Training effective Generative Adversarial Networks (GANs) requires large amounts of training data, without which the trained models are usually sub-optimal with discriminator over-fitting. Several prior studies address this issue by…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Kaiwen Cui , Jiaxing Huang , Zhipeng Luo , Gongjie Zhang , Fangneng Zhan , Shijian Lu

Generative adversarial networks (GANs) have been shown to produce realistic samples from high-dimensional distributions, but training them is considered hard. A possible explanation for training instabilities is the inherent imbalance…

Machine Learning · Statistics 2018-07-12 Mehdi S. M. Sajjadi , Giambattista Parascandolo , Arash Mehrjou , Bernhard Schölkopf

Data Augmentation (DA) is a technique to increase the quantity and diversity of the training data, and by that alleviate overfitting and improve generalisation. However, standard DA produces synthetic data for augmentation with limited…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Lorenzo Tronchin , Minh H. Vu , Paolo Soda , Tommy Löfstedt

Clinical data usually cannot be freely distributed due to their highly confidential nature and this hampers the development of machine learning in the healthcare domain. One way to mitigate this problem is by generating realistic synthetic…

Machine learning algorithms are used in diverse domains, many of which face significant challenges due to data imbalance. Studies have explored various approaches to address the issue, like data preprocessing, cost-sensitive learning, and…

Artificial Intelligence · Computer Science 2025-02-25 Pankaj Yadav , Gulshan Sihag , Vivek Vijay

Data augmentation, a widely-employed technique for addressing data scarcity, involves generating synthetic data examples which are then used to augment available training data. Researchers have seen surprising success from simple methods,…

Computation and Language · Computer Science 2025-06-05 Ray Groshan , Michael Ginn , Alexis Palmer

We present a compression algorithm for parton densities using synthetic replicas generated from the training of a Generative Adversarial Network (GAN). The generated replicas are used to further enhance the statistics of a given Monte Carlo…

High Energy Physics - Phenomenology · Physics 2021-07-07 Stefano Carrazza , Juan M. Cruz-Martinez , Tanjona R. Rabemananjara

In recent years, Generative Adversarial Networks (GANs) have received significant attention from the research community. With a straightforward implementation and outstanding results, GANs have been used for numerous applications. Despite…

Machine Learning · Computer Science 2019-08-01 P Manisha , Sujit Gujar

We propose a novel method for imputing missing data by adapting the well-known Generative Adversarial Nets (GAN) framework. Accordingly, we call our method Generative Adversarial Imputation Nets (GAIN). The generator (G) observes some…

Machine Learning · Computer Science 2018-06-11 Jinsung Yoon , James Jordon , Mihaela van der Schaar

Recently, generative machine-learning models have gained popularity in physics, driven by the goal of improving the efficiency of Markov chain Monte Carlo techniques and of exploring their potential in capturing experimental data…

Statistical Mechanics · Physics 2021-09-03 Japneet Singh , Vipul Arora , Vinay Gupta , Mathias S. Scheurer

Training generative adversarial networks (GANs) with limited real image data generally results in deteriorated performance and collapsed models. To conquer this challenge, we are inspired by the latest observation, that one can discover…

Machine Learning · Computer Science 2021-10-26 Tianlong Chen , Yu Cheng , Zhe Gan , Jingjing Liu , Zhangyang Wang

Generative models excel in creating realistic images, yet their dependency on extensive datasets for training presents significant challenges, especially in domains where data collection is costly or challenging. Current data-efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuta Mimura