English
Related papers

Related papers: Training generative neural networks via Maximum Me…

200 papers

While likelihood-based inference and its variants provide a statistically efficient and widely applicable approach to parametric inference, their application to models involving intractable likelihoods poses challenges. In this work, we…

Methodology · Statistics 2019-06-17 Francois-Xavier Briol , Alessandro Barp , Andrew B. Duncan , Mark Girolami

In recent years, machine learning has achieved impressive results across different application areas. However, machine learning algorithms do not necessarily perform well on a new domain with a different distribution than its training set.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Ye Gao , Zhendong Chu , Hongning Wang , John Stankovic

Several machine learning models, including neural networks, consistently misclassify adversarial examples---inputs formed by applying small but intentionally worst-case perturbations to examples from the dataset, such that the perturbed…

Machine Learning · Statistics 2015-03-24 Ian J. Goodfellow , Jonathon Shlens , Christian Szegedy

Generative adversarial networks (GANs) provide an algorithmic framework for constructing generative models with several appealing properties: they do not require a likelihood function to be specified, only a generating procedure; they…

Machine Learning · Statistics 2017-02-28 Shakir Mohamed , Balaji Lakshminarayanan

We present a novel neural network Maximum Mean Discrepancy (MMD) statistic by identifying a new connection between neural tangent kernel (NTK) and MMD. This connection enables us to develop a computationally efficient and memory-efficient…

Machine Learning · Statistics 2021-10-19 Xiuyuan Cheng , Yao Xie

Modern deep artificial neural networks have achieved great success in the domain of computer vision and beyond. However, their application to many real-world tasks is undermined by certain limitations, such as overconfident uncertainty…

Machine Learning · Computer Science 2022-05-05 Adrián Csiszárik , Beatrix Benkő , Dániel Varga

An adaptive bandwidth selection procedure for the mixture kernel in the maximum mean discrepancy (MMD) for fitting generative moment matching networks (GMMNs) is introduced, and its ability to improve the learning of copula random number…

Machine Learning · Statistics 2025-09-01 Marius Hofert , Gan Yao

The maximum mean discrepancy (MMD) test could in principle detect any distributional discrepancy between two datasets. However, it has been shown that the MMD test is unaware of adversarial attacks -- the MMD test failed to detect the…

Machine Learning · Computer Science 2021-07-13 Ruize Gao , Feng Liu , Jingfeng Zhang , Bo Han , Tongliang Liu , Gang Niu , Masashi Sugiyama

This paper studies how well generative adversarial networks (GANs) learn probability distributions from finite samples. Our main results establish the convergence rates of GANs under a collection of integral probability metrics defined…

Machine Learning · Computer Science 2022-06-10 Jian Huang , Yuling Jiao , Zhen Li , Shiao Liu , Yang Wang , Yunfei Yang

We explore a data-driven approach for learning to optimize neural networks. We construct a dataset of neural network checkpoints and train a generative model on the parameters. In particular, our model is a conditional diffusion transformer…

Machine Learning · Computer Science 2022-09-27 William Peebles , Ilija Radosavovic , Tim Brooks , Alexei A. Efros , Jitendra Malik

Generative adversarial network (GAN) has gotten wide re-search interest in the field of deep learning. Variations of GAN have achieved competitive results on specific tasks. However, the stability of training and diversity of generated…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Haoxuan You , Zhicheng Jiao , Haojun Xu , Jie Li , Ying Wang , Xinbo Gao

We introduce a novel machine unlearning framework founded upon the established principles of the min-max optimization paradigm. We capitalize on the capabilities of strong Membership Inference Attacks (MIA) to facilitate the unlearning of…

Machine Learning · Computer Science 2024-02-14 Rohan Sharma , Shijie Zhou , Kaiyi Ji , Changyou Chen

Generative Adversarial Networks (Goodfellow et al., 2014), a major breakthrough in the field of generative modeling, learn a discriminator to estimate some distance between the target and the candidate distributions. This paper examines…

Machine Learning · Statistics 2018-07-27 Victor Berger , Michèle Sebag

Generative adversarial networks (GANs) are emerging machine learning models for generating synthesized data similar to real data by jointly training a generator and a discriminator. In many applications, data and computational resources are…

Machine Learning · Computer Science 2021-07-20 Jinke Ren , Chonghe Liu , Guanding Yu , Dongning Guo

Generative adversarial networks (GANs) are a learning framework that rely on training a discriminator to estimate a measure of difference between a target and generated distributions. GANs, as normally formulated, rely on the generated…

Machine Learning · Statistics 2018-02-23 R Devon Hjelm , Athul Paul Jacob , Tong Che , Adam Trischler , Kyunghyun Cho , Yoshua Bengio

We propose a gradient flow procedure for generative modeling by transporting particles from an initial source distribution to a target distribution, where the gradient field on the particles is given by a noise-adaptive Wasserstein Gradient…

Machine Learning · Computer Science 2024-05-14 Alexandre Galashov , Valentin de Bortoli , Arthur Gretton

In recent years, generative adversarial networks (GANs) have demonstrated impressive experimental results while there are only a few works that foster statistical learning theory for GANs. In this work, we propose an infinite dimensional…

Machine Learning · Computer Science 2023-01-20 Hayk Asatryan , Hanno Gottschalk , Marieke Lippert , Matthias Rottmann

Despite remarkable performance in producing realistic samples, Generative Adversarial Networks (GANs) often produce low-quality samples near low-density regions of the data manifold, e.g., samples of minor groups. Many techniques have been…

Machine Learning · Computer Science 2021-10-28 Jinhee Lee , Haeri Kim , Youngkyu Hong , Hye Won Chung

Reliable training of generative adversarial networks (GANs) typically require massive datasets in order to model complicated distributions. However, in several applications, training samples obey invariances that are \textit{a priori}…

In this paper, we propose a multi-generator extension to the adversarial training framework, in which the objective of each generator is to represent a unique component of a target mixture distribution. In the training phase, the generators…

Machine Learning · Computer Science 2018-02-07 Karim Said Barsim , Lirong Yang , Bin Yang