English
Related papers

Related papers: PT-MMD: A Novel Statistical Framework for the Eval…

200 papers

Many computer vision applications involve modeling complex spatio-temporal patterns in high-dimensional motion data. Recently, restricted Boltzmann machines (RBMs) have been widely used to capture and represent spatial patterns in a single…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Siqi Nie , Ziheng Wang , Qiang Ji

We investigate the training and performance of generative adversarial networks using the Maximum Mean Discrepancy (MMD) as critic, termed MMD GANs. As our main theoretical contribution, we clarify the situation with bias in GAN loss…

Machine Learning · Statistics 2021-01-15 Mikołaj Bińkowski , Danica J. Sutherland , Michael Arbel , Arthur Gretton

Generative models are invaluable in many fields of science because of their ability to capture high-dimensional and complicated distributions, such as photo-realistic images, protein structures, and connectomes. How do we evaluate the…

In this work, we propose to study the global geometrical properties of generative models. We introduce a new Riemannian metric to assess the similarity between any two data points. Importantly, our metric is agnostic to the parametrization…

Machine Learning · Computer Science 2024-07-17 Beomsu Kim , Michael Puthawala , Jong Chul Ye , Emanuele Sansone

Generative models are typically evaluated by direct inspection of their generated samples, e.g., by visual inspection in the case of images. Further evaluation metrics like the Fr\'echet inception distance or maximum mean discrepancy are…

Information Theory · Computer Science 2024-08-02 Michael Baur , Nurettin Turan , Simon Wallner , Wolfgang Utschick

Probabilistic generative models can be used for compression, denoising, inpainting, texture synthesis, semi-supervised learning, unsupervised feature learning, and other tasks. Given this wide range of applications, it is not surprising…

Machine Learning · Statistics 2016-04-26 Lucas Theis , Aäron van den Oord , Matthias Bethge

Probabilistic graphical models (PGMs) are widely used to discover latent structure in data, but their success hinges on selecting an appropriate model design. In practice, model specification is difficult and often requires iterative…

Machine Learning · Computer Science 2026-04-08 Kevin Zhang , Yixin Wang

The ability to automatically estimate the quality and coverage of the samples produced by a generative model is a vital requirement for driving algorithm research. We present an evaluation metric that can separately and reliably measure…

Machine Learning · Statistics 2019-10-31 Tuomas Kynkäänniemi , Tero Karras , Samuli Laine , Jaakko Lehtinen , Timo Aila

Training even moderately-sized generative models with differentially-private stochastic gradient descent (DP-SGD) is difficult: the required level of noise for reasonable levels of privacy is simply too large. We advocate instead building…

Machine Learning · Statistics 2023-07-21 Fredrik Harder , Milad Jalali Asadabadi , Danica J. Sutherland , Mijung Park

Generative adversarial nets (GANs) are widely used to learn the data sampling process and their performance may heavily depend on the loss functions, given a limited computational budget. This study revisits MMD-GAN that uses the maximum…

Machine Learning · Computer Science 2019-02-11 Wei Wang , Yuan Sun , Saman Halgamuge

A wide range of models have been proposed for Graph Generative Models, necessitating effective methods to evaluate their quality. So far, most techniques use either traditional metrics based on subgraph counting, or the representations of…

Machine Learning · Statistics 2022-06-14 Hamed Shirzad , Kaveh Hassani , Danica J. Sutherland

Maximum mean discrepancy (MMD) has been successfully applied to learn deep generative models for characterizing a joint distribution of variables via kernel mean embedding. In this paper, we present conditional generative moment- matching…

Machine Learning · Computer Science 2016-06-15 Yong Ren , Jialian Li , Yucen Luo , Jun Zhu

Probabilistic generative models provide a powerful framework for representing data that avoids the expense of manual annotation typically needed by discriminative approaches. Model selection in this generative setting can be challenging,…

Generative models are known to be difficult to assess. Recent works, especially on generative adversarial networks (GANs), produce good visual samples of varied categories of images. However, the validation of their quality is still…

Machine Learning · Computer Science 2019-09-25 Timothée Lesort , Andrei Stoain , Jean-François Goudou , David Filliat

Deep generative models have shown great promise when it comes to synthesising novel images. While they can generate images that look convincing on a higher-level, generating fine-grained details is still a challenge. In order to foster…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Andrin Jenal , Nikolay Savinov , Torsten Sattler , Gaurav Chaurasia

Deep generative models (DGMs) are effective on learning multilayered representations of complex data and performing inference of input data by exploring the generative ability. However, little work has been done on examining or empowering…

Machine Learning · Computer Science 2015-12-16 Chongxuan Li , Jun Zhu , Tianlin Shi , Bo Zhang

Recent advances in generative modeling have led to an increased interest in the study of statistical divergences as means of model comparison. Commonly used evaluation methods, such as the Frechet Inception Distance (FID), correlate well…

Machine Learning · Statistics 2018-10-30 Mehdi S. M. Sajjadi , Olivier Bachem , Mario Lucic , Olivier Bousquet , Sylvain Gelly

We present a novel metric for generative modeling evaluation, focusing primarily on generative networks. The method uses dendrograms to represent real and fake data, allowing for the divergence between training and generated samples to be…

Machine Learning · Computer Science 2023-11-29 Gustavo Sutter Carvalho , Moacir Antonelli Ponti

Restricted Boltzmann Machines are generative models that consist of a layer of hidden variables connected to another layer of visible units, and they are used to model the distribution over visible variables. In order to gain a higher…

Computer Vision and Pattern Recognition · Computer Science 2023-06-20 Arkaitz Bidaurrazaga , Aritz Pérez , Roberto Santana

The reconstruction of 3D microstructures from 2D slices is considered to hold significant value in predicting the spatial structure and physical properties of materials.The dimensional extension from 2D to 3D is viewed as a highly…

Machine Learning · Computer Science 2024-02-27 Yilin Zheng , Zhigong Song