English
Related papers

Related papers: On the Robustness of Quality Measures for GANs

200 papers

Recent research on robustness has revealed significant performance gaps between neural image classifiers trained on datasets that are similar to the test set, and those that are from a naturally shifted distribution, such as sketches,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Hritik Bansal , Aditya Grover

Generative models have made immense progress in recent years, particularly in their ability to generate high quality images. However, that quality has been difficult to evaluate rigorously, with evaluation dominated by heuristic approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Y. Alex Kolchinski , Sharon Zhou , Shengjia Zhao , Mitchell Gordon , Stefano Ermon

Generative Adversarial Networks (GANs) have shown remarkable results in modeling complex distributions, but their evaluation remains an unsettled issue. Evaluations are essential for: (i) relative assessment of different models and (ii)…

Synthesising photo-realistic images from natural language is one of the challenging problems in computer vision. Over the past decade, a number of approaches have been proposed, of which the improved Stacked Generative Adversarial Network…

Software Engineering · Computer Science 2021-10-05 Hyejin Park , Taaha Waseem , Wen Qi Teo , Ying Hwei Low , Mei Kuan Lim , Chun Yong Chong

GAN-generated image detection now becomes the first line of defense against the malicious uses of machine-synthesized image manipulations such as deepfakes. Although some existing detectors work well in detecting clean, known GAN samples,…

Cryptography and Security · Computer Science 2024-01-08 Chi Liu , Tianqing Zhu , Sheng Shen , Wanlei Zhou

Generative Adversarial Networks (GANs) produce high-quality images but are challenging to train. They need careful regularization, vast amounts of compute, and expensive hyper-parameter sweeps. We make significant headway on these issues by…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Axel Sauer , Kashyap Chitta , Jens Müller , Andreas Geiger

The rapid advancement of generative image technology has introduced significant security concerns, particularly in the domain of face generation detection. This paper investigates the vulnerabilities of current AI-generated face detection…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Sun Haoxuan , Hong Yan , Zhan Jiahui , Chen Haoxing , Lan Jun , Zhu Huijia , Wang Weiqiang , Zhang Liqing , Zhang Jianfu

Generative Adversarial Networks (GANs) have made great progress in synthesizing realistic images in recent years. However, they are often trained on image datasets with either too few samples or too many classes belonging to different data…

Machine Learning · Computer Science 2020-10-16 Shichang Tang

We propose a robust and reliable evaluation metric for generative models by introducing topological and statistical treatments for rigorous support estimation. Existing metrics, such as Inception Score (IS), Frechet Inception Distance…

Machine Learning · Computer Science 2024-01-25 Pum Jun Kim , Yoojin Jang , Jisu Kim , Jaejun Yoo

In this work we demonstrate that generative adversarial networks (GANs) can be used to generate realistic pervasive changes in remote sensing imagery, even in an unpaired training setting. We investigate some transformation quality metrics…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Christopher X. Ren , Amanda Ziemann , James Theiler , Alice M. S. Durieux

Many recent developments on generative models for natural images have relied on heuristically-motivated metrics that can be easily gamed by memorizing a small sample from the true distribution or training a model directly to improve the…

Machine Learning · Computer Science 2021-06-08 Ching-Yuan Bai , Hsuan-Tien Lin , Colin Raffel , Wendy Chih-wen Kan

Fr\'echet Inception Distance (FID) is a widely used metric for assessing synthetic image quality. It relies on an ImageNet-based feature extractor, making its applicability to medical imaging unclear. A recent trend is to adapt FID to…

Recent advances in text-to-image generators have led to substantial capabilities in image generation. However, the complexity of prompts acts as a bottleneck in the quality of images generated. A particular under-explored facet is the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Tham Yik Foong , Shashank Kotyan , Po Yuan Mao , Danilo Vasconcellos Vargas

Evaluating generative adversarial networks (GANs) is inherently challenging. In this paper, we revisit several representative sample-based evaluation metrics for GANs, and address the problem of how to evaluate the evaluation metrics. We…

Machine Learning · Computer Science 2018-08-20 Qiantong Xu , Gao Huang , Yang Yuan , Chuan Guo , Yu Sun , Felix Wu , Kilian Weinberger

Despite the tremendous success of diffusion generative models in text-to-image generation, replicating this success in the domain of image compression has proven difficult. In this paper, we demonstrate that diffusion can significantly…

Image and Video Processing · Electrical Eng. & Systems 2024-03-11 Emiel Hoogeboom , Eirikur Agustsson , Fabian Mentzer , Luca Versari , George Toderici , Lucas Theis

Despite achieving impressive performance, state-of-the-art classifiers remain highly vulnerable to small, imperceptible, adversarial perturbations. This vulnerability has proven empirically to be very intricate to address. In this paper, we…

Machine Learning · Computer Science 2018-12-03 Alhussein Fawzi , Hamza Fawzi , Omar Fawzi

The growing popularity of generative music models underlines the need for perceptually relevant, objective music quality metrics. The Frechet Audio Distance (FAD) is commonly used for this purpose even though its correlation with perceptual…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-07 Azalea Gui , Hannes Gamper , Sebastian Braun , Dimitra Emmanouilidou

Multi-domain image-to-image translation with conditional Generative Adversarial Networks (GANs) can generate highly photo realistic images with desired target classes, yet these synthetic images have not always been helpful to improve…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Suman Sapkota , Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Tae-Kyun Kim

Diffusion models have achieved remarkable progress in class-to-image generation. However, we observe that despite impressive FID scores, state-of-the-art models often generate distorted or low-quality images, especially in certain classes.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Jie Shao , Ke Zhu , Minghao Fu , Guo-hua Wang , Jianxin Wu

We show that diffusion models can achieve image sample quality superior to the current state-of-the-art generative models. We achieve this on unconditional image synthesis by finding a better architecture through a series of ablations. For…

Machine Learning · Computer Science 2021-06-02 Prafulla Dhariwal , Alex Nichol