English
Related papers

Related papers: Provably robust deep generative models

200 papers

Adversarial examples are inevitable on the road of pervasive applications of deep neural networks (DNN). Imperceptible perturbations applied on natural samples can lead DNN-based classifiers to output wrong prediction with fair confidence…

Machine Learning · Computer Science 2020-11-04 Tao Bai , Jinqi Luo , Jun Zhao

We study the model robustness against adversarial examples, referred to as small perturbed input data that may however fool many state-of-the-art deep learning models. Unlike previous research, we establish a novel theory addressing the…

Machine Learning · Computer Science 2020-06-11 Shufei Zhang , Kaizhu Huang , Zenglin Xu

Password guessing approaches via deep learning have recently been investigated with significant breakthroughs in their ability to generate novel, realistic password candidates. In the present work we study a broad collection of deep…

Machine Learning · Computer Science 2020-12-18 David Biesner , Kostadin Cvejoski , Bogdan Georgiev , Rafet Sifa , Erik Krupicka

This paper describes a general, scalable, end-to-end framework that uses the generative adversarial network (GAN) objective to enable robust speech recognition. Encoders trained with the proposed approach enjoy improved invariance by…

Computation and Language · Computer Science 2017-11-07 Anuroop Sriram , Heewoo Jun , Yashesh Gaur , Sanjeev Satheesh

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Matching the performance of conditional Generative Adversarial Networks with little supervision is an important task, especially in venturing into new domains. We design a new training algorithm, which is robust to missing or ambiguous…

Machine Learning · Statistics 2019-06-11 Kiran Koshy Thekumparampil , Sewoong Oh , Ashish Khetan

Deep generative models have gained much attention given their ability to generate data for applications as varied as healthcare to financial technology to surveillance, and many more - the most popular models being generative adversarial…

Cryptography and Security · Computer Science 2021-12-02 Hui Sun , Tianqing Zhu , Zhiqiu Zhang , Dawei Jin. Ping Xiong , Wanlei Zhou

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In addition, AEs have adversarial transferability, which means AEs generated for a source model can fool another black-box model (target model) with…

Cryptography and Security · Computer Science 2024-01-08 Ryota Iijima , Sayaka Shiota , Hitoshi Kiya

Recent advances have shown that GP priors, or their finite realisations, can be encoded using deep generative models such as variational autoencoders (VAEs). These learned generators can serve as drop-in replacements for the original priors…

Machine Learning · Statistics 2023-11-13 Elizaveta Semenova , Prakhar Verma , Max Cairney-Leeming , Arno Solin , Samir Bhatt , Seth Flaxman

Generative adversarial networks (GANs) have given us a great tool to fit implicit generative models to data. Implicit distributions are ones we can sample from easily, and take derivatives of samples with respect to model parameters. These…

Machine Learning · Statistics 2017-02-28 Ferenc Huszár

Recent research showed that deep neural networks are highly sensitive to so-called adversarial perturbations, which are tiny perturbations of the input data purposely designed to fool a machine learning classifier. Most classification…

Machine Learning · Computer Science 2018-01-15 Akram Erraqabi , Aristide Baratin , Yoshua Bengio , Simon Lacoste-Julien

Data-driven models, especially deep learning classifiers often demonstrate great success on clean datasets. Yet, they remain vulnerable to common data distortions such as adversarial and common corruption perturbations. These perturbations…

Adversarial training has been actively studied in recent computer vision research to improve the robustness of models. However, due to the huge computational cost of generating adversarial samples, adversarial training methods are often…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yihan Wu , Xinda Li , Florian Kerschbaum , Heng Huang , Hongyang Zhang

Sparsely-gated Mixture of Expert (MoE), an emerging deep model architecture, has demonstrated a great promise to enable high-accuracy and ultra-efficient model inference. Despite the growing popularity of MoE, little work investigated its…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yihua Zhang , Ruisi Cai , Tianlong Chen , Guanhua Zhang , Huan Zhang , Pin-Yu Chen , Shiyu Chang , Zhangyang Wang , Sijia Liu

Variational Autoencoders are one of the most commonly used generative models, particularly for image data. A prominent difficulty in training VAEs is data that is supported on a lower-dimensional manifold. Recent work by Dai and Wipf (2020)…

Machine Learning · Computer Science 2022-05-19 Frederic Koehler , Viraj Mehta , Chenghui Zhou , Andrej Risteski

Recent advances in Deep Learning and probabilistic modeling have led to strong improvements in generative models for images. On the one hand, Generative Adversarial Networks (GANs) have contributed a highly effective adversarial learning…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Yang He , Bernt Schiele , Mario Fritz

One of the most interesting challenges in Artificial Intelligence is to train conditional generators which are able to provide labeled adversarial samples drawn from a specific distribution. In this work, a new framework is presented to…

Image and Video Processing · Electrical Eng. & Systems 2018-06-20 Shabab Bazrafkan , Hossein Javidnia , Peter Corcoran

The decoder-based machine learning generative algorithms such as Generative Adversarial Networks (GAN), Variational Auto-Encoders (VAE), Transformers show impressive results when constructing objects similar to those in a training ensemble.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Gabriel Turinici

When trained effectively, the Variational Autoencoder (VAE) is both a powerful language model and an effective representation learning framework. In practice, however, VAEs are trained with the evidence lower bound (ELBO) as a surrogate…

Machine Learning · Computer Science 2019-09-04 Bohan Li , Junxian He , Graham Neubig , Taylor Berg-Kirkpatrick , Yiming Yang

In this work, we explore adversarial attacks on the Variational Autoencoders (VAE). We show how to modify data point to obtain a prescribed latent code (supervised attack) or just get a drastically different code (unsupervised attack). We…

Cryptography and Security · Computer Science 2021-05-07 Anna Kuzina , Max Welling , Jakub M. Tomczak