English
Related papers

Related papers: Provably robust deep generative models

200 papers

The variational auto-encoder (VAE) is a deep latent variable model that has two neural networks in an autoencoder-like architecture; one of them parameterizes the model's likelihood. Fitting its parameters via maximum likelihood (ML) is…

Machine Learning · Computer Science 2021-06-03 Francisco J. R. Ruiz , Michalis K. Titsias , Taylan Cemgil , Arnaud Doucet

We propose a new type of attack for finding adversarial examples for image classifiers. Our method exploits spanners, i.e. deep neural networks whose input space is low-dimensional and whose output range approximates the set of images of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Ajil Jalal , Andrew Ilyas , Constantinos Daskalakis , Alexandros G. Dimakis

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

Machine Learning · Statistics 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton

Training machine learning models that are robust against adversarial inputs poses seemingly insurmountable challenges. To better understand adversarial robustness, we consider the underlying problem of learning robust representations. We…

Machine Learning · Computer Science 2020-07-07 Sicheng Zhu , Xiao Zhang , David Evans

Automatic speaker verification (ASV) systems are highly vulnerable to presentation attacks, also called spoofing attacks. Replay is among the simplest attacks to mount - yet difficult to detect reliably. The generalization failure of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-24 Bhusan Chettri , Tomi Kinnunen , Emmanouil Benetos

We propose a novel deep clustering method that integrates Variational Autoencoders (VAEs) into the Expectation-Maximization (EM) framework. Our approach models the probability distribution of each cluster with a VAE and alternates between…

Machine Learning · Computer Science 2025-01-14 Michael Adipoetra , Ségolène Martin

Although the recent progress is substantial, deep learning methods can be vulnerable to the maliciously generated adversarial examples. In this paper, we present a novel training procedure and a thresholding test strategy, towards robust…

Machine Learning · Computer Science 2018-11-08 Tianyu Pang , Chao Du , Yinpeng Dong , Jun Zhu

Variational auto-encoders (VAEs) are an influential and generally-used class of likelihood-based generative models in unsupervised learning. The likelihood-based generative models have been reported to be highly robust to the…

Machine Learning · Computer Science 2020-10-06 Xuming Ran , Mingkun Xu , Qi Xu , Huihui Zhou , Quanying Liu

Many existing deep learning models are vulnerable to adversarial examples that are imperceptible to humans. To address this issue, various methods have been proposed to design network architectures that are robust to one particular type of…

Machine Learning · Computer Science 2021-01-19 Jia Liu , Yaochu Jin

Deep neural networks have achieved substantial achievements in several computer vision areas, but have vulnerabilities that are often fooled by adversarial examples that are not recognized by humans. This is an important issue for security…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Hakmin Lee , Hong Joo Lee , Seong Tae Kim , Yong Man Ro

A new form of variational autoencoder (VAE) is developed, in which the joint distribution of data and codes is considered in two (symmetric) forms: ($i$) from observed data fed through the encoder to yield codes, and ($ii$) from latent…

Machine Learning · Computer Science 2017-11-21 Yunchen Pu , Weiyao Wang , Ricardo Henao , Liqun Chen , Zhe Gan , Chunyuan Li , Lawrence Carin

Many crucial problems in deep learning and statistical inference are caused by a variational gap, i.e., a difference between model evidence (log-likelihood) and evidence lower bound (ELBO). In particular, in a classical VAE setting that…

Machine Learning · Computer Science 2025-03-06 Łukasz Struski , Marcin Mazur , Paweł Batorski , Przemysław Spurek , Jacek Tabor

Deep Neural Networks (DNN) have been shown to be vulnerable to adversarial examples. Adversarial training (AT) is a popular and effective strategy to defend against adversarial attacks. Recent works (Benz et al., 2020; Xu et al., 2021; Tian…

Machine Learning · Computer Science 2023-02-09 Boqi Li , Weiwei Liu

Clustering is one of the fundamental problems in unsupervised learning. Recent deep learning based methods focus on learning clustering oriented representations. Among those methods, Variational Deep Embedding achieves great success in…

Machine Learning · Computer Science 2021-03-12 Ruixuan Luo , Wei Li , Zhiyuan Zhang , Ruihan Bao , Keiko Harimoto , Xu Sun

Unsupervised learning of generative models has seen tremendous progress over recent years, in particular due to generative adversarial networks (GANs), variational autoencoders, and flow-based models. GANs have dramatically improved sample…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Thomas Lucas , Konstantin Shmelkov , Karteek Alahari , Cordelia Schmid , Jakob Verbeek

Sequential recommendation as an emerging topic has attracted increasing attention due to its important practical significance. Models based on deep learning and attention mechanism have achieved good performance in sequential…

Information Retrieval · Computer Science 2021-03-22 Zhe Xie , Chengxuan Liu , Yichi Zhang , Hongtao Lu , Dong Wang , Yue Ding

Auto-encoding generative adversarial networks (GANs) combine the standard GAN algorithm, which discriminates between real and model-generated data, with a reconstruction loss given by an auto-encoder. Such models aim to prevent mode…

Machine Learning · Statistics 2017-10-24 Mihaela Rosca , Balaji Lakshminarayanan , David Warde-Farley , Shakir Mohamed

As Deep Neural Networks (DNNs) are considered the state-of-the-art in many classification tasks, the question of their semantic generalizations has been raised. To address semantic interpretability of learned features, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Shideh Rezaeifar , Olga Taran , Slava Voloshynovskiy

AI Safety is a major concern in many deep learning applications such as autonomous driving. Given a trained deep learning model, an important natural problem is how to reliably verify the model's prediction. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Tong Che , Xiaofeng Liu , Site Li , Yubin Ge , Ruixiang Zhang , Caiming Xiong , Yoshua Bengio

Today text classification models have been widely used. However, these classifiers are found to be easily fooled by adversarial examples. Fortunately, standard attacking methods generate adversarial texts in a pair-wise way, that is, an…

Computation and Language · Computer Science 2020-03-24 Yankun Ren , Jianbin Lin , Siliang Tang , Jun Zhou , Shuang Yang , Yuan Qi , Xiang Ren