English
Related papers

Related papers: Exploring the Connection between Robust and Genera…

200 papers

Unsupervised learning of generative models has seen tremendous progress over recent years, in particular due to generative adversarial networks (GANs), variational autoencoders, and flow-based models. GANs have dramatically improved sample…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Thomas Lucas , Konstantin Shmelkov , Karteek Alahari , Cordelia Schmid , Jakob Verbeek

Matching the performance of conditional Generative Adversarial Networks with little supervision is an important task, especially in venturing into new domains. We design a new training algorithm, which is robust to missing or ambiguous…

Machine Learning · Statistics 2019-06-11 Kiran Koshy Thekumparampil , Sewoong Oh , Ashish Khetan

Multi-attribute classification generalizes classification, presenting new challenges for making accurate predictions and quantifying uncertainty. We build upon recent work and show that architectures for multi-attribute prediction can be…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Jacob Kelly , Richard Zemel , Will Grathwohl

Quantum mechanics is inherently probabilistic in light of Born's rule. Using quantum circuits as probabilistic generative models for classical data exploits their superior expressibility and efficient direct sampling ability. However,…

Quantum Physics · Physics 2019-05-15 Jinfeng Zeng , Yufeng Wu , Jin-Guo Liu , Lei Wang , Jiangping Hu

Ideally, what confuses neural network should be confusing to humans. However, recent experiments have shown that small, imperceptible perturbations can change the network prediction. To address this gap in perception, we propose a novel…

Machine Learning · Computer Science 2018-10-31 Alexander Matyasko , Lap-Pui Chau

Multimodal generative models have recently gained significant attention for their ability to learn representations across various modalities, enhancing joint and cross-generation coherence. However, most existing works use standard Gaussian…

Machine Learning · Computer Science 2024-10-01 Shiyu Yuan , Jiali Cui , Hanao Li , Tian Han

Generative adversarial networks (GANs) are powerful generative models, but usually suffer from instability and generalization problem which may lead to poor generations. Most existing works focus on stabilizing the training of the…

Machine Learning · Computer Science 2020-04-29 Shufei Zhang , Zhuang Qian , Kaizhu Huang , Jimin Xiao , Yuan He

Machine learning models are vulnerable to adversarial examples formed by applying small carefully chosen perturbations to inputs that cause unexpected classification errors. In this paper, we perform experiments on various adversarial…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Andras Rozsa , Manuel Günther , Terrance E. Boult

We introduce the Generalized Energy Based Model (GEBM) for generative modelling. These models combine two trained components: a base distribution (generally an implicit model), which can learn the support of data with low intrinsic…

Machine Learning · Statistics 2021-12-22 Michael Arbel , Liang Zhou , Arthur Gretton

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

Machine Learning · Statistics 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

Generative neural networks can produce data samples according to the statistical properties of their training distribution. This feature can be used to test modern computational neuroscience hypotheses suggesting that spontaneous brain…

Neural and Evolutionary Computing · Computer Science 2025-07-29 Lorenzo Tausani , Alberto Testolin , Marco Zorzi

Deep energy-based models (EBMs) are very flexible in distribution parametrization but computationally challenging because of the intractable partition function. They are typically trained via maximum likelihood, using contrastive divergence…

Machine Learning · Computer Science 2020-07-22 Lantao Yu , Yang Song , Jiaming Song , Stefano Ermon

Energy-based models (EBMs) are powerful probabilistic models, but suffer from intractable sampling and density evaluation due to the partition function. As a result, inference in EBMs relies on approximate sampling algorithms, leading to a…

Machine Learning · Computer Science 2020-01-10 Dieterich Lawson , George Tucker , Bo Dai , Rajesh Ranganath

While deep learning has led to remarkable results on a number of challenging problems, researchers have discovered a vulnerability of neural networks in adversarial settings, where small but carefully chosen perturbations to the input can…

Neural and Evolutionary Computing · Computer Science 2018-11-26 Edward Grefenstette , Robert Stanforth , Brendan O'Donoghue , Jonathan Uesato , Grzegorz Swirszcz , Pushmeet Kohli

The vulnerabilities of deep neural networks against adversarial examples have become a significant concern for deploying these models in sensitive domains. Devising a definitive defense against such attacks is proven to be challenging, and…

Machine Learning · Computer Science 2022-10-04 Xuwang Yin , Soheil Kolouri , Gustavo K. Rohde

Undirected graphical models are compact representations of joint probability distributions over random variables. To solve inference tasks of interest, graphical models of arbitrary topology can be trained using empirical risk minimization.…

Machine Learning · Computer Science 2020-10-23 Adarsh K. Jeewajee , Leslie P. Kaelbling

Energy-based models (EBMs) have experienced a resurgence within machine learning in recent years, including as a promising alternative for probabilistic regression. However, energy-based regression requires a proposal distribution to be…

Machine Learning · Computer Science 2023-11-08 Fredrik K. Gustafsson , Martin Danelljan , Thomas B. Schön

We propose a novel technique to make neural network robust to adversarial examples using a generative adversarial network. We alternately train both classifier and generator networks. The generator network generates an adversarial…

Machine Learning · Computer Science 2023-07-06 Hyeungill Lee , Sungyeob Han , Jungwoo Lee

Machine Learning has been applied in a wide range of tasks throughout the last years, ranging from image classification to autonomous driving and natural language processing. Restricted Boltzmann Machine (RBM) has received recent attention…

Machine Learning · Computer Science 2021-01-05 Gustavo H. de Rosa , Mateus Roder , João P. Papa

Deep generative models are rapidly becoming a common tool for researchers and developers. However, as exhaustively shown for the family of discriminative models, the test-time inference of deep neural networks cannot be fully controlled and…

Machine Learning · Computer Science 2019-05-15 Dario Pasquini , Marco Mingione , Massimo Bernaschi