中文
相关论文

相关论文: Learning to Drop Out: An Adversarial Approach to T…

200 篇论文

Data-driven fault diagnostics of safety-critical systems often faces the challenge of a complete lack of labeled data associated with faulty system conditions (i.e., fault types) at training time. Since an unknown number and nature of fault…

机器学习 · 计算机科学 2020-10-01 Manuel Arias Chao , Bryan T. Adey , Olga Fink

Training an ensemble of diverse sub-models has been empirically demonstrated as an effective strategy for improving the adversarial robustness of deep neural networks. However, current ensemble training methods for image recognition…

机器学习 · 计算机科学 2023-05-24 Lele Wang , Bin Liu

AI models have garnered significant research attention towards predictive task automation. However, a stationary training environment is an underlying assumption for most models and such models simply do not work on non-stationary data…

机器学习 · 计算机科学 2025-04-29 Hassan Wasswa , Aziida Nanyonga , Timothy Lynar

We propose a new method for unsupervised generative continual learning through realignment of Variational Autoencoder's latent space. Deep generative models suffer from catastrophic forgetting in the same way as other neural structures.…

机器学习 · 计算机科学 2022-06-06 Kamil Deja , Paweł Wawrzyński , Wojciech Masarczyk , Daniel Marczak , Tomasz Trzciński

We introduce an approach for training Variational Autoencoders (VAEs) that are certifiably robust to adversarial attack. Specifically, we first derive actionable bounds on the minimal size of an input perturbation required to change a VAE's…

机器学习 · 统计学 2022-04-26 Ben Barrett , Alexander Camuto , Matthew Willetts , Tom Rainforth

Variational autoencoders (VAEs), as an important aspect of generative models, have received a lot of research interests and reached many successful applications. However, it is always a challenge to achieve the consistency between the…

机器学习 · 计算机科学 2022-05-10 Xiaoyu Chen , Chen Gong , Qiang He , Xinwen Hou , Yu Liu

Recently, the training with adversarial examples, which are generated by adding a small but worst-case perturbation on input examples, has been proved to improve generalization performance of neural networks. In contrast to the individually…

机器学习 · 计算机科学 2017-09-19 Sungrae Park , Jun-Keon Park , Su-Jin Shin , Il-Chul Moon

Variational Autoencoders (VAEs) have experienced recent success as data-generating models by using simple architectures that do not require significant fine-tuning of hyperparameters. However, VAEs are known to suffer from…

机器学习 · 统计学 2020-07-22 Wei Cheng , Gregory Darnell , Sohini Ramachandran , Lorin Crawford

Selective manipulation of data attributes using deep generative models is an active area of research. In this paper, we present a novel method to structure the latent space of a Variational Auto-Encoder (VAE) to encode different…

机器学习 · 计算机科学 2020-07-30 Ashis Pati , Alexander Lerch

Learning from heterogeneous data poses challenges such as combining data from various sources and of different types. Meanwhile, heterogeneous data are often associated with missingness in real-world applications due to heterogeneity and…

机器学习 · 计算机科学 2021-02-26 Yu Gong , Hossein Hajimirsadeghi , Jiawei He , Thibaut Durand , Greg Mori

Variational Autoencoder (VAE), a simple and effective deep generative model, has led to a number of impressive empirical successes and spawned many advanced variants and theoretical investigations. However, recent studies demonstrate that,…

机器学习 · 计算机科学 2019-01-08 Xuezhe Ma , Chunting Zhou , Eduard Hovy

Variational autoencoders (VAEs) are one of the deep generative models that have experienced enormous success over the past decades. However, in practice, they suffer from a problem called posterior collapse, which occurs when the encoder…

机器学习 · 计算机科学 2024-02-06 Yuri Kinoshita , Kenta Oono , Kenji Fukumizu , Yuichi Yoshida , Shin-ichi Maeda

It has been previously observed that training Variational Recurrent Autoencoders (VRAE) for text generation suffers from serious uninformative latent variables problem. The model would collapse into a plain language model that totally…

计算与语言 · 计算机科学 2019-11-20 Dayiheng Liu , Xu Yang , Feng He , Yuanyuan Chen , Jiancheng Lv

Being one of the most popular generative framework, variational autoencoders(VAE) are known to suffer from a phenomenon termed posterior collapse, i.e. the latent variational distributions collapse to the prior, especially when a strong…

机器学习 · 计算机科学 2021-03-23 Renfei Tu , Yang Liu , Yongzeng Xue , Cheng Wang , Maozu Guo

Syntactic information contains structures and rules about how text sentences are arranged. Incorporating syntax into text modeling methods can potentially benefit both representation learning and generation. Variational autoencoders (VAEs)…

计算与语言 · 计算机科学 2019-08-28 Yijun Xiao , William Yang Wang

Adversarial training has been proven to be a powerful regularization method to improve the generalization of models. However, current adversarial training methods only attack the original input sample or the embedding vectors, and their…

机器学习 · 计算机科学 2021-08-31 Shiwen Ni , Jiawen Li , Hung-Yu Kao

Recent successes in image generation, model-based reinforcement learning, and text-to-image generation have demonstrated the empirical advantages of discrete latent representations, although the reasons behind their benefits remain unclear.…

机器学习 · 计算机科学 2023-07-27 David Friede , Christian Reimers , Heiner Stuckenschmidt , Mathias Niepert

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

机器学习 · 统计学 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton

Variational autoencoders (VAEs) are a popular class of deep generative models with many variants and a wide range of applications. Improvements upon the standard VAE mostly focus on the modelling of the posterior distribution over the…

机器学习 · 计算机科学 2022-11-02 James Langley , Miguel Monteiro , Charles Jones , Nick Pawlowski , Ben Glocker

Autoencoders (AE) have recently been widely employed to approach the novelty detection problem. Trained only on the normal data, the AE is expected to reconstruct the normal data effectively while fail to regenerate the anomalous data,…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Mohammadreza Salehi , Atrin Arya , Barbod Pajoum , Mohammad Otoofi , Amirreza Shaeiri , Mohammad Hossein Rohban , Hamid R. Rabiee