English
Related papers

Related papers: Novelty Detection via Robust Variational Autoencod…

200 papers

We present a deep learning system for testing graphics units by detecting novel visual corruptions in videos. Unlike previous work in which manual tagging was required to collect labeled training data, our weak supervision method is fully…

Machine Learning · Computer Science 2021-08-10 Adi Szeskin , Lev Faivishevsky , Ashwin K Muppalla , Amitai Armon , Tom Hope

Robustness is a fundamental property of machine learning classifiers required to achieve safety and reliability. In the field of adversarial robustness of image classifiers, robustness is commonly defined as the stability of a model to all…

Machine Learning · Computer Science 2024-05-28 Georg Siedel , Weijia Shao , Silvia Vock , Andrey Morozov

The Variational Autoencoder (VAE) is known to suffer from the phenomenon of \textit{posterior collapse}, where the latent representations generated by the model become independent of the inputs. This leads to degenerated representations of…

Machine Learning · Computer Science 2023-09-12 Fotios Lygerakis , Elmar Rueckert

Denoising autoencoders (DAE) are trained to reconstruct their clean inputs with noise injected at the input level, while variational autoencoders (VAE) are trained with noise injected in their stochastic hidden layer, with a regularizer…

Machine Learning · Computer Science 2016-01-05 Daniel Jiwoong Im , Sungjin Ahn , Roland Memisevic , Yoshua Bengio

In this paper we present a new implementation of a Variational Autoencoder (VAE) for the calibration of sensors. We propose that the VAE can be used to calibrate sensor data by training the latent space as a calibration output. We discuss…

Machine Learning · Computer Science 2025-11-04 Travis Barrett , Amit Kumar Mishra , Joyce Mwangama

Robust low-rank approximation under row-wise adversarial corruption can be achieved with a single pass, randomized procedure that detects and removes outlier rows by thresholding their projected norms. We propose a scalable, non-iterative…

Machine Learning · Computer Science 2025-04-04 Aidan Tiruvan

Inverse problems often involve matching observational data using a physical model that takes a large number of parameters as input. These problems tend to be under-constrained and require regularization to impose additional structure on the…

Computational Physics · Physics 2019-06-07 Daniel O'Malley , John K. Golden , Velimir V. Vesselinov

The standard approach for neural topic modeling uses a variational autoencoder (VAE) framework that jointly minimizes the KL divergence between the estimated posterior and prior, in addition to the reconstruction loss. Since neural topic…

Computation and Language · Computer Science 2023-05-29 Raymond Li , Felipe González-Pizarro , Linzi Xing , Gabriel Murray , Giuseppe Carenini

Variational autoencoders (VAEs) are influential generative models with rich representation capabilities from the deep neural network architecture and Bayesian method. However, VAE models have a weakness that assign a higher likelihood to…

Machine Learning · Computer Science 2021-11-02 Xuming Ran , Mingkun Xu , Lingrui Mei , Qi Xu , Quanying Liu

Despite impressive state-of-the-art performance on a wide variety of machine learning tasks, deep learning methods can produce over-confident predictions, particularly with limited training data. Therefore, quantifying uncertainty is…

Machine Learning · Computer Science 2022-04-27 Haleh Akrami , Anand Joshi , Sergul Aydore , Richard Leahy

Variational Auto-Encoders (VAEs) have become very popular techniques to perform inference and learning in latent variable models as they allow us to leverage the rich representational power of neural networks to obtain flexible…

Machine Learning · Computer Science 2018-11-26 Anthony L. Caterini , Arnaud Doucet , Dino Sejdinovic

Probabilistic models with hierarchical-latent-variable structures provide state-of-the-art results amongst non-autoregressive, unsupervised density-based models. However, the most common approach to training such models based on Variational…

Machine Learning · Statistics 2020-10-09 Benoit Gaujac , Ilya Feige , David Barber

Due to their unsupervised training and uncertainty estimation, deep Variational Autoencoders (VAEs) have become powerful tools for reconstruction-based Time Series Anomaly Detection (TSAD). Existing VAE-based TSAD methods, either…

Machine Learning · Computer Science 2024-01-09 Zhangkai Wu , Longbing Cao , Qi Zhang , Junxian Zhou , Hui Chen

Exploiting the rapid advances in probabilistic inference, in particular variational Bayes and variational autoencoders (VAEs), for anomaly detection (AD) tasks remains an open research question. Previous works argued that training VAE…

Machine Learning · Computer Science 2020-10-13 Adrian Alan Pol , Victor Berger , Gianluca Cerminara , Cecile Germain , Maurizio Pierini

We present the development of a semi-supervised regression method using variational autoencoders (VAE), which is customized for use in soft sensing applications. We motivate the use of semi-supervised learning considering the fact that…

Machine Learning · Computer Science 2022-12-12 Yilin Zhuang , Zhuobin Zhou , Burak Alakent , Mehmet Mercangöz

Watermarking plays a key role in the provenance and detection of AI-generated content. While existing methods prioritize robustness against real-world distortions (e.g., JPEG compression and noise addition), we reveal a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Zhongjie Ba , Yitao Zhang , Peng Cheng , Bin Gong , Xinyu Zhang , Qinglong Wang , Kui Ren

In this work, we explore adversarial attacks on the Variational Autoencoders (VAE). We show how to modify data point to obtain a prescribed latent code (supervised attack) or just get a drastically different code (unsupervised attack). We…

Cryptography and Security · Computer Science 2021-05-07 Anna Kuzina , Max Welling , Jakub M. Tomczak

In this paper we offer a method and algorithm, which make possible fully autonomous (unsupervised) detection of new classes, and learning following a very parsimonious training priming (few labeled data samples only). Moreover, new unknown…

Machine Learning · Computer Science 2019-11-05 Eduardo Soares , Plamen Angelov

Although substantial efforts have been made to learn disentangled representations under the variational autoencoder (VAE) framework, the fundamental properties to the dynamics of learning of most VAE models still remain unknown and…

Machine Learning · Computer Science 2020-07-14 Yanjun Li , Shujian Yu , Jose C. Principe , Xiaolin Li , Dapeng Wu

A new form of the variational autoencoder (VAE) is proposed, based on the symmetric Kullback-Leibler divergence. It is demonstrated that learning of the resulting symmetric VAE (sVAE) has close connections to previously developed…

Machine Learning · Statistics 2017-10-23 Liqun Chen , Shuyang Dai , Yunchen Pu , Chunyuan Li , Qinliang Su , Lawrence Carin