English
Related papers

Related papers: Autoencoding Under Normalization Constraints

200 papers

Discriminatively trained neural classifiers can be trusted, only when the input data comes from the training distribution (in-distribution). Therefore, detecting out-of-distribution (OOD) samples is very important to avoid classification…

Machine Learning · Computer Science 2019-04-30 Sachin Vernekar , Ashish Gaurav , Taylor Denouden , Buu Phan , Vahdat Abdelzad , Rick Salay , Krzysztof Czarnecki

Likelihood-based generative models are a promising resource to detect out-of-distribution (OOD) inputs which could compromise the robustness or reliability of a machine learning system. However, likelihoods derived from such models have…

Machine Learning · Computer Science 2020-01-20 Joan Serrà , David Álvarez , Vicenç Gómez , Olga Slizovskaia , José F. Núñez , Jordi Luque

Out-of-distribution (OOD) detection is important for machine learning models deployed in the wild. Recent methods use auxiliary outlier data to regularize the model for improved OOD detection. However, these approaches make a strong…

Machine Learning · Computer Science 2022-06-30 Julian Katz-Samuels , Julia Nakhleh , Robert Nowak , Yixuan Li

Neural networks (NNs) are widely used for object classification in autonomous driving. However, NNs can fail on input data not well represented by the training dataset, known as out-of-distribution (OOD) data. A mechanism to detect OOD…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Julia Nitsch , Masha Itkina , Ransalu Senanayake , Juan Nieto , Max Schmidt , Roland Siegwart , Mykel J. Kochenderfer , Cesar Cadena

Advancements in synthesized speech have created a growing threat of impersonation, making it crucial to develop deepfake algorithm recognition. One significant aspect is out-of-distribution (OOD) detection, which has gained notable…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Renmingyue Du , Jixun Yao , Qiuqiang Kong , Yin Cao

Building a scalable machine learning system for unsupervised anomaly detection via representation learning is highly desirable. One of the prevalent methods is using a reconstruction error from variational autoencoder (VAE) via maximizing…

Machine Learning · Computer Science 2020-05-08 Seonho Park , George Adosoglou , Panos M. Pardalos

Anomaly detection involves identifying instances within a dataset that deviate from the norm and occur infrequently. Current benchmarks tend to favor methods biased towards low diversity in normal data, which does not align with real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Mohammad Akhavan Anvari , Rojina Kashefi , Vahid Reza Khazaie , Mohammad Khalooei , Mohammad Sabokrou

In recent years, there have been significant improvements in various forms of image outlier detection. However, outlier detection performance under adversarial settings lags far behind that in standard settings. This is due to the lack of…

Out-of-distribution (OOD) detection is critical for preventing deep learning models from making incorrect predictions to ensure the safety of artificial intelligence systems. Especially in safety-critical applications such as medical…

Machine Learning · Computer Science 2023-02-16 Mouxiao Huang , Yu Qiao

By design, discriminatively trained neural network classifiers produce reliable predictions only for in-distribution samples. For their real-world deployments, detecting out-of-distribution (OOD) samples is essential. Assuming OOD to be…

Machine Learning · Computer Science 2019-10-11 Sachin Vernekar , Ashish Gaurav , Vahdat Abdelzad , Taylor Denouden , Rick Salay , Krzysztof Czarnecki

When neural networks are employed for high-stakes decision-making, it is desirable that they provide explanations for their prediction in order for us to understand the features that have contributed to the decision. At the same time, it is…

Machine Learning · Computer Science 2022-05-10 Penny Chong , Ngai-Man Cheung , Yuval Elovici , Alexander Binder

In this paper, a robust classification-autoencoder (CAE) is proposed, which has strong ability to recognize outliers and defend adversaries. The main idea is to change the autoencoder from an unsupervised learning model into a classifier,…

Machine Learning · Computer Science 2022-06-08 Lijia Yu , Xiao-Shan Gao

Autoencoder (AE) is a neural network (NN) architecture that is trained to reconstruct an input at its output. By measuring the reconstruction errors of new input samples, AE can detect anomalous samples deviated from the trained data…

Machine Learning · Computer Science 2023-02-16 Jinho Choi , Jihong Park , Abhinav Japesh , Adarsh

Outlier detection is an important data mining task with numerous practical applications such as intrusion detection, credit card fraud detection, and video surveillance. However, given a specific complicated task with big data, the process…

Machine Learning · Computer Science 2020-06-23 Yuening Li , Zhengzhang Chen , Daochen Zha , Kaixiong Zhou , Haifeng Jin , Haifeng Chen , Xia Hu

Reconstruction error-based neural architectures constitute a classical deep learning approach to anomaly detection which has shown great performances. It consists in training an Autoencoder to reconstruct a set of examples deemed to…

Machine Learning · Computer Science 2024-06-06 Fabrizio Angiulli , Fabio Fassetti , Luca Ferragina

Deep neural networks suffer from the overconfidence issue in the open world, meaning that classifiers could yield confident, incorrect predictions for out-of-distribution (OOD) samples. Thus, it is an urgent and challenging task to detect…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Qiuyu Zhu , Guohui Zheng , Yingying Yan

Principal Component Analysis (PCA) minimizes the reconstruction error given a class of linear models of fixed component dimensionality. Probabilistic PCA adds a probabilistic structure by learning the probability distribution of the PCA…

Machine Learning · Computer Science 2022-09-20 Vanessa Böhm , Uroš Seljak

Universal anomaly detection still remains a challenging problem in machine learning and medical image analysis. It is possible to learn an expected distribution from a single class of normative samples, e.g., through epistemic uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Johanna P. Müller , Matthew Baugh , Jeremy Tan , Mischa Dombrowski , Bernhard Kainz

Due to the rare occurrence of anomalous events, a typical approach to anomaly detection is to train an autoencoder (AE) with normal data only so that it learns the patterns or representations of the normal training data. At test time, the…

Machine Learning · Computer Science 2024-05-20 Marcella Astrid , Muhammad Zaigham Zaheer , Djamila Aouada , Seung-Ik Lee

Discriminative neural networks offer little or no performance guarantees when deployed on data not generated by the same process as the training distribution. On such out-of-distribution (OOD) inputs, the prediction may not only be…