English
Related papers

Related papers: Beyond the Known: Adversarial Autoencoders in Nove…

200 papers

Reliably assessing model confidence in deep learning and predicting errors likely to be made are key elements in providing safety for model deployment, in particular for applications with dire consequences. In this paper, it is first shown…

Machine Learning · Computer Science 2020-10-21 Theodoros Tsiligkaridis

High-dimensional data poses unique challenges in outlier detection process. Most of the existing algorithms fail to properly address the issues stemming from a large number of features. In particular, outlier detection algorithms perform…

Machine Learning · Computer Science 2020-09-22 Firuz Kamalov , Ho Hon Leung

We present a new methodology for detecting out-of-distribution (OOD) images by utilizing norms of the score estimates at multiple noise scales. A score is defined to be the gradient of the log density with respect to the input data. Our…

Machine Learning · Computer Science 2021-03-24 Ahsan Mahmood , Junier Oliva , Martin Styner

Outlier, or anomaly, detection is essential for optimal performance of machine learning methods and statistical predictive models. It is not just a technical step in a data cleaning process but a key topic in many fields such as fraudulent…

Machine Learning · Computer Science 2020-02-19 O. Ramos Terrades , A. Berenguel , D. Gil

Outlier detection tasks have been playing a critical role in AI safety. There has been a great challenge to deal with this task. Observations show that deep neural network classifiers usually tend to incorrectly classify out-of-distribution…

Machine Learning · Computer Science 2022-09-27 Jingyang Lin , Yu Wang , Qi Cai , Yingwei Pan , Ting Yao , Hongyang Chao , Tao Mei

Traditional anomaly detection methods focus on detecting inter-class variations while medical image novelty identification is inherently an intra-class detection problem. For example, a machine learning model trained with normal chest X-ray…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Xiaoyuan Guo , Judy Wawira Gichoya , Saptarshi Purkayastha , Imon Banerjee

While many works on Continual Learning have shown promising results for mitigating catastrophic forgetting, they have relied on supervised training. To successfully learn in a label-agnostic incremental setting, a model must distinguish…

Machine Learning · Computer Science 2021-12-09 Shivam Khare , Kun Cao , James Rehg

Advancements in synthesized speech have created a growing threat of impersonation, making it crucial to develop deepfake algorithm recognition. One significant aspect is out-of-distribution (OOD) detection, which has gained notable…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Renmingyue Du , Jixun Yao , Qiuqiang Kong , Yin Cao

Anomaly Detection (AD) is a critical task that involves identifying observations that do not conform to a learned model of normality. Prior work in deep AD is predominantly based on a familiarity hypothesis, where familiar features serve as…

Machine Learning · Computer Science 2024-02-27 Sarath Sivaprasad , Mario Fritz

Novelty detection is a task of machine learning that aims at detecting novel events without a prior knowledge. In particular, its techniques can be applied to detect unexpected signals from new phenomena at colliders. In this paper, we…

High Energy Physics - Phenomenology · Physics 2022-12-13 Xu-Hui Jiang , Aurelio Juste , Ying-Ying Li , Tao Liu

Outlier detection has received special attention in various fields, mainly for those dealing with machine learning and artificial intelligence. As strong outliers, anomalies are divided into the point, contextual and collective outliers.…

Machine Learning · Computer Science 2020-01-29 Rasoul Kiani , Amin Keshavarzi , Mahdi Bohlouli

Unsupervised anomaly detection is a challenging task. Autoencoders (AEs) or generative models are often employed to model the data distribution of normal inputs and subsequently identify anomalous, out-of-distribution inputs by high…

Machine Learning · Computer Science 2025-06-12 Yalin Liao , Austin J. Brockmeier

Deep neural networks (DNNs) are known to produce incorrect predictions with very high confidence on out-of-distribution (OOD) inputs. This limitation is one of the key challenges in the adoption of deep learning models in high-assurance…

Machine Learning · Computer Science 2021-03-24 Ramneet Kaur , Susmit Jha , Anirban Roy , Oleg Sokolsky , Insup Lee

This paper introduces a novel anomaly detection framework that combines the robust statistical principles of density-estimation-based anomaly detection methods with the representation-learning capabilities of deep learning models. The…

Machine Learning · Computer Science 2024-08-15 Joseph Gallego-Mejia , Oscar Bustos-Brinez , Fabio A. González

Anomaly detection is being regarded as an unsupervised learning task as anomalies stem from adversarial or unlikely events with unknown distributions. However, the predictive performance of purely unsupervised anomaly detection often fails…

Machine Learning · Computer Science 2014-01-27 Nico Goernitz , Marius Micha Kloft , Konrad Rieck , Ulf Brefeld

Modern neural networks are known to give overconfident prediction for out-of-distribution inputs when deployed in the open world. It is common practice to leverage a surrogate outlier dataset to regularize the model during training, and…

Machine Learning · Computer Science 2024-02-27 Wenyu Jiang , Hao Cheng , Mingcai Chen , Chongjun Wang , Hongxin Wei

Uncertainty estimation for machine learning models is of high importance in many scenarios such as constructing the confidence intervals for model predictions and detection of out-of-distribution or adversarially generated points. In this…

Machine Learning · Computer Science 2022-05-06 Kirill Fedyanin , Evgenii Tsymbalov , Maxim Panov

Deep neural networks (DNNs), especially convolutional neural networks, have achieved superior performance on image classification tasks. However, such performance is only guaranteed if the input to a trained model is similar to the training…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Liang Liang , Linhai Ma , Linchen Qian , Jiasong Chen

Although deep learning has been applied to successfully address many data mining problems, relatively limited work has been done on deep learning for anomaly detection. Existing deep anomaly detection methods, which focus on learning new…

Machine Learning · Computer Science 2019-11-21 Guansong Pang , Chunhua Shen , Anton van den Hengel

The pixelwise reconstruction error of deep autoencoders is often utilized for image novelty detection and localization under the assumption that pixels with high error indicate which parts of the input image are unfamiliar and therefore…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Patrick Feeney , Michael C. Hughes