English
Related papers

Related papers: Outlier Detection using AI: A Survey

200 papers

We present definitions and properties of the fast massive unsupervised outlier detection (FastMUOD) indices, used for outlier detection (OD) in functional data. FastMUOD detects outliers by computing, for each curve, an amplitude, magnitude…

Methodology · Statistics 2022-07-27 Oluwasegun Taiwo Ojo , Antonio Fernández Anta , Marc G. Genton , Rosa E. Lillo

Detecting outliers which are grossly different from or inconsistent with the remaining dataset is a major challenge in real-world KDD applications. Existing outlier detection methods are ineffective on scattered real-world datasets due to…

Machine Learning · Computer Science 2009-12-30 Ke Zhang , Marcus Hutter , Huidong Jin

This paper describes the architecture and the fundamental methodology of an anomaly detector, which by continuously monitoring Simple Network Management Protocol data and by processing it as complex-events, is able to timely recognize…

Cryptography and Security · Computer Science 2021-06-29 Massimiliano Leone Itria , Enrico Schiavone , Nicola Nostro

Outlier detection is a fundamental data science task with applications ranging from data cleaning to network security. Given the fundamental nature of the task, this has been the subject of much research. Recently, a new class of outlier…

Databases · Computer Science 2016-12-26 Jiongqian Liang , Srinivasan Parthasarathy

Ordinary least square (OLS) estimation of a linear regression model is well-known to be highly sensitive to outliers. It is common practice to (1) identify and remove outliers by looking at the data and (2) to fit OLS and form confidence…

Methodology · Statistics 2019-08-13 Shuxiao Chen , Jacob Bien

While reinforcement learning (RL) algorithms have been successfully applied across numerous sequential decision-making problems, their generalization to unforeseen testing environments remains a significant concern. In this paper, we study…

Machine Learning · Computer Science 2024-04-11 Linas Nasvytis , Kai Sandbrink , Jakob Foerster , Tim Franzmeyer , Christian Schroeder de Witt

The widespread use of information and communication technology (ICT) over the course of the last decades has been a primary catalyst behind the digitalization of power systems. Meanwhile, as the utilization rate of the Internet of Things…

Machine Learning · Computer Science 2022-12-06 Ugur Halden , Umit Cali , Ferhat Ozgur Catak , Salvatore D'Arco , Francisco Bilendo

Many machine learning classification systems lack competency awareness. Specifically, many systems lack the ability to identify when outliers (e.g., samples that are distinct from and not represented in the training data distribution) are…

Machine Learning · Computer Science 2020-07-03 Matthew Cook , Alina Zare , Paul Gader

Efficient and effective Out-of-Distribution (OOD) detection is essential for the safe deployment of AI systems. Existing feature space methods, while effective, often incur significant computational overhead due to their reliance on…

Machine Learning · Computer Science 2024-06-05 Litian Liu , Yao Qin

Despite tremendous progress in outlier detection research in recent years, the majority of existing methods are designed only to detect unconditional outliers that correspond to unusual data patterns expressed in the joint space of all data…

Machine Learning · Computer Science 2016-12-23 Charmgil Hong , Milos Hauskrecht

The curse of outlier measurements in estimation problems is a well known issue in a variety of fields. Therefore, outlier removal procedures, which enables the identification of spurious measurements within a set, have been developed for…

Information Theory · Computer Science 2017-08-02 Marco Compagnoni , Alessia Pini , Antonio Canclini , Paolo Bestagini , Fabio Antonacci , Stefano Tubaro , Augusto Sarti

The neighbor-based method has become a powerful tool to handle the outlier detection problem, which aims to infer the abnormal degree of the sample based on the compactness of the sample and its neighbors. However, the existing methods…

Machine Learning · Computer Science 2024-05-30 Zhuang Qi , Junlin Zhang , Xiaming Chen , Xin Qi

It is important to be able to detect and classify malicious network traffic flows such as DDoS attacks from benign flows. Normally the task is performed by using supervised classification algorithms. In this paper we analyze the usage of…

Cryptography and Security · Computer Science 2018-08-08 Quang-Vinh Dang

Transformers excel in natural language processing and computer vision tasks. However, they still face challenges in generalizing to Out-of-Distribution (OOD) datasets, i.e. data whose distribution differs from that seen during training. OOD…

Machine Learning · Computer Science 2026-01-30 Yijin Zhou , Yutang Ge , Wenyuan Xie , Linqian Zeng , Xiaowen Dong , Yuguang Wang

Out-of-distribution (OOD) detection is critical to ensure the safe deployment of deep learning models in critical applications. Deep learning models can often misidentify OOD samples as in-distribution (ID) samples. This vulnerability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Sudarshan Regmi

Utilizing auxiliary outlier datasets to regularize the machine learning model has demonstrated promise for out-of-distribution (OOD) detection and safe prediction. Due to the labor intensity in data collection and cleaning, automating…

Machine Learning · Computer Science 2023-09-26 Xuefeng Du , Yiyou Sun , Xiaojin Zhu , Yixuan Li

Given an unsupervised outlier detection (OD) task on a new dataset, how can we automatically select a good outlier detection method and its hyperparameter(s) (collectively called a model)? Thus far, model selection for OD has been a "black…

Machine Learning · Computer Science 2021-03-18 Yue Zhao , Ryan A. Rossi , Leman Akoglu

Outlier detection plays a significant role in various real world applications such as intrusion, malfunction, and fraud detection. Traditionally, outlier detection techniques are applied to find outliers in the context of the whole dataset.…

Databases · Computer Science 2021-03-10 Masoumeh Shafieinejad , Florian Kerschbaum , Ihab F. Ilyas

Outlier detection is the identification of points in a dataset that do not conform to the norm. Outlier detection is highly sensitive to the choice of the detection algorithm and the feature subspace used by the algorithm. Extracting…

Artificial Intelligence · Computer Science 2017-05-18 Yanjie Fu , Charu Aggarwal , Srinivasan Parthasarathy , Deepak S. Turaga , Hui Xiong

Out-of-distribution (OOD) detection plays a crucial role in ensuring the robustness and reliability of machine learning systems deployed in real-world applications. Recent approaches have explored the use of unlabeled data, showing…

Machine Learning · Computer Science 2025-10-09 Momin Abbas , Ali Falahati , Hossein Goli , Mohammad Mohammadi Amiri