English
Related papers

Related papers: Outlier Detection through Null Space Analysis of N…

200 papers

The quality of datasets plays a crucial role in the successful training and deployment of deep learning models. Especially in the medical field, where system performance may impact the health of patients, clean datasets are a safety…

Image and Video Processing · Electrical Eng. & Systems 2022-08-19 Stefan Röhrl , Alice Hein , Lucie Huang , Dominik Heim , Christian Klenk , Manuel Lengl , Martin Knopp , Nawal Hafez , Oliver Hayden , Klaus Diepold

It is important to be able to detect and classify malicious network traffic flows such as DDoS attacks from benign flows. Normally the task is performed by using supervised classification algorithms. In this paper we analyze the usage of…

Cryptography and Security · Computer Science 2018-08-08 Quang-Vinh Dang

We propose a meta-learning algorithm utilizing a linear transformer that carries out null-space projection of neural network outputs. The main idea is to construct an alternative classification space such that the error signals during…

Machine Learning · Computer Science 2018-12-06 Sung Whan Yoon , Jun Seo , Jaekyun Moon

Unsupervised outlier detection constitutes a crucial phase within data analysis and remains a dynamic realm of research. A good outlier detection algorithm should be computationally efficient, robust to tuning parameter selection, and…

Machine Learning · Statistics 2024-09-23 Sheikh Arafat , Na Sun , Maria L. Weese , Waldyn G. Martinez

In novelty detection, the goal is to decide if a new data point should be categorized as an inlier or an outlier, given a training dataset that primarily captures the inlier distribution. Recent approaches typically use deep encoder and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Muhammad Asad , Ihsan Ullah , Ganesh Sistu , Michael G. Madden

We present different methods of unsupervised learning which can be used for outlier detection in high energy nuclear collisions. The UrQMD model is used to generate the bulk background of events as well as different variants of outlier…

High Energy Physics - Experiment · Physics 2021-05-26 Punnathat Thaprasop , Kai Zhou , Jan Steinheimer , Christoph Herold

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

Machine Learning · Computer Science 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

In this paper we introduce a new method for detecting outliers in a set of proportions. It is based on the construction of a suitable two-way contingency table and on the application of an algorithm for the detection of outlying cells in…

Methodology · Statistics 2016-08-04 Flavio Mignone , Fabio Rapallo

Due to the intractability of characterizing everything that looks unlike the normal data, anomaly detection (AD) is traditionally treated as an unsupervised problem utilizing only normal samples. However, it has recently been found that…

Computer Vision and Pattern Recognition · Computer Science 2023-01-29 Philipp Liznerski , Lukas Ruff , Robert A. Vandermeulen , Billy Joe Franks , Klaus-Robert Müller , Marius Kloft

Data certainty is one of the issues in the real-world applications which is caused by unwanted noise in data. Recently, more attentions have been paid to overcome this problem. We proposed a new method based on neutrosophic set (NS) theory…

Signal Processing · Electrical Eng. & Systems 2019-08-12 Elyas Rashno , Sanaz Saki Norouzi , Behrouz Minaei-bidgoli , Yanhui Guo

The presence of outliers can prevent clustering algorithms from accurately determining an appropriate group structure within a data set. We present outlierMBC, a model-based approach for sequentially removing outliers and clustering the…

Methodology · Statistics 2025-06-30 Ultán P. Doherty , Paul D. McNicholas , Arthur White

Outlier detection is an important task in data mining and many technologies have been explored in various applications. However, due to the default assumption that outliers are non-concentrated, unsupervised outlier detection may not…

Machine Learning · Computer Science 2020-03-10 Zhe Li , Chunhua Sun , Chunli Liu , Xiayu Chen , Meng Wang , Yezheng Liu

Deep neural networks achieve superior performance in challenging tasks such as image classification. However, deep classifiers tend to incorrectly classify out-of-distribution (OOD) inputs, which are inputs that do not belong to the…

Machine Learning · Computer Science 2019-10-24 Vahdat Abdelzad , Krzysztof Czarnecki , Rick Salay , Taylor Denounden , Sachin Vernekar , Buu Phan

Benchmarking unsupervised outlier detection is difficult. Outliers are rare, and existing benchmark data contains outliers with various and unknown characteristics. Fully synthetic data usually consists of outliers and regular instance with…

Machine Learning · Computer Science 2021-05-07 Georg Steinbuss , Klemens Böhm

Event sequence data record the occurrences of events in continuous time. Event sequence forecasting based on temporal point processes (TPPs) has been extensively studied, but outlier or anomaly detection, especially without any supervision…

Machine Learning · Computer Science 2024-11-26 Somjit Nath , Yik Chau Lui , Siqi Liu

Support Vector Machines are a widely used classification technique. They are computationally efficient and provide excellent predictions even for high-dimensional data. Moreover, Support Vector Machines are very flexible due to the…

Applications · Statistics 2010-09-30 Michiel Debruyne

This paper presents an automated approach for providing ranked lists of outliers in observed demand to support analysts in network revenue management. Such network revenue management, e.g. for railway itineraries, needs accurate demand…

Physics and Society · Physics 2023-02-27 Nicola Rennie , Catherine Cleophas , Adam M. Sykulski , Florian Dost

The inability to linearly classify XOR has motivated much of deep learning. We revisit this age-old problem and show that linear classification of XOR is indeed possible. Instead of separating data between halfspaces, we propose a slightly…

Machine Learning · Computer Science 2024-06-21 Matthew Lau , Ismaila Seck , Athanasios P Meliopoulos , Wenke Lee , Eugene Ndiaye

LiDAR-based semantic scene understanding is an important module in the modern autonomous driving perception stack. However, identifying outlier points in a LiDAR point cloud is challenging as LiDAR point clouds lack semantically-rich…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Shaocong Xu , Pengfei Li , Qianpu Sun , Xinyu Liu , Yang Li , Shihui Guo , Zhen Wang , Bo Jiang , Rui Wang , Kehua Sheng , Bo Zhang , Li Jiang , Hao Zhao , Yilun Chen

Normalization and outlier detection belong to the preprocessing of gene expression data. We propose a natural normalization procedure based on statistical data depth which normalizes to the distribution of gene expressions of the most…

Methodology · Statistics 2022-06-29 Alicia Nieto-Reyes , Javier Cabrera