English
Related papers

Related papers: Outlier Detection through Null Space Analysis of N…

200 papers

A critical barrier to learning an accurate decision rule for outlier detection is the scarcity of outlier data. As such, practitioners often turn to the use of similar but imperfect outlier data from which they might transfer information to…

Machine Learning · Computer Science 2023-10-10 Mohammadreza M. Kalan , Samory Kpotufe

We propose thresholding as an approach to deal with class imbalance. We define the concept of thresholding as a process of determining a decision boundary in the presence of a tunable parameter. The threshold is the maximum value of this…

Machine Learning · Computer Science 2016-07-12 Charmgil Hong , Rumi Ghosh , Soundar Srinivasan

Detecting which nodes in graphs are outliers is a relatively new machine learning task with numerous applications. Despite the proliferation of algorithms developed in recent years for this task, there has been no standard comprehensive…

The Dark Energy Survey is able to collect image data of an extremely large number of extragalactic objects, and it can be reasonably assumed that many unusual objects of high scientific interest are hidden inside these data. Due to the…

Astrophysics of Galaxies · Physics 2023-05-04 Lior Shamir

With the advent of future big-data surveys, automated tools for unsupervised discovery are becoming ever more necessary. In this work, we explore the ability of deep generative networks for detecting outliers in astronomical imaging…

Recent successes of artificial intelligence and deep learning often depend on the well-collected training dataset which is assumed to have an identical distribution with the test dataset. However, this assumption, which is called closed-set…

Artificial Intelligence · Computer Science 2025-01-14 Eui-Soo Jung , Hae-Hun Seo , Hyun-Woo Jung , Je-Geon Oh , Yoon-Yeong Kim

Many well-established anomaly detection methods use the distance of a sample to those in its local neighbourhood: so-called `local outlier methods', such as LOF and DBSCAN. They are popular for their simple principles and strong performance…

Machine Learning · Computer Science 2021-12-13 Adam Goodge , Bryan Hooi , See Kiong Ng , Wee Siong Ng

Anomaly detection is an important problem in many application areas, such as network security. Many deep learning methods for unsupervised anomaly detection produce good empirical performance but lack theoretical guarantees. By casting…

Machine Learning · Statistics 2024-09-16 Tian-Yi Zhou , Matthew Lau , Jizhou Chen , Wenke Lee , Xiaoming Huo

The problem of detecting whether a test sample is from in-distribution (i.e., training distribution by a classifier) or out-of-distribution sufficiently different from it arises in many real-world machine learning applications. However, the…

Machine Learning · Statistics 2018-02-27 Kimin Lee , Honglak Lee , Kibok Lee , Jinwoo Shin

Outlier detection and cluster number estimation is an important issue for clustering real data. This paper focuses on spectral clustering, a time-tested clustering method, and reveals its important properties related to outliers. The…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Takuro Ina , Atsushi Hashimoto , Masaaki Iiyama , Hidekazu Kasahara , Mikihiko Mori , Michihiko Minoh

Support Vector Machines have been successfully used for one-class classification (OCSVM, SVDD) when trained on clean data, but they work much worse on dirty data: outliers present in the training data tend to become support vectors, and are…

Machine Learning · Computer Science 2022-12-29 Daniel Boiar , Thomas Liebig , Erich Schubert

It is widely recognized that deep neural networks are sensitive to bias in the data. This means that during training these models are likely to learn spurious correlations between data and labels, resulting in limited generalization…

Machine Learning · Computer Science 2024-12-06 Vito Paolo Pastore , Massimiliano Ciranni , Davide Marinelli , Francesca Odone , Vittorio Murino

Observations in data which are significantly different from its neighbouring points but cannot be classified as noise are known as anomalies or outliers. These anomalies are a cause of concern and a timely warning about their presence could…

Applications · Statistics 2020-06-09 Krishnam Kapoor

This paper presents a new approach for detecting outliers by introducing the notion of object's proximity. The main idea is that normal point has similar characteristics with several neighbors. So the point in not an outlier if it has a…

Computer Vision and Pattern Recognition · Computer Science 2014-11-26 Amina Dik , Khalid Jebari , Abdelaziz Bouroumi , Aziz Ettouhami

Most of the existing methods for anomaly detection use only positive data to learn the data distribution, thus they usually need a pre-defined threshold at the detection stage to determine whether a test instance is an outlier.…

Machine Learning · Computer Science 2019-03-19 Kai Tian , Shuigeng Zhou , Jianping Fan , Jihong Guan

Neural networks have demonstrated unmatched performance in a range of classification tasks. Despite numerous efforts of the research community, novelty detection remains one of the significant limitations of neural networks. The ability to…

Machine Learning · Computer Science 2022-05-03 Thomas A. Henzinger , Anna Lukina , Christian Schilling

In this paper, we propose a novel approach for outlier detection, called local projections, which is based on concepts of Local Outlier Factor (LOF) (Breunig et al., 2000) and RobPCA (Hubert et al., 2005). By using aspects of both methods,…

Outlier detection is a well-researched and crucial problem in machine learning. However, there is little research on string data outlier detection, as most literature focuses on outlier detection of numerical data. A robust string data…

Machine Learning · Computer Science 2026-03-13 Philip Maus

Transformers excel in natural language processing and computer vision tasks. However, they still face challenges in generalizing to Out-of-Distribution (OOD) datasets, i.e. data whose distribution differs from that seen during training. OOD…

Machine Learning · Computer Science 2026-01-30 Yijin Zhou , Yutang Ge , Wenyuan Xie , Linqian Zeng , Xiaowen Dong , Yuguang Wang

Ordinary least square (OLS) estimation of a linear regression model is well-known to be highly sensitive to outliers. It is common practice to (1) identify and remove outliers by looking at the data and (2) to fit OLS and form confidence…

Methodology · Statistics 2019-08-13 Shuxiao Chen , Jacob Bien