English
Related papers

Related papers: A Fast Greedy Algorithm for Outlier Mining

200 papers

The outlying property detection problem is the problem of discovering the properties distinguishing a given object, known in advance to be an outlier in a database, from the other database objects. In this paper, we analyze the problem…

Machine Learning · Computer Science 2013-06-18 Fabrizio Angiulli , Fabio Fassetti , Luigi Palopoli , Giuseppe Manco

Traditional machine learning models focus on achieving good performance on the overall training distribution, but they often underperform on minority groups. Existing methods can improve the worst-group performance, but they can have…

Machine Learning · Computer Science 2022-10-14 Yuchen Zeng , Kristjan Greenewald , Kangwook Lee , Justin Solomon , Mikhail Yurochkin

Unsupervised learning methods are well established in the area of anomaly detection and achieve state of the art performances on outlier datasets. Outliers play a significant role, since they bear the potential to distort the predictions of…

Machine Learning · Computer Science 2024-07-02 Andreas Lohrer , Daniyal Kazempour , Maximilian Hünemörder , Peer Kröger

In a corpus of data, outliers are either errors: mistakes in the data that are counterproductive, or are unique: informative samples that improve model robustness. Identifying outliers can lead to better datasets by (1) removing noise in…

We propose a randomized greedy search algorithm to find a point estimate for a random partition based on a loss function and posterior Monte Carlo samples. Given the large size and awkward discrete nature of the search space, the…

Methodology · Statistics 2021-05-11 David B. Dahl , Devin J. Johnson , Peter Mueller

Outlier detection amounts to finding data points that differ significantly from the norm. Classic outlier detection methods are largely designed for single data type such as continuous or discrete. However, real world data is increasingly…

Machine Learning · Statistics 2016-08-18 Kien Do , Truyen Tran , Dinh Phung , Svetha Venkatesh

The ability to collect and store ever more massive databases has been accompanied by the need to process them efficiently. In many cases, most observations have the same behavior, while a probable small proportion of these observations are…

Statistics Theory · Mathematics 2021-09-21 Myrto Limnios , Nathan Noiry , Stéphan Clémençon

The Projection Congruent Subset (PCS) Outlyingness is a new index of multivariate outlyingness obtained by considering univariate projections of the data. Like many other outlier detection procedures, PCS searches for a subset which…

Methodology · Statistics 2013-08-01 Kaveh Vakili , Eric Schmitt

Outlier detection is an important topic in machine learning and has been used in a wide range of applications. Outliers are objects that are few in number and deviate from the majority of objects. As a result of these two properties, we…

Machine Learning · Computer Science 2022-04-22 Xusheng Du , Enguang Zuo , Zhenzhen He , Jiong Yu

Outlier detection is a fundamental task in data mining and has many applications including detecting errors in databases. While there has been extensive prior work on methods for outlier detection, modern datasets often have sizes that are…

Machine Learning · Computer Science 2019-08-01 Laure Berti-Equille , Ji Meng Loh , Saravanan Thirumuruganathan

Many traditional methods for identifying changepoints can struggle in the presence of outliers, or when the noise is heavy-tailed. Often they will infer additional changepoints in order to fit the outliers. To overcome this problem, data…

Methodology · Statistics 2017-07-12 Paul Fearnhead , Guillem Rigaill

There exist multiple methods to detect outliers in multivariate data in the literature, but most of them require to estimate the covariance matrix. The higher the dimension, the more complex the estimation of the matrix becoming impossible…

Methodology · Statistics 2020-12-01 P. Navarro-Esteban , J. A. Cuesta-Albertos

This paper studies sparse linear regression analysis with outliers in the responses. A parameter vector for modeling outliers is added to the standard linear regression model and then the sparse estimation problem for both coefficients and…

Statistics Theory · Mathematics 2015-05-21 Shota Katayama , Hironori Fujisawa

We introduce and develop a novel approach to outlier detection based on adaptation of random subspace learning. Our proposed method handles both high-dimension low-sample size and traditional low-dimensional high-sample size datasets.…

Machine Learning · Statistics 2015-05-05 Bohan Liu , Ernest Fokoue

In order to allow machine learning algorithms to extract knowledge from raw data, these data must first be cleaned, transformed, and put into machine-appropriate form. These often very time-consuming phase is referred to as preprocessing.…

Machine Learning · Computer Science 2021-11-19 David Cemernek

A new semi-supervised ensemble algorithm called XGBOD (Extreme Gradient Boosting Outlier Detection) is proposed, described and demonstrated for the enhanced detection of outliers from normal observations in various practical datasets. The…

Machine Learning · Computer Science 2020-09-22 Yue Zhao , Maciej K. Hryniewicki

In general frequent itemsets are generated from large data sets by applying association rule mining algorithms like Apriori, Partition, Pincer-Search, Incremental, Border algorithm etc., which take too much computer time to compute all the…

Databases · Computer Science 2010-11-02 Soumadip Ghosh , Sushanta Biswas , Debasree Sarkar , Partha Pratim Sarkar

Outlying observations, which significantly deviate from other measurements, may distort the conclusions of data analysis. Therefore, identifying outliers is one of the important problems that should be solved to obtain reliable results.…

Computation · Statistics 2014-05-01 Soo-Heang Eo , Seung-Mo Hong , HyungJun Cho

In statistics and machine learning, the traditional meaning of the terms `outlier' and `anomaly' is a case in the dataset that behaves differently from the bulk of the data. This raises suspicion that it may belong to a different…

Methodology · Statistics 2026-04-17 Mia Hubert , Jakob Raymaekers , Peter J. Rousseeuw

Time series data occurs widely, and outlier detection is a fundamental problem in data mining, which has numerous applications. Existing autoencoder-based approaches deliver state-of-the-art performance on challenging real-world data but…

Machine Learning · Computer Science 2022-04-08 Tung Kieu , Bin Yang , Chenjuan Guo , Christian S. Jensen , Yan Zhao , Feiteng Huang , Kai Zheng