English
Related papers

Related papers: Outlier detection in regression: conic quadratic f…

200 papers

We give the first polynomial-time algorithm for performing linear or polynomial regression resilient to adversarial corruptions in both examples and labels. Given a sufficiently large (polynomial-size) training set drawn i.i.d. from…

Machine Learning · Computer Science 2020-06-05 Adam Klivans , Pravesh K. Kothari , Raghu Meka

Clustering, or unsupervised classification, is a task often plagued by outliers. Yet there is a paucity of work on handling outliers in clustering. Outlier identification algorithms tend to fall into three broad categories: outlier…

Methodology · Statistics 2024-05-31 Katharine M. Clark , Paul D. McNicholas

Outlier detection has received special attention in various fields, mainly for those dealing with machine learning and artificial intelligence. As strong outliers, anomalies are divided into the point, contextual and collective outliers.…

Machine Learning · Computer Science 2020-01-29 Rasoul Kiani , Amin Keshavarzi , Mahdi Bohlouli

The Residual Congruent Subset (RCS) is a new method for finding outliers in the linear regression setting. Like many other outlier detection procedures, RCS searches for a subset which minimizes a criterion. The difference is that the new…

Methodology · Statistics 2014-02-18 Kaveh Vakili , Eric Schmitt

Rate-distortion theory-based outlier detection builds upon the rationale that a good data compression will encode outliers with unique symbols. Based on this rationale, we propose Cluster Purging, which is an extension of clustering-based…

Machine Learning · Computer Science 2023-02-23 Maximilian B. Toller , Bernhard C. Geiger , Roman Kern

We present in this paper a new tool for outliers detection in the context of multiple regression models. This graphical tool is based on recursive estimation of the parameters. Simulations were carried out to illustrate the performance of…

Methodology · Statistics 2007-07-03 Christian Paroissin

A new technique for the detection of outliers in contingency tables is introduced. Outliers thereby are unexpected cell counts with respect to classical loglinear Poisson models. Subsets of cell counts called minimal patterns are defined,…

Computation · Statistics 2012-11-15 Sonja Kuhnt , Fabio Rapallo , André Rehage

Data cubes are multidimensional databases, often built from several separate databases, that serve as flexible basis for data analysis. Surprisingly, outlier detection on data cubes has not yet been treated extensively. In this work, we…

Databases · Computer Science 2023-03-16 Lara Kuhlmann , Daniel Wilmes , Emmanuel Müller , Markus Pauly , Daniel Horn

Outlier detection is an inevitable step to most statistical data analyses. However, the mere detection of an outlying case does not always answer all scientific questions associated with that data point. Outlier detection techniques,…

Methodology · Statistics 2019-12-12 Michiel Debruyne , Sebastiaan Höppner , Sven Serneels , Tim Verdonck

We study the problem of detecting outlier pairs of strongly correlated variables among a collection of $n$ variables with otherwise weak pairwise correlations. After normalization, this task amounts to the geometric task where we are given…

Data Structures and Algorithms · Computer Science 2018-01-08 Matti Karppa , Petteri Kaski , Jukka Kohonen

Outlier detection is an important task in data mining and many technologies have been explored in various applications. However, due to the default assumption that outliers are non-concentrated, unsupervised outlier detection may not…

Machine Learning · Computer Science 2020-03-10 Zhe Li , Chunhua Sun , Chunli Liu , Xiayu Chen , Meng Wang , Yezheng Liu

Linear regression with normally distributed errors - including particular cases such as ANOVA, Student's t-test or location-scale inference - is a widely used statistical procedure. In this case the ordinary least squares estimator…

Methodology · Statistics 2019-09-18 Alain Desgagné

Central moments and cumulants are often employed to characterize the distribution of data. The skewness and kurtosis are particularly useful for the detection of outliers, the assessment of departures from normally distributed data,…

Instrumentation and Methods for Astrophysics · Physics 2014-03-24 Lorenzo Rimoldini

Mixtures of multivariate contaminated shifted asymmetric Laplace distributions are developed for handling asymmetric clusters in the presence of outliers (also referred to as bad points herein). In addition to the parameters of the related…

Methodology · Statistics 2018-04-25 Katherine Morris , Antonio Punzo , Paul D. McNicholas , Ryan P. Browne

We consider the problem of outlier robust PCA (OR-PCA) where the goal is to recover principal directions despite the presence of outlier data points. That is, given a data matrix $M^*$, where $(1-\alpha)$ fraction of the points are noisy…

Machine Learning · Computer Science 2017-02-21 Yeshwanth Cherapanamjeri , Prateek Jain , Praneeth Netrapalli

We consider a fundamental problem in unsupervised learning called \emph{subspace recovery}: given a collection of $m$ points in $\mathbb{R}^n$, if many but not necessarily all of these points are contained in a $d$-dimensional subspace $T$…

Computational Complexity · Computer Science 2013-12-05 Moritz Hardt , Ankur Moitra

Outlier detection plays an essential role in many data-driven applications to identify isolated instances that are different from the majority. While many statistical learning and data mining techniques have been used for developing more…

Machine Learning · Computer Science 2018-05-08 Ninghao Liu , Donghwa Shin , Xia Hu

Classification is the basis of cognition. Unlike other solutions, this study approaches it from the view of outliers. We present an expanding algorithm to detect outliers in univariate datasets, together with the underlying foundation. The…

Artificial Intelligence · Computer Science 2012-01-04 C. A. Hsiao

In practical data analysis under noisy environment, it is common to first use robust methods to identify outliers, and then to conduct further analysis after removing the outliers. In this paper, we consider statistical inference of the…

Machine Learning · Statistics 2022-01-04 Toshiaki Tsukurimichi , Yu Inatsu , Vo Nguyen Le Duy , Ichiro Takeuchi

The numerical performance of algorithms can be studied using test sets or procedures that generate such problems. This paper proposes various methods for generating linear, semidefinite, and second-order cone optimization problems.…

Optimization and Control · Mathematics 2023-02-03 Mohammadhossein Mohammadisiahroudi , Ramin Fakhimi , Brandon Augustino , Tamás Terlaky