English
Related papers

Related papers: Outlier Detection in Contingency Tables based on M…

200 papers

Rare data in a large-scale database are called outliers that reveal significant information in the real world. The subspace-based outlier detection is regarded as a feasible approach in very high dimensional space. However, the outliers…

Artificial Intelligence · Computer Science 2014-05-06 Zhana Bao

We propose a novel procedure for outlier detection in functional data, in a semi-supervised framework. As the data is functional, we consider the coefficients obtained after projecting the observations onto orthonormal bases (wavelet, PCA).…

Machine Learning · Statistics 2017-12-14 Clémentine Barreyre , Béatrice Laurent , Jean-Michel Loubes , Bertrand Cabon , Loïc Boussouf

We construct examples of contingency tables on $n$ binary random variables where the gap between the linear programming lower/upper bound and the true integer lower/upper bounds on cell entries is exponentially large. These examples provide…

Optimization and Control · Mathematics 2007-06-13 Seth Sullivant

Outlier detection refers to the identification of anomalous samples that deviate significantly from the distribution of normal data and has been extensively studied and used in a variety of practical tasks. However, most unsupervised…

Machine Learning · Computer Science 2025-01-07 Can Gao , Xiaofeng Tan , Jie Zhou , Weiping Ding , Witold Pedrycz

The usual Minimum Covariance Determinant (MCD) estimator of a covariance matrix is robust against casewise outliers. These are cases (that is, rows of the data matrix) that behave differently from the majority of cases, raising suspicion…

Methodology · Statistics 2024-07-08 Jakob Raymaekers , Peter J. Rousseeuw

Outlier detection plays a significant role in various real world applications such as intrusion, malfunction, and fraud detection. Traditionally, outlier detection techniques are applied to find outliers in the context of the whole dataset.…

Databases · Computer Science 2021-03-10 Masoumeh Shafieinejad , Florian Kerschbaum , Ihab F. Ilyas

This paper studies the construction of p-values for nonparametric outlier detection, taking a multiple-testing perspective. The goal is to test whether new independent samples belong to the same distribution as a reference data set or are…

Methodology · Statistics 2024-03-12 Stephen Bates , Emmanuel Candès , Lihua Lei , Yaniv Romano , Matteo Sesia

Regression is the workhorse of statistics, and is often faced with real data that contain outliers. When these are casewise outliers, that is, cases that are entirely wrong or belong to a different population, the issue can be remedied by…

Methodology · Statistics 2026-03-06 Jakob Raymaekers , Peter J. Rousseeuw

Outlier detection refers to the identification of data points that deviate from a general data distribution. Existing unsupervised approaches often suffer from high computational cost, complex hyperparameter tuning, and limited…

Machine Learning · Computer Science 2022-08-26 Zheng Li , Yue Zhao , Xiyang Hu , Nicola Botta , Cezar Ionescu , George H. Chen

Contingency tables are a fundamental representation of multivariate categorical data. As the size of the contingency table grows exponentially with the number of variables, even a moderate number of variables, each with a moderate number of…

Methodology · Statistics 2026-03-10 Veronica Vinciotti , Ernst C. Wit

Analyzing sequence data usually leads to the discovery of interesting patterns and then anomaly detection. In recent years, numerous frameworks and methods have been proposed to discover interesting patterns in sequence data as well as…

Databases · Computer Science 2021-12-01 Wensheng Gan , Lili Chen , Shicheng Wan , Jiahui Chen , Chien-Ming Chen

We propose PODS (Predictable Outliers in Data-trendS), a method that, given a collection of temporal data sets, derives data-driven explanations for outliers by identifying meaningful relationships between them. First, we formalize the…

Databases · Computer Science 2020-04-10 Aline Bessa , Juliana Freire , Divesh Srivastava , Tamraparni Dasu

We consider state estimation for networked systems where measurements from sensor nodes are contaminated by outliers. A new hierarchical measurement model is formulated for outlier detection by integrating the outlier-free measurement model…

Applications · Statistics 2022-11-08 Hongwei Wang , Hongbin Li , Wei Zhang , Junyi Zuo , Heping Wang , Jun Fang

The quality of datasets plays a crucial role in the successful training and deployment of deep learning models. Especially in the medical field, where system performance may impact the health of patients, clean datasets are a safety…

Image and Video Processing · Electrical Eng. & Systems 2022-08-19 Stefan Röhrl , Alice Hein , Lucie Huang , Dominik Heim , Christian Klenk , Manuel Lengl , Martin Knopp , Nawal Hafez , Oliver Hayden , Klaus Diepold

Outlier, or anomaly, detection is essential for optimal performance of machine learning methods and statistical predictive models. It is not just a technical step in a data cleaning process but a key topic in many fields such as fraudulent…

Machine Learning · Computer Science 2020-02-19 O. Ramos Terrades , A. Berenguel , D. Gil

Many traditional methods for identifying changepoints can struggle in the presence of outliers, or when the noise is heavy-tailed. Often they will infer additional changepoints in order to fit the outliers. To overcome this problem, data…

Methodology · Statistics 2017-07-12 Paul Fearnhead , Guillem Rigaill

Ordinary least square (OLS) estimation of a linear regression model is well-known to be highly sensitive to outliers. It is common practice to (1) identify and remove outliers by looking at the data and (2) to fit OLS and form confidence…

Methodology · Statistics 2019-08-13 Shuxiao Chen , Jacob Bien

Outlier detection is a major topic in robust statistics due to the high practical significance of anomalous observations. Many existing methods are, however, either parametric or cease to perform well when the data is far from linearly…

Methodology · Statistics 2018-11-14 Matias Heikkilä

Outlier Detection is a critical and cardinal research task due its array of applications in variety of domains ranging from data mining, clustering, statistical analysis, fraud detection, network intrusion detection and diagnosis of…

Machine Learning · Computer Science 2018-03-15 Archit Harsh , John E. Ball , Pan Wei

The paper proposes a new latent variable model for the simultaneous (two-way) detection of outlying individuals and items for item-response-type data. The proposed model is a synergy between a factor model for binary responses and…

Methodology · Statistics 2021-10-25 Yunxiao Chen , Yan Lu , Irini Moustaki