English
Related papers

Related papers: Detecting deviating data cells

200 papers

Outlying curves often occur in functional or longitudinal datasets, and can be very influential on parameter estimators and very hard to detect visually. In this article we introduce estimators of the mean and the principal components that…

Applications · Statistics 2010-11-03 Daniel Gervini

In data analysis, contamination caused by outliers is inevitable, and robust statistical methods are strongly demanded. In this paper, our concern is to develop a new approach for robust data analysis based on scoring rules. The scoring…

Statistics Theory · Mathematics 2013-11-22 Takafumi Kanamori , Hironori Fujisawa

Rate-distortion theory-based outlier detection builds upon the rationale that a good data compression will encode outliers with unique symbols. Based on this rationale, we propose Cluster Purging, which is an extension of clustering-based…

Machine Learning · Computer Science 2023-02-23 Maximilian B. Toller , Bernhard C. Geiger , Roman Kern

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

Machine Learning · Computer Science 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

Anomalies and outliers are common in real-world data, and they can arise from many sources, such as sensor faults. Accordingly, anomaly detection is important both for analyzing the anomalies themselves and for cleaning the data for further…

Machine Learning · Statistics 2018-11-13 Haitao Liu , Randy C. Paffenroth , Jian Zou , Chong Zhou

With the rise of machine learning and deep learning based applications in practice, monitoring, i.e. verifying that these operate within specification, has become an important practical problem. An important aspect of this monitoring is to…

Machine Learning · Computer Science 2021-06-29 Thomas Viehmann

We develop techniques to quantify the degree to which a given (training or testing) example is an outlier in the underlying distribution. We evaluate five methods to score examples in a dataset by how well-represented the examples are, for…

Machine Learning · Computer Science 2019-10-30 Nicholas Carlini , Úlfar Erlingsson , Nicolas Papernot

One of the significant challenges in monitoring the quality of products today is the high dimensionality of quality characteristics. In this paper, we address Phase I analysis of high-dimensional processes with individual observations when…

Methodology · Statistics 2023-01-02 Mohsen Ebadi , Shojaeddin Chenouri , Stefan H. Steiner

Deep neural networks (DNNs) are known to produce incorrect predictions with very high confidence on out-of-distribution (OOD) inputs. This limitation is one of the key challenges in the adoption of deep learning models in high-assurance…

Machine Learning · Computer Science 2021-03-24 Ramneet Kaur , Susmit Jha , Anirban Roy , Oleg Sokolsky , Insup Lee

In the realm of unsupervised image outlier detection, assigning outlier scores holds greater significance than its subsequent task: thresholding for predicting labels. This is because determining the optimal threshold on non-separable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Zhonghang Liu , Panzhong Lu , Guoyang Xie , Zhichao Lu , Wen-Yan Lin

It is crucial to detect when an instance lies downright too far from the training samples for the machine learning model to be trusted, a challenge known as out-of-distribution (OOD) detection. For neural networks, one approach to this task…

Observations in data which are significantly different from its neighbouring points but cannot be classified as noise are known as anomalies or outliers. These anomalies are a cause of concern and a timely warning about their presence could…

Applications · Statistics 2020-06-09 Krishnam Kapoor

Outlier detection in data streams has gained wide importance presently due to the increasing cases of fraud in various applications of data streams. The techniques for outlier detection have been divided into either statistics based,…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-03-25 Parneeta Dhaliwal , M. P. S. Bhatia , Priti Bansal

Outlier detection refers to the identification of rare items that are deviant from the general data distribution. Existing approaches suffer from high computational complexity, low predictive capability, and limited interpretability. As a…

Machine Learning · Statistics 2022-01-04 Zheng Li , Yue Zhao , Nicola Botta , Cezar Ionescu , Xiyang Hu

Time series often contain outliers and level shifts or structural changes. These unexpected events are of the utmost importance in fraud detection, as they may pinpoint suspicious transactions. The presence of such unusual events can easily…

Computation · Statistics 2021-01-13 Peter J. Rousseeuw , Domenico Perrotta , Marco Riani , Mia Hubert

Computer-aided diagnostics has benefited from the development of deep learning-based computer vision techniques in these years. Traditional supervised deep learning methods assume that the test sample is drawn from the identical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Zesheng Hong , Yubiao Yue , Yubin Chen , Lele Cong , Huanjie Lin , Yuanmei Luo , Mini Han Wang , Weidong Wang , Jialong Xu , Xiaoqi Yang , Hechang Chen , Zhenzhang Li , Sihong Xie

Sparse estimation methods capable of tolerating outliers have been broadly investigated in the last decade. We contribute to this research considering high-dimensional regression problems contaminated by multiple mean-shift outliers which…

Methodology · Statistics 2025-10-21 Luca Insolia , Ana Kenney , Francesca Chiaromonte , Giovanni Felici

A popular approach for comparing gene expression levels between (replicated) conditions of RNA sequencing data relies on counting reads that map to features of interest. Within such count-based methods, many flexible and advanced…

Quantitative Methods · Quantitative Biology 2014-03-17 Xiaobei Zhou , Helen Lindsay , Mark D. Robinson

Outlier recognition is a fundamental problem in data analysis and has attracted a great deal of attention in the past decades. However, most existing methods still suffer from several issues such as high time and space complexities or…

Computational Geometry · Computer Science 2019-04-09 Hu Ding , Mingquan Ye

We study the change detection problem with an unknown post-change distribution. Under this constraint, the unknown change in the distribution of observations may occur in many ways without much structure on the observations, whereas, before…

Signal Processing · Electrical Eng. & Systems 2020-12-11 Deniz Sargun , C. Emre Koksal