English
Related papers

Related papers: Detecting Outliers in Data with Correlated Measure…

200 papers

Broad spectrum of urban activities including mobility can be modeled as temporal networks evolving over time. Abrupt changes in urban dynamics caused by events such as disruption of civic operations, mass crowd gatherings, holidays and…

Physics and Society · Physics 2019-12-05 Mingyi He , Shivam Pathak , Urwa Muaz , Jingtian Zhou , Saloni Saini , Sergey Malinchik , Stanislav Sobolevsky

Anomalies (unusual patterns) in time-series data give essential, and often actionable information in critical situations. Examples can be found in such fields as healthcare, intrusion detection, finance, security and flight safety. In this…

Applications · Statistics 2016-08-17 Evgeny Burnaev , Vladislav Ishimtsev

Whether an extreme observation is an outlier or not, depends strongly on the corresponding tail behaviour of the underlying distribution. We develop an automatic, data-driven method to identify extreme tail behaviour that deviates from the…

Methodology · Statistics 2019-12-06 Shrijita Bhattacharya , Jan Beirlant

In this article, we consider the problem of outlier-robust state estimation where the measurement noise can be correlated. Outliers in data arise due to many reasons like sensor malfunctioning, environmental behaviors, communication…

Signal Processing · Electrical Eng. & Systems 2024-08-21 Aamir Hussain Chughtai , Muhammad Tahir , Momin Uppal

Autonomous vehicles rely on LiDAR sensors to perceive the environment. Adverse weather conditions like rain, snow, and fog negatively affect these sensors, reducing their reliability by introducing unwanted noise in the measurements. In…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Aldi Piroli , Vinzenz Dallabetta , Johannes Kopp , Marc Walessa , Daniel Meissner , Klaus Dietmayer

In data analysis, contamination caused by outliers is inevitable, and robust statistical methods are strongly demanded. In this paper, our concern is to develop a new approach for robust data analysis based on scoring rules. The scoring…

Statistics Theory · Mathematics 2013-11-22 Takafumi Kanamori , Hironori Fujisawa

Outliers due to technical errors in water-quality data from in situ sensors can reduce data quality and have a direct impact on inference drawn from subsequent data analysis. However, outlier detection through manual monitoring is…

Modern machine learning-based recognition approaches require large-scale datasets with large number of labelled training images. However, such datasets are inherently difficult and costly to collect and annotate. Hence there is a great and…

Machine Learning · Computer Science 2019-12-30 Yanwei Fu , De-An Huang , Leonid Sigal

We derive a convex optimization problem for the task of segmenting sequential data, which explicitly treats presence of outliers. We describe two algorithms for solving this problem, one exact and one a top-down novel approach, and we…

Machine Learning · Computer Science 2014-11-19 Itamar Katz , Koby Crammer

The paper proposes a new latent variable model for the simultaneous (two-way) detection of outlying individuals and items for item-response-type data. The proposed model is a synergy between a factor model for binary responses and…

Methodology · Statistics 2021-10-25 Yunxiao Chen , Yan Lu , Irini Moustaki

Outlier detection and novelty detection are two important topics for anomaly detection. Suppose the majority of a dataset are drawn from a certain distribution, outlier detection and novelty detection both aim to detect data samples that do…

Machine Learning · Computer Science 2019-11-19 Min Du , Ruoxi Jia , Dawn Song

Metric-based summary statistics such as mean and covariance have been introduced in neural spike train space. They can properly describe template and variability in spike train data, but are often sensitive to outliers and expensive to…

Applications · Statistics 2023-11-27 Xinyu Zhou , Wei Wu

This paper studies the problem of robustly learning the correlation function for a univariate time series with the presence of noise, outliers and missing entries. The outliers or anomalies considered here are sparse and rare events that…

Applications · Statistics 2019-01-31 Triet M. Le

Outlying curves often occur in functional or longitudinal datasets, and can be very influential on parameter estimators and very hard to detect visually. In this article we introduce estimators of the mean and the principal components that…

Applications · Statistics 2010-11-03 Daniel Gervini

The Residual Congruent Subset (RCS) is a new method for finding outliers in the linear regression setting. Like many other outlier detection procedures, RCS searches for a subset which minimizes a criterion. The difference is that the new…

Methodology · Statistics 2014-02-18 Kaveh Vakili , Eric Schmitt

We consider the problem of building visual anomaly detection systems for mobile robots. Standard anomaly detection models are trained using large datasets composed only of non-anomalous data. However, in robotics applications, it is often…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Dario Mantegazza , Alessandro Giusti , Luca Maria Gambardella , Jérôme Guzzi

This paper proposes an approach for anomalous sound detection that incorporates outlier exposure and inlier modeling within a unified framework by multitask learning. While outlier exposure-based methods can extract features efficiently, it…

Sound · Computer Science 2023-09-15 Yucong Zhang , Hongbin Suo , Yulong Wan , Ming Li

This study deals with the problem of outliers in ordinal response model, which is a regression on ordered categorical data as the response variable. ``Outlier" means that the combination of ordered categorical data and its covariates is…

Methodology · Statistics 2022-12-29 Tomotaka Momozaki , Tomoyuki Nakagawa

The outlying property detection problem is the problem of discovering the properties distinguishing a given object, known in advance to be an outlier in a database, from the other database objects. In this paper, we analyze the problem…

Machine Learning · Computer Science 2013-06-18 Fabrizio Angiulli , Fabio Fassetti , Luigi Palopoli , Giuseppe Manco

The presence of outliers can prevent clustering algorithms from accurately determining an appropriate group structure within a data set. We present outlierMBC, a model-based approach for sequentially removing outliers and clustering the…

Methodology · Statistics 2025-06-30 Ultán P. Doherty , Paul D. McNicholas , Arthur White