English
Related papers

Related papers: How to detect outliers in data envelopment analysi…

200 papers

Observations in data which are significantly different from its neighbouring points but cannot be classified as noise are known as anomalies or outliers. These anomalies are a cause of concern and a timely warning about their presence could…

Applications · Statistics 2020-06-09 Krishnam Kapoor

By now, most outlier-detection algorithms struggle to accurately detect both point anomalies and cluster anomalies simultaneously. Furthermore, a few K-nearest-neighbor-based anomaly-detection methods exhibit excellent performance on many…

Information Theory · Computer Science 2025-06-06 Kaituo Zhang , Wei Huang , Bingyang Zhang , Jinshan Xu , Xuhua Yang

Autoencoders, as a dimensionality reduction technique, have been recently applied to outlier detection. However, neural networks are known to be vulnerable to overfitting, and therefore have limited potential in the unsupervised outlier…

Machine Learning · Computer Science 2019-10-23 Hamed Sarvari , Carlotta Domeniconi , Bardh Prenkaj , Giovanni Stilo

Data envelopment analysis (DEA) works like a black box that does not provide any adequate detail to identify the specific reason for inefficiency in decision-making units (DMUs). The motivation of this study is to analyze the cause of the…

Optimization and Control · Mathematics 2022-06-06 Awadh Pratap Singh , Shiv Prasad Yadav

Clustering, or unsupervised classification, is a task often plagued by outliers. Yet there is a paucity of work on handling outliers in clustering. Outlier identification algorithms tend to fall into three broad categories: outlier…

Methodology · Statistics 2024-05-31 Katharine M. Clark , Paul D. McNicholas

As a widely used method in machine learning, principal component analysis (PCA) shows excellent properties for dimensionality reduction. It is a serious problem that PCA is sensitive to outliers, which has been improved by numerous Robust…

Machine Learning · Computer Science 2020-11-24 Shenglan Liu , Yang Yu

Typical Bayesian approaches to OOD detection use epistemic uncertainty. Surprisingly from the Bayesian perspective, there are a number of methods that successfully use aleatoric uncertainty to detect OOD points (e.g. Hendryks et al. 2018).…

Machine Learning · Statistics 2021-10-29 Xi Wang , Laurence Aitchison

Anomaly and outlier detection is a long-standing problem in machine learning. In some cases, anomaly detection is easy, such as when data are drawn from well-characterized distributions such as the Gaussian. However, when data occupy…

Machine Learning · Computer Science 2021-11-24 Najib Ishaq , Thomas J. Howard , Noah M. Daniels

We present a methodology to discover outliers in catalogs of periodic light-curves. We use cross-correlation as measure of ``similarity'' between two individual light-curves and then classify light-curves with lowest average ``similarity''…

Astrophysics · Physics 2009-11-11 P. Protopapas , J. M. Giammarco , L. Faccioli , M. F. Struble , R. Dave , C. Alcock

Normalizing flows are prominent deep generative models that provide tractable probability distributions and efficient density estimation. However, they are well known to fail while detecting Out-of-Distribution (OOD) inputs as they directly…

Machine Learning · Computer Science 2021-11-17 Nishant Kumar , Pia Hanfeld , Michael Hecht , Michael Bussmann , Stefan Gumhold , Nico Hoffmann

Dynamic factor models have a wide range of applications in econometrics and applied economics. The basic motivation resides in their capability of reducing a large set of time series to only few indicators (factors). If the number of time…

Statistics Theory · Mathematics 2009-09-29 Roberto Baragona , Francesco Battaglia

It is well-known that real data often contain outliers. The term outlier typically refers to a case, that is, a row of the $n \times d$ data matrix. In recent times a different type has come into focus, the cellwise outliers. These are…

Methodology · Statistics 2024-07-08 Jakob Raymaekers , Peter J. Rousseeuw

Outlier detection in high-dimensional data is a challenging yet important task, as it has applications in, e.g., fraud detection and quality control. State-of-the-art density-based algorithms perform well because they 1) take the local…

Artificial Intelligence · Computer Science 2016-11-02 Bas van Stein , Matthijs van Leeuwen , Thomas Bäck

Outlier is the term that indicates in statistics an anomalous observation, aberrant, clearly distant from others collected observations. The outliers are the subject to animated discussions in various contexts with regard to be or not to be…

Applications · Statistics 2014-03-24 Gianluca Rosso

Ordinary least square (OLS) estimation of a linear regression model is well-known to be highly sensitive to outliers. It is common practice to (1) identify and remove outliers by looking at the data and (2) to fit OLS and form confidence…

Methodology · Statistics 2019-08-13 Shuxiao Chen , Jacob Bien

Anomalous sound detection systems must detect unknown, atypical sounds using only normal audio data. Conventional methods use the serial method, a combination of outlier exposure (OE), which classifies normal and pseudo-anomalous data and…

Sound · Computer Science 2022-06-14 Ibuki Kuroyanagi , Tomoki Hayashi , Kazuya Takeda , Tomoki Toda

Outliers can contaminate the measurement process of many nonlinear systems, which can be caused by sensor errors, model uncertainties, change in ambient environment, data loss or malicious cyber attacks. When the extended Kalman filter…

Systems and Control · Computer Science 2019-04-02 Huazhen Fang , Mulugeta A. Haile , Yebin Wang

Support Vector Machines have been successfully used for one-class classification (OCSVM, SVDD) when trained on clean data, but they work much worse on dirty data: outliers present in the training data tend to become support vectors, and are…

Machine Learning · Computer Science 2022-12-29 Daniel Boiar , Thomas Liebig , Erich Schubert

Out-of-distribution (OOD) detection is the task of identifying data sampled from distributions that were not used during training. This task is essential for reliable machine learning and a better understanding of their generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Kohei Fukuda , Hiroaki Aizawa

In many applications, when building linear regression models, it is important to account for the presence of outliers, i.e., corrupted input data points. Such problems can be formulated as mixed-integer optimization problems involving cubic…

Optimization and Control · Mathematics 2023-07-13 Andrés Gómez , José Neto