English
Related papers

Related papers: Finding Inner Outliers in High Dimensional Space

200 papers

We initiate the study of metric embeddings with \emph{outliers}. Given some metric space $(X,\rho)$ we wish to find a small set of outlier points $K \subset X$ and either an isometric or a low-distortion embedding of $(X\setminus K,\rho)$…

Data Structures and Algorithms · Computer Science 2015-08-17 Anastasios Sidiropoulos , Yusu Wang

In object tracking, outlier is one of primary factors which degrade performance of image-based tracking algorithms. In this respect, therefore, most of the existing methods simply discard detected outliers and pay little or no attention to…

Computer Vision and Pattern Recognition · Computer Science 2014-09-16 Jae-Yeong Lee , Wonpil Yu

The outlier detection problem in some cases is similar to the classification problem. For example, the main concern of clustering-based outlier detection algorithms is to find clusters and outliers, which are often regarded as noise that…

Machine Learning · Computer Science 2014-05-25 M. H. Marghny , Ahmed I. Taloba

One of the significant challenges in monitoring the quality of products today is the high dimensionality of quality characteristics. In this paper, we address Phase I analysis of high-dimensional processes with individual observations when…

Methodology · Statistics 2023-01-02 Mohsen Ebadi , Shojaeddin Chenouri , Stefan H. Steiner

Euclidean embedding from noisy observations containing outlier errors is an important and challenging problem in statistics and machine learning. Many existing methods would struggle with outliers due to a lack of detection ability. In this…

Machine Learning · Statistics 2020-12-24 Qian Zhang , Xinyuan Zhao , Chao Ding

Successful detection of Out-of-Distribution (OoD) data is becoming increasingly important to ensure safe deployment of neural networks. One of the main challenges in OoD detection is that neural networks output overconfident predictions on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Sangha Park , Jisoo Mok , Dahuin Jung , Saehyung Lee , Sungroh Yoon

The problem of clustering noisy and incompletely observed high-dimensional data points into a union of low-dimensional subspaces and a set of outliers is considered. The number of subspaces, their dimensions, and their orientations are…

Machine Learning · Statistics 2015-08-24 Reinhard Heckel , Helmut Bölcskei

Supervised classification methods often assume the train and test data distributions are the same and that all classes in the test set are present in the training set. However, deployed classifiers often require the ability to recognize…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Ryne Roady , Tyler L. Hayes , Ronald Kemker , Ayesha Gonzales , Christopher Kanan

In ordinary Dimensionality Reduction (DR), each data instance in a high dimensional space (original space), or on a distance matrix denoting original space distances, is mapped to (projected onto) one point in a low dimensional space…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Farshad Barahimi

In this paper, we address the problem of conducting statistical inference in settings involving large-scale data that may be high-dimensional and contaminated by outliers. The high volume and dimensionality of the data require distributed…

Machine Learning · Statistics 2022-11-30 Emadaldin Mozafari-Majd , Visa Koivunen

It is important to detect anomalous inputs when deploying machine learning systems. The use of larger and more complex inputs in deep learning magnifies the difficulty of distinguishing between anomalous and in-distribution examples. At the…

Machine Learning · Computer Science 2019-01-30 Dan Hendrycks , Mantas Mazeika , Thomas Dietterich

The idea of Innovation Search was proposed as a data clustering method in which the directions of innovation were utilized to compute the adjacency matrix and it was shown that Innovation Pursuit can notably outperform the self…

Machine Learning · Statistics 2020-01-01 Mostafa Rahmani , Ping Li

The scores of distance-based outlier detection methods are difficult to interpret, making it challenging to determine a cut-off threshold between normal and outlier data points without additional context. We describe a generic…

Machine Learning · Computer Science 2023-07-20 David Muhr , Michael Affenzeller , Josef Küng

An ever-growing number of vulnerabilities are reported every day. Yet these vulnerabilities are not all the same; Some are more targeted than others. Correctly estimating the likelihood of a vulnerability being exploited is a critical task…

Cryptography and Security · Computer Science 2023-04-21 Hadi Eskandari , Michael Bewong , Sabih ur Rehman

Many real-world problems can be formulated as geometric optimization problems in high dimensions, especially in the fields of machine learning and data mining. Moreover, we often need to take into account of outliers when optimizing the…

Computational Geometry · Computer Science 2020-05-04 Hu Ding

Deep neural networks (DNNs) are known to produce incorrect predictions with very high confidence on out-of-distribution (OOD) inputs. This limitation is one of the key challenges in the adoption of deep learning models in high-assurance…

Machine Learning · Computer Science 2021-03-24 Ramneet Kaur , Susmit Jha , Anirban Roy , Oleg Sokolsky , Insup Lee

The curse of outlier measurements in estimation problems is a well known issue in a variety of fields. Therefore, outlier removal procedures, which enables the identification of spurious measurements within a set, have been developed for…

Information Theory · Computer Science 2017-08-02 Marco Compagnoni , Alessia Pini , Antonio Canclini , Paolo Bestagini , Fabio Antonacci , Stefano Tubaro , Augusto Sarti

Outlier detection is a technique in data mining that aims to detect unusual or unexpected records in the dataset. Existing outlier detection algorithms have different pros and cons and exhibit different sensitivity to noisy data such as…

Machine Learning · Computer Science 2023-12-22 Yuanyuan Wei , Julian Jang-Jaccard , Fariza Sabrina , Timothy McIntosh

Change-point detection has been a classical problem in statistics and econometrics. This work focuses on the problem of detecting abrupt distributional changes in the data-generating distribution of a sequence of high-dimensional…

Methodology · Statistics 2021-05-20 Shubhadeep Chakraborty , Xianyang Zhang

The presence of outliers can prevent clustering algorithms from accurately determining an appropriate group structure within a data set. We present outlierMBC, a model-based approach for sequentially removing outliers and clustering the…

Methodology · Statistics 2025-06-30 Ultán P. Doherty , Paul D. McNicholas , Arthur White