English
Related papers

Related papers: Explainable outlier detection through decision tre…

200 papers

Outliers widely occur in big-data applications and may severely affect statistical estimation and inference. In this paper, a framework of outlier-resistant estimation is introduced to robustify an arbitrarily given loss function. It has a…

Methodology · Statistics 2023-04-20 Yiyuan She , Zhifeng Wang , Jiahui Shen

High-dimensional data poses unique challenges in outlier detection process. Most of the existing algorithms fail to properly address the issues stemming from a large number of features. In particular, outlier detection algorithms perform…

Machine Learning · Computer Science 2020-09-22 Firuz Kamalov , Ho Hon Leung

Detecting which nodes in graphs are outliers is a relatively new machine learning task with numerous applications. Despite the proliferation of algorithms developed in recent years for this task, there has been no standard comprehensive…

In a corpus of data, outliers are either errors: mistakes in the data that are counterproductive, or are unique: informative samples that improve model robustness. Identifying outliers can lead to better datasets by (1) removing noise in…

The aim of plant breeding trials is often to identify germplasms that are well adapt to target environments. These germplasms are identified through genomic prediction from the analysis of multi-environmental field trial (MET) using linear…

Quantitative Methods · Quantitative Biology 2018-07-20 Emi Tanaka

Data cubes are multidimensional databases, often built from several separate databases, that serve as flexible basis for data analysis. Surprisingly, outlier detection on data cubes has not yet been treated extensively. In this work, we…

Databases · Computer Science 2023-03-16 Lara Kuhlmann , Daniel Wilmes , Emmanuel Müller , Markus Pauly , Daniel Horn

A multivariate dataset consists of $n$ cases in $d$ dimensions, and is often stored in an $n$ by $d$ data matrix. It is well-known that real data may contain outliers. Depending on the situation, outliers may be (a) undesirable errors which…

Methodology · Statistics 2019-10-08 Peter J. Rousseeuw , Wannes Van den Bossche

We propose thresholding as an approach to deal with class imbalance. We define the concept of thresholding as a process of determining a decision boundary in the presence of a tunable parameter. The threshold is the maximum value of this…

Machine Learning · Computer Science 2016-07-12 Charmgil Hong , Rumi Ghosh , Soundar Srinivasan

Recent advances in technology have brought major breakthroughs in data collection, enabling a large amount of data to be gathered over time and thus generating time series. Mining this data has become an important task for researchers and…

Machine Learning · Computer Science 2020-02-12 Ane Blázquez-García , Angel Conde , Usue Mori , Jose A. Lozano

Outlier hypothesis testing is studied in a universal setting. Multiple sequences of observations are collected, a small subset of which are outliers. A sequence is considered an outlier if the observations in that sequence are distributed…

Information Theory · Computer Science 2014-04-02 Yun Li , Sirin Nitinawarat , Venugopal V. Veeravalli

Unsupervised outlier detection constitutes a crucial phase within data analysis and remains a dynamic realm of research. A good outlier detection algorithm should be computationally efficient, robust to tuning parameter selection, and…

Machine Learning · Statistics 2024-09-23 Sheikh Arafat , Na Sun , Maria L. Weese , Waldyn G. Martinez

Smart metering infrastructures collect data almost continuously in the form of fine-grained long time series. These massive data series often have common daily patterns that are repeated between similar days or seasons and shared among…

Methodology · Statistics 2022-10-10 A. Elías , J. M. Morales , S. Pineda

Universal outlier hypothesis testing is studied in a sequential setting. Multiple observation sequences are collected, a small subset of which are outliers. A sequence is considered an outlier if the observations in that sequence are…

Statistics Theory · Mathematics 2014-11-27 Yun Li , Sirin Nitinawarat , Venugopal V. Veeravalli

The task of outlier detection is to find small groups of data objects that are exceptional when compared with rest large amount of data. In [38], the problem of outlier detection in categorical data is defined as an optimization problem and…

Databases · Computer Science 2007-05-23 Zengyou He , Xiaofei Xu , Shengchun Deng

This article introduces trimmed estimators for the mean and covariance function of general functional data. The estimators are based on a new measure of outlyingness or data depth that is well defined on any metric space, although this…

Methodology · Statistics 2012-12-03 Daniel Gervini

Outlier detection is an important data mining tool that becomes particularly challenging when dealing with nominal data. First and foremost, flagging observations as outlying requires a well-defined notion of nominal outlyingness. This…

Methodology · Statistics 2025-09-19 Efthymios Costa , Ioanna Papatsouma

Sparse estimation methods capable of tolerating outliers have been broadly investigated in the last decade. We contribute to this research considering high-dimensional regression problems contaminated by multiple mean-shift outliers which…

Methodology · Statistics 2025-10-21 Luca Insolia , Ana Kenney , Francesca Chiaromonte , Giovanni Felici

We consider functional outlier detection from a geometric perspective, specifically: for functional data sets drawn from a functional manifold which is defined by the data's modes of variation in amplitude and phase. Based on this manifold,…

Machine Learning · Statistics 2021-09-15 Moritz Herrmann , Fabian Scheipl

Out-of-scope intent detection is of practical importance in task-oriented dialogue systems. Since the distribution of outlier utterances is arbitrary and unknown in the training stage, existing methods commonly rely on strong assumptions on…

Computation and Language · Computer Science 2021-06-18 Li-Ming Zhan , Haowen Liang , Bo Liu , Lu Fan , Xiao-Ming Wu , Albert Y. S. Lam

We propose a novel procedure for outlier detection in functional data, in a semi-supervised framework. As the data is functional, we consider the coefficients obtained after projecting the observations onto orthonormal bases (wavelet, PCA).…

Machine Learning · Statistics 2017-12-14 Clémentine Barreyre , Béatrice Laurent , Jean-Michel Loubes , Bertrand Cabon , Loïc Boussouf
‹ Prev 1 3 4 5 6 7 10 Next ›