English
Related papers

Related papers: Multiple Outliers in Small Samples

200 papers

In the present era of large scale surveys, big data presents new challenges to the discovery process for anomalous data. Such data can be indicative of systematic errors, extreme (or rare) forms of known phenomena, or most interestingly,…

Instrumentation and Methods for Astrophysics · Physics 2020-09-17 Daniel Giles , Lucianne Walkowicz

Outlier detection is a technique in data mining that aims to detect unusual or unexpected records in the dataset. Existing outlier detection algorithms have different pros and cons and exhibit different sensitivity to noisy data such as…

Machine Learning · Computer Science 2023-12-22 Yuanyuan Wei , Julian Jang-Jaccard , Fariza Sabrina , Timothy McIntosh

We present in this paper a new tool for outliers detection in the context of multiple regression models. This graphical tool is based on recursive estimation of the parameters. Simulations were carried out to illustrate the performance of…

Methodology · Statistics 2007-07-03 Christian Paroissin

The scores of distance-based outlier detection methods are difficult to interpret, making it challenging to determine a cut-off threshold between normal and outlier data points without additional context. We describe a generic…

Machine Learning · Computer Science 2023-07-20 David Muhr , Michael Affenzeller , Josef Küng

Outlier detection is the identification of points in a dataset that do not conform to the norm. Outlier detection is highly sensitive to the choice of the detection algorithm and the feature subspace used by the algorithm. Extracting…

Artificial Intelligence · Computer Science 2017-05-18 Yanjie Fu , Charu Aggarwal , Srinivasan Parthasarathy , Deepak S. Turaga , Hui Xiong

Recent advances in technology have brought major breakthroughs in data collection, enabling a large amount of data to be gathered over time and thus generating time series. Mining this data has become an important task for researchers and…

Machine Learning · Computer Science 2020-02-12 Ane Blázquez-García , Angel Conde , Usue Mori , Jose A. Lozano

The unsupervised outlier detection (UOD) problem refers to a task to identify inliers given training data which contain outliers as well as inliers, without any labeled information about inliers and outliers. It has been widely recognized…

Machine Learning · Statistics 2024-07-17 Dongha Kim , Jaesung Hwang , Jongjin Lee , Kunwoong Kim , Yongdai Kim

The problem of detecting a small number of outliers in a large dataset is an important task in many fields from fraud detection to high-energy physics. Two approaches have emerged to tackle this problem: unsupervised and supervised.…

Machine Learning · Computer Science 2015-07-30 Barbora Micenková , Brian McWilliams , Ira Assent

Modern neural networks are known to give overconfident prediction for out-of-distribution inputs when deployed in the open world. It is common practice to leverage a surrogate outlier dataset to regularize the model during training, and…

Machine Learning · Computer Science 2024-02-27 Wenyu Jiang , Hao Cheng , Mingcai Chen , Chongjun Wang , Hongxin Wei

In Small Area Estimation data linkage can be used to combine values of the variableof interest from a national survey with values of auxiliary variables obtained from another source like a population register. Linkage errors can induce bias…

Methodology · Statistics 2019-04-02 Ray Chambers , Enrico Fabrizi , Nicola Salvati

We introduce two ratio-based robust test statistics, max-robust-sum (MRS) and sum-robust-sum (SRS), designed to enhance the robustness of outlier detection in samples with exponential or Pareto tails. We also reintroduce the inward…

Methodology · Statistics 2024-09-26 Didier Sornette , Ran Wei

Wireless sensor networks usually comprise a large number of sensors monitoring changes in variables. These changes in variables represent changes in physical quantities. The changes can occur for various reasons; these reasons are…

Machine Learning · Computer Science 2017-08-29 Pelumi Oluwasanya

Clustering with outliers is one of the most fundamental problems in Computer Science. Given a set $X$ of $n$ points and two integers $k$ and $m$, the clustering with outliers aims to exclude $m$ points from $X$ and partition the remaining…

Data Structures and Algorithms · Computer Science 2023-02-21 Akanksha Agrawal , Tanmay Inamdar , Saket Saurabh , Jie Xue

Zero adjusted regression models are used to fit variables that are discrete at zero and continuous at some interval of the positive real numbers. Diagnostic analysis in these models is usually performed using the randomized quantile…

There has been extensive work on data depth-based methods for robust multivariate data analysis. Recent developments have moved to infinite-dimensional objects such as functional data. In this work, we propose a new notion of depth, the…

Methodology · Statistics 2016-11-16 Huang Huang , Ying Sun

We introduce an online outlier detection algorithm to detect outliers in a sequentially observed data stream. For this purpose, we use a two-stage filtering and hedging approach. In the first stage, we construct a multi-modal probability…

Machine Learning · Computer Science 2018-03-13 Mohammadreza Mohaghegh Neyshabouri , Suleyman Serdar Kozat

Bayesian methods have proven themselves to be successful across a wide range of scientific problems and have many well-documented advantages over competing methods. However, these methods run into difficulties for two major and prevalent…

Methodology · Statistics 2022-07-29 John R. Lewis , Steven N. MacEachern , Yoonkyung Lee

In recent results, it has been proven that all sampling methods produce outliers. In this paper, we extend these results to quantum information theory. Projectors of large rank must contain pure quantum states in their images that are…

Computational Complexity · Computer Science 2023-03-14 Samuel Epstein

Classification is the basis of cognition. Unlike other solutions, this study approaches it from the view of outliers. We present an expanding algorithm to detect outliers in univariate datasets, together with the underlying foundation. The…

Artificial Intelligence · Computer Science 2012-01-04 C. A. Hsiao

In machine learning and data mining, outliers are data points that significantly differ from the dataset and often introduce irrelevant information that can induce bias in its statistics and models. Therefore, unsupervised methods are…

Machine Learning · Computer Science 2024-11-14 Kushankur Ghosh , Murilo Coelho Naldi , Jörg Sander , Euijin Choo