English
Related papers

Related papers: A novel framework for quantifying nominal outlying…

200 papers

Clustering and outlier detection are two important tasks in data mining. Outliers frequently interfere with clustering algorithms to determine the similarity between objects, resulting in unreliable clustering results. Currently, only a few…

Machine Learning · Computer Science 2024-12-10 Qi Li , Shuliang Wang

We revisit the outlier hypothesis testing framework of Li \emph{et al.} (TIT 2014) and derive fundamental limits for the optimal test. In outlier hypothesis testing, one is given multiple observed sequences, where most sequences are…

Statistics Theory · Mathematics 2022-05-17 Lin Zhou , Yun Wei , Alfred Hero

Normalizing flows are prominent deep generative models that provide tractable probability distributions and efficient density estimation. However, they are well known to fail while detecting Out-of-Distribution (OOD) inputs as they directly…

Machine Learning · Computer Science 2021-11-17 Nishant Kumar , Pia Hanfeld , Michael Hecht , Michael Bussmann , Stefan Gumhold , Nico Hoffmann

The interactive exploration of large and evolving datasets is challenging as relationships between underlying variables may not be fully understood. There may be hidden trends and patterns in the data that are worthy of further exploration…

Machine Learning · Computer Science 2023-04-06 A. Ravishankar Rao , Daniel Clarke , Subrata Garai , Soumyabrata Dey

Categorization is one of the basic tasks in machine learning and data analysis. Building on formal concept analysis (FCA), the starting point of the present work is that different ways to categorize a given set of objects exist, which…

Artificial Intelligence · Computer Science 2023-12-21 Marcel Boersma , Krishna Manoorkar , Alessandra Palmigiano , Mattia Panettiere , Apostolos Tzimoulis , Nachoem Wijnberg

Outlier detection is a well-researched and crucial problem in machine learning. However, there is little research on string data outlier detection, as most literature focuses on outlier detection of numerical data. A robust string data…

Machine Learning · Computer Science 2026-03-13 Philip Maus

Diagnosing and cleaning data is a crucial step for building robust machine learning systems. However, identifying problems within large-scale datasets with real-world distributions is challenging due to the presence of complex issues such…

Machine Learning · Computer Science 2023-10-31 Jang-Hyun Kim , Sangdoo Yun , Hyun Oh Song

An outlier detection method may be considered fair over specified sensitive attributes if the results of outlier detection are not skewed towards particular groups defined on such sensitive attributes. In this task, we consider, for the…

Machine Learning · Computer Science 2020-08-06 Deepak P , Savitha Sam Abraham

Outlier ensemble methods have shown outstanding performance on the discovery of instances that are significantly different from the majority of the data. However, without the awareness of fairness, their applicability in the ethical…

Machine Learning · Computer Science 2021-03-18 Haoyu Liu , Fenglong Ma , Shibo He , Jiming Chen , Jing Gao

The problem of outlier detection is extremely challenging in many domains such as text, in which the attribute values are typically non-negative, and most values are zero. In such cases, it often becomes difficult to separate the outliers…

Information Retrieval · Computer Science 2017-01-06 Ramakrishnan Kannan , Hyenkyun Woo , Charu C. Aggarwal , Haesun Park

A key feature of out-of-distribution (OOD) detection is to exploit a trained neural network by extracting statistical patterns and relationships through the multi-layer classifier to detect shifts in the expected input data distribution.…

Machine Learning · Computer Science 2023-06-07 Eduardo Dadalto , Pierre Colombo , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

It is crucial to detect when an instance lies downright too far from the training samples for the machine learning model to be trusted, a challenge known as out-of-distribution (OOD) detection. For neural networks, one approach to this task…

The presence of outliers is prevalent in machine learning applications and may produce misleading results. In this paper a new method for dealing with outliers and anomal samples is proposed. To overcome the outlier issue, the proposed…

Machine Learning · Computer Science 2016-07-05 Parsa Bagherzadeh , Hadi Sadoghi Yazdi

Outlier detection (OD), distinguishing inliers and outliers in completely unlabeled datasets, plays a vital role in science and engineering. Although there have been many insightful OD methods, most of them require troublesome…

Machine Learning · Computer Science 2026-03-17 Dazhi Fu , Jicong Fan

The problem of universal outlying sequence detection is studied, where the goal is to detect outlying sequences among $M$ sequences of samples. A sequence is considered as outlying if the observations therein are generated by a distribution…

Information Theory · Computer Science 2020-05-27 Yuheng Bu , Shaofeng Zou , Venugopal V. Veeravalli

The HDoutliers algorithm is a powerful unsupervised algorithm for detecting anomalies in high-dimensional data, with a strong theoretical foundation. However, it suffers from some limitations that significantly hinder its performance level,…

Machine Learning · Statistics 2019-08-13 Priyanga Dilini Talagala , Rob J. Hyndman , Kate Smith-Miles

Data depth is an efficient tool for robustly summarizing the distribution of functional data and detecting potential magnitude and shape outliers. Commonly used functional data depth notions, such as the modified band depth and extremal…

Methodology · Statistics 2023-11-07 Cristian F. Jimenez-Varon , Fouzi Harrou , Ying Sun

Outlier detection plays a significant role in various real world applications such as intrusion, malfunction, and fraud detection. Traditionally, outlier detection techniques are applied to find outliers in the context of the whole dataset.…

Databases · Computer Science 2021-03-10 Masoumeh Shafieinejad , Florian Kerschbaum , Ihab F. Ilyas

We define outliers as a set of observations which contradicts the proposed mathematical (statistical) model and we discuss the frequently observed types of the outliers. Further we explore what changes in the model have to be made in order…

Probability · Mathematics 2017-01-25 Lev B. Klebanov , Jaromir Antoch , Andrea Karlova , Ashot V. Kakosyan

Pattern mining is one of the most well-studied subfields in exploratory data analysis. While there is a significant amount of literature on how to discover and rank itemsets efficiently from binary data, there is surprisingly little…

Data Structures and Algorithms · Computer Science 2019-02-05 Nikolaj Tatti