English
Related papers

Related papers: Quantifying Outlierness of Funds from their Catego…

200 papers

We propose two new outlier detection methods, for identifying and classifying different types of outliers in (big) functional data sets. The proposed methods are based on an existing method called Massive Unsupervised Outlier Detection…

Methodology · Statistics 2021-10-15 Oluwasegun Taiwo Ojo , Antonio Fernández Anta , Rosa E. Lillo , Carlo Sguera

Often the challenge associated with tasks like fraud and spam detection is the lack of all likely patterns needed to train suitable supervised learning models. This problem accentuates when the fraudulent patterns are not only scarce, they…

Machine Learning · Computer Science 2019-05-08 Utkarsh Porwal , Smruthi Mukund

The task of outlier detection is to find small groups of data objects that are exceptional when compared with rest large amount of data. Detection of such outliers is important for many applications such as fraud detection and customer…

Databases · Computer Science 2007-05-23 Zengyou He , Xiaofei Xu , Shengchun Deng

The isolation forest algorithm for outlier detection exploits a simple yet effective observation: if taking some multivariate data and making uniformly random cuts across the feature space recursively, it will take fewer such random cuts…

Machine Learning · Statistics 2021-11-24 David Cortes

Isolation forest or "iForest" is an intuitive and widely used algorithm for anomaly detection that follows a simple yet effective idea: in a given data distribution, if a threshold (split point) is selected uniformly at random within the…

Machine Learning · Statistics 2021-12-07 David Cortes

A trained ML model is deployed on another `test' dataset where target feature values (labels) are unknown. Drift is distribution change between the training and deployment data, which is concerning if model performance changes. For a…

Applications · Statistics 2022-09-07 Samuel Ackerman , Eitan Farchi , Orna Raz , Marcel Zalmanovici , Parijat Dube

We develop techniques to quantify the degree to which a given (training or testing) example is an outlier in the underlying distribution. We evaluate five methods to score examples in a dataset by how well-represented the examples are, for…

Machine Learning · Computer Science 2019-10-30 Nicholas Carlini , Úlfar Erlingsson , Nicolas Papernot

This study introduces the Misclassification Likelihood Matrix (MLM) as a novel tool for quantifying the reliability of neural network predictions under distribution shifts. The MLM is obtained by leveraging softmax outputs and clustering…

In this paper, we consider two types of robust models of the $k$-median/$k$-means problems: the outlier-version ($k$-MedO/$k$-MeaO) and the penalty-version ($k$-MedP/$k$-MeaP), in which we can mark some points as outliers and discard them.…

Data Structures and Algorithms · Computer Science 2021-01-01 Yishui Wang , Rolf H. Möhring , Chenchen Wu , Dachuan Xu , Dongmei Zhang

Clustering and outlier detection are two important tasks in data mining. Outliers frequently interfere with clustering algorithms to determine the similarity between objects, resulting in unreliable clustering results. Currently, only a few…

Machine Learning · Computer Science 2024-12-10 Qi Li , Shuliang Wang

In this paper, we define probabilistic measures for venture portfolio performance based on individual outlier probability for each investment and the dependence across investments. This work is inspired by loan portfolio modeling against…

Computational Engineering, Finance, and Science · Computer Science 2026-02-10 Kensei Sakamoto , Hasan Ugur Koyluoglu , Fuat Alican , Yigit Ihlamur

Anomaly detection in real-world scenarios poses challenges due to dynamic and often unknown anomaly distributions, requiring robust methods that operate under an open-world assumption. This challenge is exacerbated in practical settings,…

Machine Learning · Computer Science 2024-04-24 Dayananda Herurkar , Sebastian Palacio , Ahmed Anwar , Joern Hees , Andreas Dengel

In a network meta-analysis, some of the collected studies may deviate markedly from the others, for example having very unusual effect sizes. These deviating studies can be regarded as outlying with respect to the rest of the network and…

Methodology · Statistics 2023-01-11 Silvia Metelli , Dimitris Mavridis , Perrine Créquit , Anna Chaimani

Financial literature consists of ample research on similarity and comparison of financial assets and securities such as stocks, bonds, mutual funds, etc. However, going beyond correlations or aggregate statistics has been arduous since…

Computational Finance · Quantitative Finance 2022-10-27 Jerinsh Jeyapaulraj , Dhruv Desai , Peter Chu , Dhagash Mehta , Stefano Pasquali , Philip Sommer

Clustering problems are well-studied in a variety of fields such as data science, operations research, and computer science. Such problems include variants of centre location problems, $k$-median, and $k$-means to name a few. In some cases,…

Data Structures and Algorithms · Computer Science 2017-07-17 Zachary Friggstad , Kamyar Khodamoradi , Mohsen Rezapour , Mohammad R. Salavatipour

Standard classification theory assumes that the distribution of images in the test and training sets are identical. Unfortunately, real-life scenarios typically feature unseen data (``out-of-distribution data") which is different from data…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Gianluca Barone , Aashrit Cunchala , Rudy Nunez

It is crucial to detect when an instance lies downright too far from the training samples for the machine learning model to be trusted, a challenge known as out-of-distribution (OOD) detection. For neural networks, one approach to this task…

With the rise of machine learning and deep learning based applications in practice, monitoring, i.e. verifying that these operate within specification, has become an important practical problem. An important aspect of this monitoring is to…

Machine Learning · Computer Science 2021-06-29 Thomas Viehmann

Outlier detection is one of the most important processes taken to create good, reliable data in machine learning. The most methods of outlier detection leverage an auxiliary reconstruction task by assuming that outliers are more difficult…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Ning Huyan , Dou Quan , Xiangrong Zhang , Xuefeng Liang , Jocelyn Chanussot , Licheng Jiao

Machine learning methods must be trusted to make appropriate decisions in real-world environments, even when faced with out-of-distribution (OOD) samples. Many current approaches simply aim to detect OOD examples and alert the user when an…

Machine Learning · Computer Science 2022-09-13 Randolph Linderman , Jingyang Zhang , Nathan Inkawhich , Hai Li , Yiran Chen