中文
相关论文

相关论文: Real-time outlier detection for large datasets by …

200 篇论文

Advances in sensor technology have enabled the collection of large-scale datasets. Such datasets can be extremely noisy and often contain a significant amount of outliers that result from sensor malfunction or human operation faults. In…

机器学习 · 计算机科学 2018-08-28 Yu-Hsuan Kuo , Zhenhui Li , Daniel Kifer

This paper evaluates algorithms for classification and outlier detection accuracies in temporal data. We focus on algorithms that train and classify rapidly and can be used for systems that need to incorporate new data regularly. Hence, we…

机器学习 · 统计学 2018-05-03 Victoria J. Hodge , Jim Austin

Reliable outlier detection in high-dimensional data is crucial in modern science, yet it remains a challenging task. Traditional methods often break down in these settings due to their reliance on asymptotic behaviors with respect to sample…

统计方法学 · 统计学 2025-11-05 Seong-ho Lee , Yongho Jeon

Distance-based outlier detection is widely adopted in many fields, e.g., data mining and machine learning, because it is unsupervised, can be employed in a generic metric space, and does not have any assumptions of data distributions. Data…

数据库 · 计算机科学 2021-10-22 Daichi Amagata , Makoto Onizuka , Takahiro Hara

This work introduces the Matrix Minimum Covariance Determinant (MMCD) method, a novel robust location and covariance estimation procedure designed for data that are naturally represented in the form of a matrix. Unlike standard robust…

统计方法学 · 统计学 2025-03-17 Marcus Mayrhofer , Una Radojičić , Peter Filzmoser

High-dimensional data poses unique challenges in outlier detection process. Most of the existing algorithms fail to properly address the issues stemming from a large number of features. In particular, outlier detection algorithms perform…

机器学习 · 计算机科学 2020-09-22 Firuz Kamalov , Ho Hon Leung

In many machine learning tasks, a common approach for dealing with large-scale data is to build a small summary, {\em e.g.,} coreset, that can efficiently represent the original input. However, real-world datasets usually contain outliers…

机器学习 · 计算机科学 2022-01-24 Zixiu Wang , Yiwen Guo , Hu Ding

Often the challenge associated with tasks like fraud and spam detection[1] is the lack of all likely patterns needed to train suitable supervised learning models. In order to overcome this limitation, such tasks are attempted as outlier or…

机器学习 · 计算机科学 2018-08-22 Utkarsh Porwal , Smruthi Mukund

In this work, we address the problem of outlier detection for robust motion estimation by using modern sparse-low-rank decompositions, i.e., Robust PCA-like methods, to impose global rank constraints. Robust decompositions have shown to be…

计算机视觉与模式识别 · 计算机科学 2014-10-23 German Ros , Jose Alvarez , Julio Guerrero

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

机器学习 · 计算机科学 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

Out-of-distribution (OOD) detection is crucial for ensuring reliable deployment of machine learning models. Recent advancements focus on utilizing easily accessible auxiliary outliers (e.g., data from the web or other datasets) in training.…

机器学习 · 计算机科学 2024-11-22 Haiyun Yao , Zongbo Han , Huazhu Fu , Xi Peng , Qinghua Hu , Changqing Zhang

Outliers widely occur in big-data applications and may severely affect statistical estimation and inference. In this paper, a framework of outlier-resistant estimation is introduced to robustify an arbitrarily given loss function. It has a…

统计方法学 · 统计学 2023-04-20 Yiyuan She , Zhifeng Wang , Jiahui Shen

The task of outlier detection is to find small groups of data objects that are exceptional when compared with rest large amount of data. Detection of such outliers is important for many applications such as fraud detection and customer…

数据库 · 计算机科学 2007-05-23 Zengyou He , Xiaofei Xu , Shengchun Deng

Outlier detection is an integral part of robust evaluation for crowdsourceable Quality of Experience (QoE) and has attracted much attention in recent years. In QoE for multimedia, outliers happen because of different test conditions, human…

多媒体 · 计算机科学 2014-10-23 Qianqian Xu , Ming Yan , Yuan Yao

The outlier detection problem in some cases is similar to the classification problem. For example, the main concern of clustering-based outlier detection algorithms is to find clusters and outliers, which are often regarded as noise that…

机器学习 · 计算机科学 2014-05-25 M. H. Marghny , Ahmed I. Taloba

Outlier detection has gained increasing interest in recent years, due to newly emerging technologies and the huge amount of high-dimensional data that are now available. Outlier detection can help practitioners to identify unwanted noise…

统计理论 · 数学 2021-05-20 Mads Lindskou , Torben Tvedebrink , Poul Svante Eriksen , Niels Morling

Outlier recognition is a fundamental problem in data analysis and has attracted a great deal of attention in the past decades. However, most existing methods still suffer from several issues such as high time and space complexities or…

计算几何 · 计算机科学 2019-04-09 Hu Ding , Mingquan Ye

Large-scale distributed model training requires simultaneous training on up to thousands of machines. Faulty machine detection is critical when an unexpected fault occurs in a machine. From our experience, a training task can encounter two…

分布式、并行与集群计算 · 计算机科学 2025-04-29 Yangtao Deng , Xiang Shi , Zhuo Jiang , Xingjian Zhang , Lei Zhang , Zhang Zhang , Bo Li , Zuquan Song , Hang Zhu , Gaohong Liu , Fuliang Li , Shuguang Wang , Haibin Lin , Jianxi Ye , Minlan Yu

Weighted Outlier Detection is a method for identifying unusual or anomalous data points in a dataset, which can be caused by various factors like human error, fraud, or equipment malfunctions. Detecting outliers can reveal vital information…

机器学习 · 计算机科学 2023-06-13 Ravindrakumar Purohit , Jai Prakash Verma , Rachna Jain , Madhuri Bhavsar

Anomaly detection methods are part of the systems where rare events may endanger an operation's profitability, safety, and environmental aspects. Although many state-of-the-art anomaly detection methods were developed to date, their…

机器学习 · 计算机科学 2023-02-01 Marek Wadinger , Michal Kvasnica