中文
相关论文

相关论文: Outlier Detection Techniques for SQL and ETL Tunin…

200 篇论文

The outlying property detection problem is the problem of discovering the properties distinguishing a given object, known in advance to be an outlier in a database, from the other database objects. In this paper, we analyze the problem…

机器学习 · 计算机科学 2013-06-18 Fabrizio Angiulli , Fabio Fassetti , Luigi Palopoli , Giuseppe Manco

Outlier detection is an important data mining task with numerous practical applications such as intrusion detection, credit card fraud detection, and video surveillance. However, given a specific complicated task with big data, the process…

机器学习 · 计算机科学 2020-06-23 Yuening Li , Zhengzhang Chen , Daochen Zha , Kaixiong Zhou , Haifeng Jin , Haifeng Chen , Xia Hu

A new technique for the detection of outliers in contingency tables is introduced. Outliers thereby are unexpected cell counts with respect to classical loglinear Poisson models. Subsets of cell counts called minimal patterns are defined,…

统计计算 · 统计学 2012-11-15 Sonja Kuhnt , Fabio Rapallo , André Rehage

Patterns that appear rarely or unusually in the data can be defined as outlier patterns. The basic idea behind detecting outlier patterns is comparison of their relative frequencies with frequent patterns. Their frequencies of appearance…

数据库 · 计算机科学 2015-07-08 Archana N. , S. S. Pawar

Advances in sensor technology have enabled the collection of large-scale datasets. Such datasets can be extremely noisy and often contain a significant amount of outliers that result from sensor malfunction or human operation faults. In…

机器学习 · 计算机科学 2018-08-28 Yu-Hsuan Kuo , Zhenhui Li , Daniel Kifer

LLMs are commonly used in retrieval-augmented applications to execute user instructions based on data from external sources. For example, modern search engines use LLMs to answer queries based on relevant search results; email plugins…

密码学与安全 · 计算机科学 2025-03-07 Sahar Abdelnabi , Aideen Fay , Giovanni Cherubin , Ahmed Salem , Mario Fritz , Andrew Paverd

The outlier detection problem in some cases is similar to the classification problem. For example, the main concern of clustering-based outlier detection algorithms is to find clusters and outliers, which are often regarded as noise that…

机器学习 · 计算机科学 2014-05-25 M. H. Marghny , Ahmed I. Taloba

Anomaly detection has many applications ranging from bank-fraud detection and cyber-threat detection to equipment maintenance and health monitoring. However, choosing a suitable algorithm for a given application remains a challenging design…

Business Process Management Systems (BPMS) log events and traces of activities during the execution of a process. Anomalies are defined as deviation or departure from the normal or common order. Anomaly detection in business process logs…

软件工程 · 计算机科学 2015-07-07 Ashish Sureka

Support Vector Machines have been successfully used for one-class classification (OCSVM, SVDD) when trained on clean data, but they work much worse on dirty data: outliers present in the training data tend to become support vectors, and are…

机器学习 · 计算机科学 2022-12-29 Daniel Boiar , Thomas Liebig , Erich Schubert

We leverage a streaming architecture based on ELK, Spark and Hadoop in order to collect, store, and analyse database connection logs in near real-time. The proposed system investigates outliers using unsupervised learning; widely adopted…

机器学习 · 计算机科学 2018-12-06 Swapneel Mehta , Prasanth Kothuri , Daniel Lanza Garcia

Out-of-distribution (OOD) detection is essential for the reliable and safe deployment of machine learning systems in the real world. Great progress has been made over the past years. This paper presents the first review of recent advances…

计算与语言 · 计算机科学 2023-12-29 Hao Lang , Yinhe Zheng , Yixuan Li , Jian Sun , Fei Huang , Yongbin Li

Out-of-distribution (OOD) detection is the task of identifying data sampled from distributions that were not used during training. This task is essential for reliable machine learning and a better understanding of their generalization…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Kohei Fukuda , Hiroaki Aizawa

Outlier detection plays an essential role in many data-driven applications to identify isolated instances that are different from the majority. While many statistical learning and data mining techniques have been used for developing more…

机器学习 · 计算机科学 2018-05-08 Ninghao Liu , Donghwa Shin , Xia Hu

Whether an extreme observation is an outlier or not, depends strongly on the corresponding tail behaviour of the underlying distribution. We develop an automatic, data-driven method to identify extreme tail behaviour that deviates from the…

统计方法学 · 统计学 2019-12-06 Shrijita Bhattacharya , Jan Beirlant

Most real-world IoT data analysis tasks, such as clustering and anomaly event detection, are unsupervised and highly susceptible to the presence of outliers. In addition to sporadic scattered outliers caused by factors such as faulty sensor…

机器学习 · 计算机科学 2026-03-16 Yiqun Zhang , Zexi Tan , Xiaopeng Luo , Yunlin Liu

The combination of the Internet of Things and the Edge Computing gives many opportunities to support innovative applications close to end users. Numerous devices present in both infrastructures can collect data upon which various processing…

分布式、并行与集群计算 · 计算机科学 2021-03-02 Kostas Kolomvatsos , Christos Anagnostopoulos

Anomaly detection algorithms are often thought to be limited because they don't facilitate the process of validating results performed by domain experts. In Contrast, deep learning algorithms for anomaly detection, such as autoencoders,…

机器学习 · 计算机科学 2020-07-02 Liat Antwarg , Ronnie Mindlin Miller , Bracha Shapira , Lior Rokach

The problem of detecting a novel class at run time is known as Open Set Detection & is important for various real-world applications like medical application, autonomous driving, etc. Open Set Detection within context of deep learning…

计算机视觉与模式识别 · 计算机科学 2022-11-04 Risheek Garrepalli

Outlier detection is a well-researched and crucial problem in machine learning. However, there is little research on string data outlier detection, as most literature focuses on outlier detection of numerical data. A robust string data…

机器学习 · 计算机科学 2026-03-13 Philip Maus