中文
相关论文

相关论文: Real-time outlier detection for large datasets by …

200 篇论文

Outlier detection is one of the most important processes taken to create good, reliable data in machine learning. The most methods of outlier detection leverage an auxiliary reconstruction task by assuming that outliers are more difficult…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Ning Huyan , Dou Quan , Xiangrong Zhang , Xuefeng Liang , Jocelyn Chanussot , Licheng Jiao

Coastal pollution is a pressing global environmental issue, necessitating scalable and automated solutions for monitoring and management. This study investigates the efficacy of the Real-Time Detection Transformer (RT-DETR), a…

计算机视觉与模式识别 · 计算机科学 2025-08-22 Miftahul Huda , Arsyiah Azahra , Putri Maulida Chairani , Dimas Rizky Ramadhani , Nabila Azhari , Ade Lailani

Time series data occurs widely, and outlier detection is a fundamental problem in data mining, which has numerous applications. Existing autoencoder-based approaches deliver state-of-the-art performance on challenging real-world data but…

机器学习 · 计算机科学 2022-04-08 Tung Kieu , Bin Yang , Chenjuan Guo , Christian S. Jensen , Yan Zhao , Feiteng Huang , Kai Zheng

Data cubes are multidimensional databases, often built from several separate databases, that serve as flexible basis for data analysis. Surprisingly, outlier detection on data cubes has not yet been treated extensively. In this work, we…

数据库 · 计算机科学 2023-03-16 Lara Kuhlmann , Daniel Wilmes , Emmanuel Müller , Markus Pauly , Daniel Horn

Continuous learning from an immense volume of data streams becomes exceptionally critical in the internet era. However, data streams often do not conform to the same distribution over time, leading to a phenomenon called concept drift.…

机器学习 · 计算机科学 2024-07-09 Ke Wan , Yi Liang , Susik Yoon

Restricted Boltzmann machines (RBMs) and their extensions, called 'deep-belief networks', are powerful neural networks that have found applications in the fields of machine learning and artificial intelligence. The standard way to training…

机器学习 · 计算机科学 2018-10-25 Haik Manukian , Fabio L. Traversa , Massimiliano Di Ventra

As language models become more general purpose, increased attention needs to be paid to detecting out-of-distribution (OOD) instances, i.e., those not belonging to any of the distributions seen during training. Existing methods for…

机器学习 · 计算机科学 2024-07-19 Aryan Gulati , Xingjian Dong , Carlos Hurtado , Sarath Shekkizhar , Swabha Swayamdipta , Antonio Ortega

Data pre-treatment plays a significant role in improving data quality, thus allowing extraction of accurate information from raw data. One of the data pre-treatment techniques commonly used is outliers detection. The so-called 3${\sigma}$…

应用统计 · 统计学 2021-06-29 Kamil Oster , Stefan Güttel , Jonathan L. Shapiro , Lu Chen , Megan Jobson

Outlier detection refers to the identification of anomalous samples that deviate significantly from the distribution of normal data and has been extensively studied and used in a variety of practical tasks. However, most unsupervised…

机器学习 · 计算机科学 2025-01-07 Can Gao , Xiaofeng Tan , Jie Zhou , Weiping Ding , Witold Pedrycz

The detection of anomalies in real time is paramount to maintain performance and efficiency across a wide range of applications including web services and smart manufacturing. This paper presents a novel algorithm to detect anomalies in…

信号处理 · 电气工程与系统科学 2020-07-22 Caitríona M. Ryan , Andrew Parnell , Catherine Mahoney

Principal Component Analysis (PCA) finds a linear mapping and maximizes the variance of the data which makes PCA sensitive to outliers and may cause wrong eigendirection. In this paper, we propose techniques to solve this problem; we use…

人工智能 · 计算机科学 2012-07-03 Peratham Wiriyathammabhum , Boonserm Kijsirikul

Out-of-Distribution (OOD) detection is essential for the trustworthiness of AI systems. Methods using prior information (i.e., subspace-based methods) have shown effective performance by extracting information geometry to detect OOD data…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Kaiyu Guo , Zijian Wang , Tan Pan , Brian C. Lovell , Mahsa Baktashmotlagh

The presence of outliers can prevent clustering algorithms from accurately determining an appropriate group structure within a data set. We present outlierMBC, a model-based approach for sequentially removing outliers and clustering the…

统计方法学 · 统计学 2025-06-30 Ultán P. Doherty , Paul D. McNicholas , Arthur White

Outlier detection can serve as an extremely important tool for researchers from a wide range of fields. From the sectors of banking and marketing to the social sciences and healthcare sectors, outlier detection techniques are very useful…

统计方法学 · 统计学 2023-12-12 Efthymios Costa , Ioanna Papatsouma

Deep neural networks (DNNs) perform well at classifying inputs associated with the classes they have been trained on, which are known as in distribution inputs. However, out-of-distribution (OOD) inputs pose a great challenge to DNNs and…

机器学习 · 计算机科学 2021-02-24 Guy Amit , Moshe Levy , Ishai Rosenberg , Asaf Shabtai , Yuval Elovici

Additive manufacturing (AM), also known as 3D printing, is one of the most promising digital manufacturing technologies, thanks to its potential to produce highly complex geometries rapidly. AM has been promoted from a prototyping…

应用统计 · 统计学 2021-10-22 Ahmad Mozaffari , Shojaeddin Chenouri , Ehsan Toyserkani , Usman Ali

Out-of-distribution (OOD) detection aims to detect test samples that do not fall into any training in-distribution (ID) classes. Prior efforts focus on regularizing models with ID data only, largely underperforming counterparts that utilize…

机器学习 · 计算机科学 2025-05-20 Puning Yang , Jian Liang , Jie Cao , Ran He

This paper introduces a novel family of outlier detection algorithms based on Cluster Catch Digraphs (CCDs), specifically tailored to address the challenges of high dimensionality and varying cluster shapes, which deteriorate the…

机器学习 · 统计学 2024-10-10 Rui Shi , Nedret Billor , Elvan Ceyhan

Extracting the underlying trend signal is a crucial step to facilitate time series analysis like forecasting and anomaly detection. Besides noise signal, time series can contain not only outliers but also abrupt trend changes in real-world…

机器学习 · 计算机科学 2019-06-28 Qingsong Wen , Jingkun Gao , Xiaomin Song , Liang Sun , Jian Tan

Despite computation becomes much complex on data with an unprecedented scale, we argue computers or smart devices should and will consistently provide information and knowledge to human being in the order of a few tens milliseconds. We coin…

性能 · 计算机科学 2017-03-09 Gang Lu , Jianfeng Zhan , Tianshu Hao , Lei Wang