English
Related papers

Related papers: Real-time outlier detection for large datasets by …

200 papers

Internet traffic in the real world is susceptible to various external and internal factors which may abruptly change the normal traffic flow. Those unexpected changes are considered outliers in traffic. However, deep sequence models have…

Machine Learning · Computer Science 2022-05-05 Sajal Saha , Anwar Haque , Greg Sidebottom

The common approaches to construct a data-driven linear power flow (DD-LPF) model cannot completely eliminate the adverse impacts of outliers in a training dataset. In this letter, a novel outlier-immune DD-LPF model construction method via…

Systems and Control · Electrical Eng. & Systems 2023-12-27 Guoan Yan , Zhengshuo Li

In this paper, we present a novel approach that combines deep metric learning and synthetic data generation using diffusion models for out-of-distribution (OOD) detection. One popular approach for OOD detection is outlier exposure, where…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Assefa Seyoum Wahd

We propose a new method for computing Dynamic Mode Decomposition (DMD) evolution matrices, which we use to analyze dynamical systems. Unlike the majority of existing methods, our approach is based on a variational formulation consisting of…

Numerical Analysis · Mathematics 2019-05-24 Omri Azencot , Wotao Yin , Andrea Bertozzi

Rate-distortion theory-based outlier detection builds upon the rationale that a good data compression will encode outliers with unique symbols. Based on this rationale, we propose Cluster Purging, which is an extension of clustering-based…

Machine Learning · Computer Science 2023-02-23 Maximilian B. Toller , Bernhard C. Geiger , Roman Kern

The problem of outlier detection is extremely challenging in many domains such as text, in which the attribute values are typically non-negative, and most values are zero. In such cases, it often becomes difficult to separate the outliers…

Information Retrieval · Computer Science 2017-01-06 Ramakrishnan Kannan , Hyenkyun Woo , Charu C. Aggarwal , Haesun Park

With the advancement of Industry 4.0, intelligent manufacturing extensively employs sensors for real-time multidimensional data collection, playing a crucial role in equipment monitoring, process optimisation, and efficiency enhancement.…

Machine Learning · Computer Science 2025-03-18 Huajie Liang , Di Wang , Yuchao Lu , Mengke Song , Lei Liu , Ling An , Ying Liang , Xingjie Ma , Zhenyu Zhang , Chichun Zhou

Today's deep models are often unable to detect inputs which do not belong to the training distribution. This gives rise to confident incorrect predictions which could lead to devastating consequences in many important application fields…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Matej Grcić , Petra Bevandić , Siniša Šegvić

The recent detection transformer (DETR) has advanced object detection, but its application on resource-constrained devices requires massive computation and memory resources. Quantization stands out as a solution by representing the network…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Sheng Xu , Yanjing Li , Mingbao Lin , Peng Gao , Guodong Guo , Jinhu Lu , Baochang Zhang

This paper develops a robust dynamic mode decomposition (RDMD) method endowed with statistical and numerical robustness. Statistical robustness ensures estimation efficiency at the Gaussian and non-Gaussian probability distributions,…

Methodology · Statistics 2022-07-08 Amir Hossein Abolmasoumi , Marcos Netto , Lamine Mili

An outlier-resistance phase retrieval algorithm based on alternating direction method of multipliers (ADMM) is devised in this letter. Instead of the widely used least squares criterion that is only optimal for Gaussian noise environment,…

Information Theory · Computer Science 2017-02-22 Xue Jiang , H. C. So , X. Liu

Impulsed noise outliers are data points that differs significantly from other observations.They are generally removed from the data set through local regression or Kalman filter algorithm.However, these methods, or their generalizations,…

Methodology · Statistics 2022-08-02 Bertrand Cloez , Bénédicte Fontez , Eliel González García , Isabelle Sanchez

Given a dataset an outlier can be defined as an observation that it is unlikely to follow the statistical properties of the majority of the data. Computation of the location estimate of is fundamental in data analysis, and it is well known…

Statistics Theory · Mathematics 2015-11-16 G. Zioutas , C. Chatzinakos , T. D. Nguyen , L. Pitsoulis

In this work, we revisit outlier hypothesis testing and propose exponentially consistent, low-complexity fixed-length tests that achieve a better tradeoff between detection performance and computational complexity than existing…

Signal Processing · Electrical Eng. & Systems 2026-01-28 Lina Zhu , Lin Zhou

In Maples et al. (2018) we introduced Robust Chauvenet Outlier Rejection, or RCR, a novel outlier rejection technique that evolves Chauvenet's Criterion by sequentially applying different measures of central tendency and empirically…

Computation · Statistics 2023-01-20 Nicholas Konz , Daniel E. Reichart

Outlier detection is critical in real applications to prevent financial fraud, defend network intrusions, or detecting imminent device failures. To reduce the human effort in evaluating outlier detection results and effectively turn the…

Machine Learning · Computer Science 2023-09-04 Yu Wang , Lei Cao , Yizhou Yan , Samuel Madden

In distributed machine learning, a central node outsources computationally expensive calculations to external worker nodes. The properties of optimization procedures like stochastic gradient descent (SGD) can be leveraged to mitigate the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-19 Maximilian Egger , Serge Kas Hanna , Rawad Bitar

As Artificial Intelligence models, such as Large Video-Language models (VLMs), grow in size, their deployment in real-world applications becomes increasingly challenging due to hardware limitations and computational costs. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Timothy Wei , Hsien Xin Peng , Elaine Xu , Bryan Zhao , Lei Ding , Diji Yang

Real-world data deviating from the independent and identically distributed (i.i.d.) assumption of in-distribution training data poses security threats to deep networks, thus advancing out-of-distribution (OOD) detection algorithms.…

Computation and Language · Computer Science 2024-10-31 Yiming Wang , Pei Zhang , Baosong Yang , Derek F. Wong , Zhuosheng Zhang , Rui Wang

Outlier detection refers to the identification of data points that deviate from a general data distribution. Existing unsupervised approaches often suffer from high computational cost, complex hyperparameter tuning, and limited…

Machine Learning · Computer Science 2022-08-26 Zheng Li , Yue Zhao , Xiyang Hu , Nicola Botta , Cezar Ionescu , George H. Chen