中文
相关论文

相关论文: Real-time outlier detection for large datasets by …

200 篇论文

Internet traffic in the real world is susceptible to various external and internal factors which may abruptly change the normal traffic flow. Those unexpected changes are considered outliers in traffic. However, deep sequence models have…

机器学习 · 计算机科学 2022-05-05 Sajal Saha , Anwar Haque , Greg Sidebottom

The common approaches to construct a data-driven linear power flow (DD-LPF) model cannot completely eliminate the adverse impacts of outliers in a training dataset. In this letter, a novel outlier-immune DD-LPF model construction method via…

系统与控制 · 电气工程与系统科学 2023-12-27 Guoan Yan , Zhengshuo Li

In this paper, we present a novel approach that combines deep metric learning and synthetic data generation using diffusion models for out-of-distribution (OOD) detection. One popular approach for OOD detection is outlier exposure, where…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Assefa Seyoum Wahd

We propose a new method for computing Dynamic Mode Decomposition (DMD) evolution matrices, which we use to analyze dynamical systems. Unlike the majority of existing methods, our approach is based on a variational formulation consisting of…

数值分析 · 数学 2019-05-24 Omri Azencot , Wotao Yin , Andrea Bertozzi

Rate-distortion theory-based outlier detection builds upon the rationale that a good data compression will encode outliers with unique symbols. Based on this rationale, we propose Cluster Purging, which is an extension of clustering-based…

机器学习 · 计算机科学 2023-02-23 Maximilian B. Toller , Bernhard C. Geiger , Roman Kern

The problem of outlier detection is extremely challenging in many domains such as text, in which the attribute values are typically non-negative, and most values are zero. In such cases, it often becomes difficult to separate the outliers…

信息检索 · 计算机科学 2017-01-06 Ramakrishnan Kannan , Hyenkyun Woo , Charu C. Aggarwal , Haesun Park

With the advancement of Industry 4.0, intelligent manufacturing extensively employs sensors for real-time multidimensional data collection, playing a crucial role in equipment monitoring, process optimisation, and efficiency enhancement.…

机器学习 · 计算机科学 2025-03-18 Huajie Liang , Di Wang , Yuchao Lu , Mengke Song , Lei Liu , Ling An , Ying Liang , Xingjie Ma , Zhenyu Zhang , Chichun Zhou

Today's deep models are often unable to detect inputs which do not belong to the training distribution. This gives rise to confident incorrect predictions which could lead to devastating consequences in many important application fields…

计算机视觉与模式识别 · 计算机科学 2020-11-24 Matej Grcić , Petra Bevandić , Siniša Šegvić

The recent detection transformer (DETR) has advanced object detection, but its application on resource-constrained devices requires massive computation and memory resources. Quantization stands out as a solution by representing the network…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Sheng Xu , Yanjing Li , Mingbao Lin , Peng Gao , Guodong Guo , Jinhu Lu , Baochang Zhang

This paper develops a robust dynamic mode decomposition (RDMD) method endowed with statistical and numerical robustness. Statistical robustness ensures estimation efficiency at the Gaussian and non-Gaussian probability distributions,…

统计方法学 · 统计学 2022-07-08 Amir Hossein Abolmasoumi , Marcos Netto , Lamine Mili

An outlier-resistance phase retrieval algorithm based on alternating direction method of multipliers (ADMM) is devised in this letter. Instead of the widely used least squares criterion that is only optimal for Gaussian noise environment,…

信息论 · 计算机科学 2017-02-22 Xue Jiang , H. C. So , X. Liu

Impulsed noise outliers are data points that differs significantly from other observations.They are generally removed from the data set through local regression or Kalman filter algorithm.However, these methods, or their generalizations,…

统计方法学 · 统计学 2022-08-02 Bertrand Cloez , Bénédicte Fontez , Eliel González García , Isabelle Sanchez

Given a dataset an outlier can be defined as an observation that it is unlikely to follow the statistical properties of the majority of the data. Computation of the location estimate of is fundamental in data analysis, and it is well known…

统计理论 · 数学 2015-11-16 G. Zioutas , C. Chatzinakos , T. D. Nguyen , L. Pitsoulis

In this work, we revisit outlier hypothesis testing and propose exponentially consistent, low-complexity fixed-length tests that achieve a better tradeoff between detection performance and computational complexity than existing…

信号处理 · 电气工程与系统科学 2026-01-28 Lina Zhu , Lin Zhou

In Maples et al. (2018) we introduced Robust Chauvenet Outlier Rejection, or RCR, a novel outlier rejection technique that evolves Chauvenet's Criterion by sequentially applying different measures of central tendency and empirically…

统计计算 · 统计学 2023-01-20 Nicholas Konz , Daniel E. Reichart

Outlier detection is critical in real applications to prevent financial fraud, defend network intrusions, or detecting imminent device failures. To reduce the human effort in evaluating outlier detection results and effectively turn the…

机器学习 · 计算机科学 2023-09-04 Yu Wang , Lei Cao , Yizhou Yan , Samuel Madden

In distributed machine learning, a central node outsources computationally expensive calculations to external worker nodes. The properties of optimization procedures like stochastic gradient descent (SGD) can be leveraged to mitigate the…

分布式、并行与集群计算 · 计算机科学 2023-04-19 Maximilian Egger , Serge Kas Hanna , Rawad Bitar

As Artificial Intelligence models, such as Large Video-Language models (VLMs), grow in size, their deployment in real-world applications becomes increasingly challenging due to hardware limitations and computational costs. To address this,…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Timothy Wei , Hsien Xin Peng , Elaine Xu , Bryan Zhao , Lei Ding , Diji Yang

Real-world data deviating from the independent and identically distributed (i.i.d.) assumption of in-distribution training data poses security threats to deep networks, thus advancing out-of-distribution (OOD) detection algorithms.…

计算与语言 · 计算机科学 2024-10-31 Yiming Wang , Pei Zhang , Baosong Yang , Derek F. Wong , Zhuosheng Zhang , Rui Wang

Outlier detection refers to the identification of data points that deviate from a general data distribution. Existing unsupervised approaches often suffer from high computational cost, complex hyperparameter tuning, and limited…

机器学习 · 计算机科学 2022-08-26 Zheng Li , Yue Zhao , Xiyang Hu , Nicola Botta , Cezar Ionescu , George H. Chen