English
Related papers

Related papers: Real-time outlier detection for large datasets by …

200 papers

Detecting abrupt changes in data distribution is one of the most significant tasks in streaming data analysis. Although many unsupervised Change-Point Detection (CPD) methods have been proposed recently to identify those changes, they still…

Machine Learning · Computer Science 2024-04-26 Yang Cao , Ye Zhu , Kai Ming Ting , Flora D. Salim , Hong Xian Li , Luxing Yang , Gang Li

Neural networks are known to produce over-confident predictions on input images, even when these images are out-of-distribution (OOD) samples. This limits the applications of neural network models in real-world scenarios, where OOD samples…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Ke Fan , Yikai Wang , Qian Yu , Da Li , Yanwei Fu

Modern data collecting methods and computation tools have made it possible to monitor high-dimensional processes. In this article, Phase II monitoring of high-dimensional processes is investigated when the available number of samples…

Methodology · Statistics 2023-01-24 Mohsen Ebadi , Shojaeddin Chenouri , Stefan H. Steiner

Real-time detection of out-of-context LLM outputs is crucial for enterprises looking to safely adopt RAG applications. In this work, we train lightweight models to discriminate LLM-generated text that is semantically out-of-context from…

Computation and Language · Computer Science 2024-11-07 Ian Poey , Jiajun Liu , Qishuai Zhong , Adrien Chenailler

Out-of-distribution (OOD) detection is essential for ensuring the robustness of machine learning models by identifying samples that deviate from the training distribution. While traditional OOD detection has primarily focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Shawn Li , Huixian Gong , Hao Dong , Tiankai Yang , Zhengzhong Tu , Yue Zhao

This paper introduces a fast algorithm for randomized computation of a low-rank Dynamic Mode Decomposition (DMD) of a matrix. Here we consider this matrix to represent the development of a spatial grid through time e.g. data from a static…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 N. Benjamin Erichson , Carl Donovan

In data analysis, contamination caused by outliers is inevitable, and robust statistical methods are strongly demanded. In this paper, our concern is to develop a new approach for robust data analysis based on scoring rules. The scoring…

Statistics Theory · Mathematics 2013-11-22 Takafumi Kanamori , Hironori Fujisawa

In a cyber-physical system such as an autonomous vehicle (AV), machine learning (ML) models can be used to navigate and identify objects that may interfere with the vehicle's operation. However, ML models are unlikely to make accurate…

Robotics · Computer Science 2022-11-22 Michael Yuhas , Arvind Easwaran

Out-of-distribution (OOD) detection is essential to prevent anomalous inputs from causing a model to fail during deployment. While improved OOD detection methods have emerged, they often rely on the final layer outputs and require a full…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Ziqian Lin , Sreya Dutta Roy , Yixuan Li

Cyber-physical systems (CPS) greatly benefit by using machine learning components that can handle the uncertainty and variability of the real-world. Typical components such as deep neural networks, however, introduce new types of hazards…

Machine Learning · Computer Science 2020-01-29 Feiyang Cai , Xenofon Koutsoukos

This paper presents a novel evaluation framework for Out-of-Distribution (OOD) detection that aims to assess the performance of machine learning models in more realistic settings. We observed that the real-world requirements for testing OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Vahid Reza Khazaie , Anthony Wong , Mohammad Sabokrou

We consider a problem of linear model selection in the presence of both continuous and categorical predictors. Feasible models consist of subsets of numerical variables and partitions of levels of factors. A new algorithm called delete or…

Applications · Statistics 2015-12-22 Aleksandra Maj-Kańska , Piotr Pokarowski , Agnieszka Prochenka

Distributional drift detection is important in medical applications as it helps ensure the accuracy and reliability of models by identifying changes in the underlying data distribution that could affect the prediction results of machine…

Image and Video Processing · Electrical Eng. & Systems 2025-05-12 Yusen Wu , Phuong Nguyen , Rose Yesha , Yelena Yesha

Detection of Out-of-Distribution (OOD) samples in real time is a crucial safety check for deployment of machine learning models in the medical field. Despite a growing number of uncertainty quantification techniques, there is a lack of…

Machine Learning · Computer Science 2022-05-09 Karina Zadorozhny , Patrick Thoral , Paul Elbers , Giovanni Cinà

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Anomaly detection (AD) plays a vital role across a wide range of real-world domains by identifying data instances that deviate from expected patterns, potentially signaling critical events such as system failures, fraudulent activities, or…

Machine Learning · Computer Science 2025-07-11 Amirhossein Sadough , Mahyar Shahsavari , Mark Wijtvliet , Marcel van Gerven

The recent, counter-intuitive discovery that deep generative models (DGMs) can frequently assign a higher likelihood to outliers has implications for both outlier detection applications as well as our overall understanding of generative…

Machine Learning · Statistics 2020-10-27 Ziyu Wang , Bin Dai , David Wipf , Jun Zhu

Neural networks often make overconfident predictions from out-of-distribution (OOD) samples. Detection of OOD data is therefore crucial to improve the safety of machine learning. The simplest and most powerful method for OOD detection is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Hikaru Shijo , Yutaka Yoshihama , Kenichi Yadani , Norifumi Murata

We propose an anomaly detection method for multi-variate scientific data based on analysis of high-order joint moments. Using kurtosis as a reliable measure of outliers, we suggest that principal kurtosis vectors, by analogy to principal…

Computational Physics · Physics 2019-05-01 Konduri Aditya , Hemanth Kolla , W. Philip Kegelmeyer , Timothy M. Shead , Julia Ling , Warren L. Davis

Approximate joint diagonalization of a set of matrices provides a powerful framework for numerous statistical signal processing applications. For non-unitary joint diagonalization (NUJD) based on the least-squares (LS) criterion, outliers,…

Signal Processing · Electrical Eng. & Systems 2021-07-14 Wenjuan Liu , Dazheng Feng , Bingnan Pei , Mengdao Xing , Xinhong Meng , Qianru Wei
‹ Prev 1 8 9 10 Next ›