English
Related papers

Related papers: Detecting Dataset Drift and Non-IID Sampling via k…

200 papers

Out-of-Distribution (OOD) detection is essential for the trustworthiness of AI systems. Methods using prior information (i.e., subspace-based methods) have shown effective performance by extracting information geometry to detect OOD data…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Kaiyu Guo , Zijian Wang , Tan Pan , Brian C. Lovell , Mahsa Baktashmotlagh

Data-driven methods have been widely used in network intrusion detection (NID) systems. However, there are currently a number of challenges derived from how the datasets are being collected. Most attack classes in network intrusion datasets…

Cryptography and Security · Computer Science 2020-09-17 Dylan Chou , Meng Jiang

Nearest neighbors is a successful and long-standing technique for anomaly detection. Significant progress has been recently achieved by self-supervised deep methods (e.g. RotNet). Self-supervised features however typically under-perform…

Machine Learning · Computer Science 2020-02-25 Liron Bergman , Niv Cohen , Yedid Hoshen

Machine learning methods such as deep neural networks (DNNs), despite their success across different domains, are known to often generate incorrect predictions with high confidence on inputs outside their training distribution. The…

Machine Learning · Computer Science 2022-01-10 Ramneet Kaur , Susmit Jha , Anirban Roy , Sangdon Park , Edgar Dobriban , Oleg Sokolsky , Insup Lee

This paper proposes a method for OOD detection. Questioning the premise of previous studies that ID and OOD samples are separated distinctly, we consider samples lying in the intermediate of the two and use them for training a network. We…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Engkarat Techapanurak , Anh-Chuong Dang , Takayuki Okatani

With massive data being generated daily and the ever-increasing interconnectivity of the world's Internet infrastructures, a machine learning based intrusion detection system (IDS) has become a vital component to protect our economic and…

Cryptography and Security · Computer Science 2021-08-20 Zachary Tauscher , Yushan Jiang , Kai Zhang , Jian Wang , Houbing Song

When learning from streaming data, a change in the data distribution, also known as concept drift, can render a previously-learned model inaccurate and require training a new model. We present an adaptive learning algorithm that extends…

Machine Learning · Computer Science 2020-08-04 Ashraf Tahmasbi , Ellango Jothimurugesan , Srikanta Tirthapura , Phillip B. Gibbons

Previously in 2014, we proposed the Nearest Descent (ND) method, capable of generating an efficient Graph, called the in-tree (IT). Due to some beautiful and effective features, this IT structure proves well suited for data clustering.…

Machine Learning · Statistics 2016-03-07 Teng Qiu , Yongjie Li

Adapting to drifting data streams is a significant challenge in online learning. Concept drift must be detected for effective model adaptation to evolving data properties. Concept drift can impact the data distribution entirely or…

Machine Learning · Computer Science 2023-12-12 Gabriel J. Aguiar , Alberto Cano

Deep neural networks (DNNs) enable innovative applications of machine learning like image recognition, machine translation, or malware detection. However, deep learning is often criticized for its lack of robustness in adversarial settings…

Machine Learning · Computer Science 2018-03-14 Nicolas Papernot , Patrick McDaniel

Many real-world applications adopt multi-label data streams as the need for algorithms to deal with rapidly changing data increases. Changes in data distribution, also known as concept drift, cause the existing classification models to…

Machine Learning · Computer Science 2022-02-02 Ege Berkay Gulcan , Fazli Can

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

There exists a large body of work on online drift detection with the goal of dynamically finding and maintaining changes in data streams. In this paper, we adopt a query-based approach to drift detection. Our approach relies on {\em a drift…

Data Structures and Algorithms · Computer Science 2016-05-16 Sofia Kleisarchaki , Sihem Amer-Yahia , Ahlame Douzal-Chouakria , Vassilis Christophides

Permutation entropy and its associated frameworks are remarkable examples of physics-inspired techniques adept at processing complex and extensive datasets. Despite substantial progress in developing and applying these tools, their use has…

Data Analysis, Statistics and Probability · Physics 2024-08-14 Leonardo G. J. M. Voltarelli , Arthur A. B. Pessa , Luciano Zunino , Rafael S. Zola , Ervin K. Lenzi , Matjaz Perc , Haroldo V. Ribeiro

As machine learning models increasingly replace traditional business logic in the production system, their lifecycle management is becoming a significant concern. Once deployed into production, the machine learning models are constantly…

Machine Learning · Computer Science 2022-11-24 Lorena Poenaru-Olaru , Luis Cruz , Arie van Deursen , Jan S. Rellermeyer

Learning from many real-world datasets is limited by a problem called the class imbalance problem. A dataset is imbalanced when one class (the majority class) has significantly more samples than the other class (the minority class). Such…

Machine Learning · Computer Science 2017-11-30 Soroush Saryazdi , Bahareh Nikpour , Hossein Nezamabadi-pour

We consider the problem of feature detection in the presence of clutter in spatial point processes. Classification methods have been developed in previous studies. Among these, Byers and Raftery (1998) models the observed Kth nearest…

Methodology · Statistics 2024-03-13 Nicoletta D'Angelo

In real-world applications, input data distributions are rarely static over a period of time, a phenomenon known as concept drift. Such concept drifts degrade the model's prediction performance, and therefore we require methods to overcome…

Machine Learning · Computer Science 2024-07-10 Christofer Fellicious , Sahib Julka , Lorenz Wendlinger , Michael Granitzer

Boundary point detection aims to outline the external contour structure of clusters and enhance the inter-cluster discrimination, thus bolstering the performance of the downstream classification and clustering tasks. However, existing…

Machine Learning · Computer Science 2025-02-26 Dehua Peng , Zhipeng Gui , Jie Gui , Huayi Wu

In recent years, we know that the interaction with images has increased. Image similarity involves fetching similar-looking images abiding by a given reference image. The target is to find out whether the image searched as a query can…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Sayan Nath , Nikhil Nayak