English
Related papers

Related papers: Expected Similarity Estimation for Large-Scale Bat…

200 papers

Anomaly detection is one of the frequent and important subroutines deployed in large-scale data processing systems. Even being a well-studied topic, existing techniques for unsupervised anomaly detection require storing significant amounts…

Databases · Computer Science 2017-06-22 Chen Luo , Anshumali Shrivastava

In theory, Bayesian nonparametric (BNP) models are well suited to streaming data scenarios due to their ability to adapt model complexity with the observed data. Unfortunately, such benefits have not been fully realized in practice;…

Machine Learning · Statistics 2015-04-22 Alex Tank , Nicholas J. Foti , Emily B. Fox

We present a new fast online clustering algorithm that reliably recovers arbitrary-shaped data clusters in high throughout data streams. Unlike the existing state-of-the-art online clustering methods based on k-means or k-medoid, it does…

Artificial Intelligence · Computer Science 2015-06-11 Krzysztof Choromanski , Sanjiv Kumar , Xiaofeng Liu

The advances in deep neural networks (DNN) have significantly enhanced real-time detection of anomalous data in IoT applications. However, the complexity-accuracy-delay dilemma persists: complex DNN models offer higher accuracy, but typical…

Machine Learning · Computer Science 2021-08-21 Mao V. Ngo , Tie Luo , Tony Q. S. Quek

Existing high-dimensional online learning methods often face the challenge that their error bounds, or per-batch sample sizes, diverge as the number of data batches increases. To address this issue, we propose an asynchronous decomposition…

Machine Learning · Statistics 2026-03-24 Shixiang Liu , Zhifan Li , Hanming Yang , Jianxin Yin

With the dawn of the Big Data era, data sets are growing rapidly. Data is streaming from everywhere - from cameras, mobile phones, cars, and other electronic devices. Clustering streaming data is a very challenging problem. Unlike the…

Machine Learning · Computer Science 2019-02-08 Shlomo Bugdary , Shay Maymon

Anomaly detection when observing a large number of data streams is essential in a variety of applications, ranging from epidemiological studies to monitoring of complex systems. High-dimensional scenarios are usually tackled with…

Methodology · Statistics 2025-12-18 Ivo V. Stoepker , Rui M. Castro , Ery Arias-Castro , Edwin van den Heuvel

Identifying changes in the generative process of sequential data, known as changepoint detection, has become an increasingly important topic for a wide variety of fields. A recently developed approach, which we call EXact Online Bayesian…

Machine Learning · Statistics 2018-10-16 Michael Byrd , Linh Nghiem , Jing Cao

Ensuring the reliability of power electronic converters is a matter of great importance, and data-driven condition monitoring techniques are cementing themselves as an important tool for this purpose. However, translating methods that work…

Machine Learning · Computer Science 2024-02-28 Pere Izquierdo Gomez , Miguel E. Lopez Gajardo , Nenad Mijatovic , Tomislav Dragicevic

Detection of anomalies among a large number of processes is a fundamental task that has been studied in multiple research areas, with diverse applications spanning from spectrum access to cyber-security. Anomalous events are characterized…

Information Theory · Computer Science 2022-08-12 Benjamin Wolff , Tomer Gafni , Guy Revach , Nir Shlezinger , Kobi Cohen

Semi-supervised learning (SSL) methods assume that labeled data, unlabeled data and test data are from the same distribution. Open-set semi-supervised learning (Open-set SSL) considers a more practical scenario, where unlabeled data and…

Machine Learning · Computer Science 2024-04-16 Yang Yu , Danruo Deng , Furui Liu , Yueming Jin , Qi Dou , Guangyong Chen , Pheng-Ann Heng

We discover a theoretical connection between explanation estimation and distribution compression that significantly improves the approximation of feature attributions, importance, and effects. While the exact computation of various machine…

Machine Learning · Computer Science 2025-01-24 Hubert Baniecki , Giuseppe Casalicchio , Bernd Bischl , Przemyslaw Biecek

Detecting changes is of fundamental importance when analyzing data streams and has many applications, e.g., in predictive maintenance, fraud detection, or medicine. A principled approach to detect changes is to compare the distributions of…

Machine Learning · Computer Science 2025-02-13 Florian Kalinke , Marco Heyden , Georg Gntuni , Edouard Fouché , Klemens Böhm

Tracking and approximating data matrices in streaming fashion is a fundamental challenge. The problem requires more care and attention when data comes from multiple distributed sites, each receiving a stream of data. This paper considers…

Databases · Computer Science 2014-05-01 Mina Ghashami , Jeff M. Phillips , Feifei Li

By now, most outlier-detection algorithms struggle to accurately detect both point anomalies and cluster anomalies simultaneously. Furthermore, a few K-nearest-neighbor-based anomaly-detection methods exhibit excellent performance on many…

Information Theory · Computer Science 2025-06-06 Kaituo Zhang , Wei Huang , Bingyang Zhang , Jinshan Xu , Xuhua Yang

Big data problems frequently require processing datasets in a streaming fashion, either because all data are available at once but collectively are larger than available memory or because the data intrinsically arrive one data point at a…

Computation · Statistics 2018-08-08 Andrea Giovannucci , Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii

In this paper, we address the problem of learning compact similarity-preserving embeddings for massive high-dimensional streams of data in order to perform efficient similarity search. We present a new online method for computing binary…

Machine Learning · Computer Science 2018-02-12 Anne Morvan , Antoine Souloumiac , Cédric Gouy-Pailler , Jamal Atif

Anomaly detection plays a critical role in fraud detection, health care, intrusion detection, military surveillance, etc. Anomaly detection algorithm based on density estimation (called ADDE algorithm) is one of widely used algorithms.…

Quantum Physics · Physics 2022-08-17 Ming-Chao Guo , Hai-Ling Liu , Yong-Mei Li , Wen-Min Li , Su-Juan Qin , Qiao-Yan Wen , Fei Gao

Measuring similarity between two objects is the core operation in existing clustering algorithms in grouping similar objects into clusters. This paper introduces a new similarity measure called point-set kernel which computes the similarity…

Machine Learning · Computer Science 2022-01-07 Kai Ming Ting , Jonathan R. Wells , Ye Zhu

Clustering of event stream data is of great importance in many application scenarios, including but not limited to, e-commerce, electronic health, online testing, mobile music service, etc. Existing clustering algorithms fail to take…

Methodology · Statistics 2024-05-29 Yuecheng Zhang , Guanhua Fang , Wen Yu