English
Related papers

Related papers: Anomaly Detection in Hierarchical Data Streams und…

200 papers

Anomaly detection is a branch of data analysis and machine learning which aims at identifying observations that exhibit abnormal behaviour. Be it measurement errors, disease development, severe weather, production quality default(s) (items)…

Machine Learning · Statistics 2024-07-11 Pavlo Mozharovskyi , Romain Valla

Analysis of an organization's computer network activity is a key component of early detection and mitigation of insider threat, a growing concern for many organizations. Raw system logs are a prototypical example of streaming data that can…

Neural and Evolutionary Computing · Computer Science 2017-12-19 Aaron Tuor , Samuel Kaplan , Brian Hutchinson , Nicole Nichols , Sean Robinson

Labeling data correctly is an expensive and challenging task in machine learning, especially for on-line data streams. Deep learning models especially require a large number of clean labeled data that is very difficult to acquire in…

Machine Learning · Computer Science 2020-10-28 Taraneh Younesian , Dick Epema , Lydia Y. Chen

One of the significant problems of streaming data classification is the occurrence of concept drift, consisting of the change of probabilistic characteristics of the classification task. This phenomenon destabilizes the performance of the…

Machine Learning · Computer Science 2021-12-21 Michał Woźniak , Paweł Zyblewski , Paweł Ksieniewicz

Online active learning is a paradigm in machine learning that aims to select the most informative data points to label from a data stream. The problem of minimizing the cost associated with collecting labeled observations has gained a lot…

Machine Learning · Statistics 2023-12-01 Davide Cacciarelli , Murat Kulahci

An anomaly detection method based on deep autoencoders is proposed to address anomalies that often occur in enterprise-level ETL data streams. The study first analyzes multiple types of anomalies in ETL processes, including delays, missing…

Machine Learning · Computer Science 2025-11-04 Xin Chen , Saili Uday Gadgil , Kangning Gao , Yi Hu , Cong Nie

State-of-the-art machine learning models require access to significant amount of annotated data in order to achieve the desired level of performance. While unlabelled data can be largely available and even abundant, annotation process can…

Machine Learning · Computer Science 2020-10-15 Rahaf Aljundi , Nikolay Chumerin , Daniel Olmeda Reino

Network operators are generally aware of common attack vectors that they defend against. For most networks the vast majority of traffic is legitimate. However new attack vectors are continually designed and attempted by bad actors which…

Machine Learning · Computer Science 2019-04-03 Amir Ziai

Data mining offers a diverse toolbox for extracting meaningful structures from complex datasets, with anomaly detection emerging as a critical subfield particularly in the context of streaming or real-time data. Within anomaly detection,…

Machine Learning · Computer Science 2025-05-14 Adam Ulrich , Jan Krňávek , Roman Šenkeřík , Zuzana Komínková Oplatková , Radek Vala

We present a novel approach for the problem of frequency estimation in data streams that is based on optimization and machine learning. Contrary to state-of-the-art streaming frequency estimation algorithms, which heavily rely on random…

Data Structures and Algorithms · Computer Science 2022-07-19 Dimitris Bertsimas , Vassilis Digalakis

In this work, we propose a new, fast and scalable method for anomaly detection in large time-evolving graphs. It may be a static graph with dynamic node attributes (e.g. time-series), or a graph evolving in time, such as a temporal network.…

Social and Information Networks · Computer Science 2019-01-29 Volodymyr Miz , Benjamin Ricaud , Kirell Benzi , Pierre Vandergheynst

Recognising human activities from streaming videos poses unique challenges to learning algorithms: predictive models need to be scalable, incrementally trainable, and must remain bounded in size even when the data stream is arbitrarily…

Machine Learning · Statistics 2016-10-06 Rocco De Rosa , Ilaria Gori , Fabio Cuzzolin , Barbara Caputo , Nicolò Cesa-Bianchi

Detection of anomalous situations for complex mission-critical systems hold paramount importance when their service continuity needs to be ensured. A major challenge in detecting anomalies from the operational data arises due to the…

Machine Learning · Computer Science 2025-05-20 Shanay Mehta , Shlok Mehendale , Nicole Fernandes , Jyotirmoy Sarkar , Santonu Sarkar , Snehanshu Saha

Decision tree learning is a widely used approach in machine learning, favoured in applications that require concise and interpretable models. Heuristic methods are traditionally used to quickly produce models with reasonably high accuracy.…

For data sets populated by a very well modeled process and by another process of unknown probability density function (PDF), a desired feature when manipulating the fraction of the unknown process (either for enhancing it or suppressing it)…

Machine Learning · Statistics 2017-04-05 Pietro Vischia , Tommaso Dorigo

The advances in deep neural networks (DNN) have significantly enhanced real-time detection of anomalous data in IoT applications. However, the complexity-accuracy-delay dilemma persists: complex DNN models offer higher accuracy, but typical…

Machine Learning · Computer Science 2021-08-21 Mao V. Ngo , Tie Luo , Tony Q. S. Quek

The ability to detect weak distributed activation patterns in networks is critical to several applications, such as identifying the onset of anomalous activity or incipient congestion in the Internet, or faint traces of a biochemical spread…

Information Theory · Computer Science 2010-03-02 Aarti Singh , Robert D. Nowak , Robert Calderbank

Much of the worlds data is streaming, time-series data, where anomalies give significant information in critical situations. Yet detecting anomalies in streaming data is a difficult task, requiring detectors to process data in real-time,…

Artificial Intelligence · Computer Science 2016-07-11 Subutai Ahmad , Scott Purdy

Data is often generated in streams, with new observations arriving over time. A key challenge for learning models from data streams is capturing relevant information while keeping computational costs manageable. We explore intelligent data…

Machine Learning · Computer Science 2025-12-23 Benedetta Lavinia Mussati , Freddie Bickford Smith , Tom Rainforth , Stephen Roberts

Advances in deep neural networks (DNN) greatly bolster real-time detection of anomalous IoT data. However, IoT devices can barely afford complex DNN models due to limited computational power and energy supply. While one can offload anomaly…

Machine Learning · Computer Science 2020-01-13 Mao V. Ngo , Hakima Chaouchi , Tie Luo , Tony Q. S. Quek