English
Related papers

Related papers: Fast Memory-efficient Anomaly Detection in Streami…

200 papers

In this paper we introduce a notion of planarity for graphs that are presented in a streaming fashion. A $\textit{streamed graph}$ is a stream of edges $e_1,e_2,...,e_m$ on a vertex set $V$. A streamed graph is $\omega$-$\textit{stream…

Data Structures and Algorithms · Computer Science 2015-01-29 Giordano Da Lozzo , Ignaz Rutter

Real-time detection of anomalies in streaming data is receiving increasing attention as it allows us to raise alerts, predict faults, and detect intrusions or threats across industries. Yet, little attention has been given to compare the…

Big data problems frequently require processing datasets in a streaming fashion, either because all data are available at once but collectively are larger than available memory or because the data intrinsically arrive one data point at a…

Computation · Statistics 2018-08-08 Andrea Giovannucci , Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii

Cybersecurity systems are continuously producing a huge number of time-stamped events in the form of high-order tensors, such as {count; time, port, flow duration, packet size, . . . }, and so how can we detect anomalies/intrusions in real…

Machine Learning · Computer Science 2025-03-04 Kota Nakamura , Koki Kawabata , Shungo Tanaka , Yasuko Matsubara , Yasushi Sakurai

Cyber security is one of the most significant technical challenges in current times. Detecting adversarial activities, prevention of theft of intellectual properties and customer data is a high priority for corporations and government…

Databases · Computer Science 2015-03-04 Sutanay Choudhury , Lawrence Holder , George Chin , Khushbu Agarwal , John Feo

We study how to detect clusters in a graph defined by a stream of edges, without storing the entire graph. We extend the approach to dynamic graphs defined by the most recent edges of the stream and to several streams. The {\em content…

Logic in Computer Science · Computer Science 2018-12-27 Michel de Rougemont , Guillaume Vimont

With the widely used smart meters in the energy sector, anomaly detection becomes a crucial mean to study the unusual consumption behaviors of customers, and to discover unexpected events of using energy promptly. Detecting consumption…

Databases · Computer Science 2016-06-21 Xiufeng Liu , Per Sieverts Nielsen

A multitude of toxic online behaviors, ranging from network attacks to anonymous traffic and spam, have severely disrupted the smooth operation of networks. Due to the inherent sender-receiver nature of network behaviors, graph-based…

Machine Learning · Computer Science 2024-01-22 Ziqi Yuan , Haoyi Zhou , Tianyu Chen , Jianxin Li

Processing large-scale graphs, containing billions of entities, is critical across fields like bioinformatics, high-performance computing, navigation and route planning, among others. Efficient graph partitioning, which divides a graph into…

Data Structures and Algorithms · Computer Science 2024-10-11 Adil Chhabra , Florian Kurpicz , Christian Schulz , Dominik Schweisgut , Daniel Seemaier

Partitioning graphs into blocks of roughly equal size is widely used when processing large graphs. Currently there is a gap in the space of available partitioning algorithms. On the one hand, there are streaming algorithms that have been…

Data Structures and Algorithms · Computer Science 2021-12-23 Marcelo Fonseca Faraj , Christian Schulz

Dynamic graphs are extensively employed for detecting anomalous behavior in nodes within the Internet of Things (IoT). Graph generative models are often used to address the issue of imbalanced node categories in dynamic graphs.…

Robotics · Computer Science 2024-12-13 Munan Li , Xianshi Su , Runze Ma , Tongbang Jiang , Zijian Li , Tony Q. S. Quek

An important objective for analyzing real-world graphs is to achieve scalable performance on large, streaming graphs. A challenging and relevant example is the graph partition problem. As a combinatorial problem, graph partition is NP-hard,…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-10 Edward Kao , Vijay Gadepally , Michael Hurley , Michael Jones , Jeremy Kepner , Sanjeev Mohindra , Paul Monticciolo , Albert Reuther , Siddharth Samsi , William Song , Diane Staheli , Steven Smith

The challenge of estimating similarity between sets has been a significant concern in data science, finding diverse applications across various domains. However, previous approaches, such as MinHash, have predominantly centered around…

Data Structures and Algorithms · Computer Science 2024-05-31 Fenghao Dong , Yang He , Yutong Liang , Zirui Liu , Yuhan Wu , Peiqing Chen , Tong Yang

Complex networks have now become integral parts of modern information infrastructures. This paper proposes a user-centric method for detecting anomalies in heterogeneous information networks, in which nodes and/or edges might be from…

Social and Information Networks · Computer Science 2018-10-22 Vahid Ranjbar , Mostafa Salehi , Pegah Jandaghi , Mahdi Jalili

Online anomaly detection from a data stream is critical for the safety and security of many applications but is facing severe challenges due to complex and evolving data streams from IoT devices and cloud-based infrastructures.…

Machine Learning · Computer Science 2022-06-13 Susik Yoon , Youngjun Lee , Jae-Gil Lee , Byung Suk Lee

In the recent years, the scale of graph datasets has increased to such a degree that a single machine is not capable of efficiently processing large graphs. Thereby, efficient graph partitioning is necessary for those large graph…

Data Structures and Algorithms · Computer Science 2019-02-06 Md Anwarul kaium Patwary , Saurabh Garg , Byeong Kang

We present TRI\`EST, a suite of one-pass streaming algorithms to compute unbiased, low-variance, high-quality approximations of the global and local (i.e., incident to each vertex) number of triangles in a fully-dynamic graph represented as…

Data Structures and Algorithms · Computer Science 2016-06-29 Lorenzo De Stefani , Alessandro Epasto , Matteo Riondato , Eli Upfal

Nondominated sorting, also called Pareto Depth Analysis (PDA), is widely used in multi-objective optimization and has recently found important applications in multi-criteria anomaly detection. Recently, a partial differential equation (PDE)…

Machine Learning · Computer Science 2018-04-17 Bilal Abbasi , Jeff Calder , Adam M. Oberman

A streaming algorithm to compute the spectral proper orthogonal decomposition (SPOD) of stationary random processes is presented. As new data becomes available, an incremental update of the truncated eigenbasis of the estimated…

Fluid Dynamics · Physics 2019-01-14 Oliver T. Schmidt , Aaron Towne

Point clouds are increasingly important in intelligent applications, but frequent off-chip memory traffic in accelerators causes pipeline stalls and leads to high energy consumption. While conventional line buffer techniques can eliminate…

Hardware Architecture · Computer Science 2025-07-01 Yu Feng , Zheng Liu , Weikai Lin , Zihan Liu , Jingwen Leng , Minyi Guo , Zhezhi He , Jieru Zhao , Yuhao Zhu