English
Related papers

Related papers: Flattened Exponential Histogram for Sliding Window…

200 papers

We presented an efficient algorithm, fast adaptive flat-histogram ensemble (FAFE), to estimate the density of states (DOS) and to enhance sampling in large systems. FAFE calculates the means of an arbitrary extensive variable $U$ in…

Statistical Mechanics · Physics 2008-11-13 Xin Zhou , Yi Jiang

We propose skewed stable random projections for approximating the pth frequency moments of dynamic data streams (0<p<=2), which has been frequently studied in theoretical computer science and database communities. Our method significantly…

Data Structures and Algorithms · Computer Science 2008-02-07 Ping Li

Detecting heavy hitters, which are flows exceeding a specified threshold, is crucial for network measurement, but it faces challenges due to increasing throughput and memory constraints. Existing sketch-based solutions, particularly those…

Networking and Internet Architecture · Computer Science 2024-08-26 Xilai Liu , Xinyi Zhang , Bingqing Liu , Tao Li , Tong Yang , Gaogang Xie

We present FQN (Fast $Q_n$), a novel algorithm for fast detection of outliers in data streams. The algorithm works in the sliding window model, checking if an item is an outlier by cleverly computing the $Q_n$ scale estimator in the current…

Data Structures and Algorithms · Computer Science 2020-01-10 Massimo Cafaro , Catiuscia Melle , Marco Pulimeno , Italo Epicoco

Counters are a fundamental building block for networking applications such as load balancing, traffic engineering, and intrusion detection, which require estimating flow sizes and identifying heavy hitter flows. Existing works suggest…

Data Structures and Algorithms · Computer Science 2020-04-23 Ran Ben Basat , Gil Einziger , Michael Mitzenmacher , Shay Vargaftik

Indexing of static and dynamic sets is fundamental to a large set of applications such as information retrieval and caching. Denoting the characteristic vector of the set by B, we consider the problem of encoding sets and multisets to…

Data Structures and Algorithms · Computer Science 2018-09-17 Ran Ben Basat , Seungbum Jo , Srinivasa Rao Satti , Shubham Ugare

In the sliding window model, we are required to maintain the target statistics over the most recent $n$ elements of a data stream, which is captured by a window of size $n$ sliding over the data stream. Exact computation usually requires…

Data Structures and Algorithms · Computer Science 2026-04-28 Ryo Suzuki , Yutaro Yamaguchi

We extend the multi-pass streaming model to sliding window problems, and address the problem of computing order statistics on fixed-size sliding windows, in the multi-pass streaming model as well as the closely related communication…

Data Structures and Algorithms · Computer Science 2018-07-13 Dhruv Rohatgi

Several challenging problem in clustering, partitioning and imaging have traditionally been solved using the "spectral technique". These problems include the normalized cut problem, the graph expander ratio problem, the Cheeger constant…

Optimization and Control · Mathematics 2016-10-14 Dorit S. Hochbaum

In this paper, we explore the problem of event-based meshflow estimation, a novel task that involves predicting a spatially smooth sparse motion field from event cameras. To start, we review the state-of-the-art in event-based flow…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xinglong Luo , Ao Luo , Kunming Luo , Zhengning Wang , Ping Tan , Bing Zeng , Shuaicheng Liu

This article proposes an efficient Bayesian inference for piecewise exponential hazard (PEH) models, which allow the effect of a covariate on the survival time to vary over time. The proposed inference methodology is based on a particle…

Computation · Statistics 2020-04-01 Parfait Munezero

Estimating frequencies of items over data streams is a common building block in streaming data measurement and analysis. Misra and Gries introduced their seminal algorithm for the problem in 1982, and the problem has since been revisited…

Data Structures and Algorithms · Computer Science 2017-05-23 Daniel Anderson , Pryce Bevan , Kevin Lang , Edo Liberty , Lee Rhodes , Justin Thaler

\begin{abstract} The frequencies of the elements in a data stream are an important statistical measure and the task of estimating them arises in many applications within data analysis and machine learning. Two of the most popular algorithms…

Data Structures and Algorithms · Computer Science 2020-08-12 Anders Aamand , Piotr Indyk , Ali Vakilian

Multi-Head Attention (MHA) is a critical computational kernel in transformer-based AI models. Emerging scalable tile-based accelerator architectures integrate increasing numbers of tightly-packed processing elements (PEs) with tensor units.…

Hardware Architecture · Computer Science 2025-05-27 Chi Zhang , Luca Colagrande , Renzo Andri , Thomas Benz , Gamze Islamoglu , Alessandro Nadalini , Francesco Conti , Yawei Li , Luca Benini

Large, distributed data streams are now ubiquitous. High-accuracy sketches with low memory overhead have become the de facto method for analyzing this data. For instance, if we wish to group data by some label and report the largest counts…

Data Structures and Algorithms · Computer Science 2024-02-14 Homin K. Lee , Charles Masson

Crowd counting based on density maps is generally regarded as a regression task.Deep learning is used to learn the mapping between image content and crowd density distribution. Although great success has been achieved, some pedestrians far…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Jiwei Chen , Kewei Wang , Wen Su , Zengfu Wang

As the application of deep learning continues to grow, so does the amount of data used to make predictions. While traditionally, big-data deep learning was constrained by computing performance and off-chip memory bandwidth, a new constraint…

Cryptography and Security · Computer Science 2020-10-12 Brandon Reagen , Wooseok Choi , Yeongil Ko , Vincent Lee , Gu-Yeon Wei , Hsien-Hsin S. Lee , David Brooks

Handling haphazard streaming data, such as data from edge devices, presents a challenging problem. Over time, the incoming data becomes inconsistent, with missing, faulty, or new inputs reappearing. Therefore, it requires models that are…

Machine Learning · Computer Science 2024-12-31 Himanshu Buckchash , Momojit Biswas , Rohit Agarwal , Dilip K. Prasad

Counting is among the most fundamental operations in computing. For example, counting the pth frequency moment has been a very active area of research, in theoretical computer science, databases, and data mining. When p=1, the task (i.e.,…

Information Theory · Computer Science 2008-02-24 Ping Li

Estimating cardinality, i.e., the number of distinct elements, of a data stream is a fundamental problem in areas like databases, computer networks, and information retrieval. This study delves into a broader scenario where each element…

Databases · Computer Science 2024-06-28 Yiyan Qi , Rundong Li , Pinghui Wang , Yufang Sun , Rui Xing