English
Related papers

Related papers: Frequency Estimation in Data Streams: Learning the…

200 papers

This paper considers the constrained sampling multi-stream quickest change detection problem, also known as the bandit quickest change detection problem. One stream contains a change-point that shifts its mean by an unknown amount. The goal…

Systems and Control · Electrical Eng. & Systems 2026-03-30 Joshua Kartzman , Calvin Hawkins , Matthew Hale

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

We introduce a novel network-adaptive algorithm that is suitable for alleviating network packet losses for low-latency interactive communications between a source and a destination. Our network-adaptive algorithm estimates in real-time the…

Networking and Internet Architecture · Computer Science 2020-06-30 Salma Emara , Silas L. Fong , Baochun Li , Ashish Khisti , Wai-Tian Tan , Xiaoqing Zhu , John Apostolopoulos

The Basic Counting problem [1] is one of the most fundamental and critical streaming problems of sliding window queries over data streams. Given a stream of 0's and 1's, the purpose of this problem is to estimate the number of 1's in the…

Data Structures and Algorithms · Computer Science 2019-12-10 Shuhao Sun , Dagang Li

Real-time computation of data streams over affordable virtualized infrastructure resources is an important form of data in motion processing architecture. However, processing such data streams while ensuring strict guarantees on quality of…

Most density based stream clustering algorithms separate the clustering process into an online and offline component. Exact summarized statistics are being employed for defining micro-clusters or grid cells during the online stage followed…

Databases · Computer Science 2016-12-09 Andrei Sorin Sabau

We study estimation problems in safety-critical applications with streaming data. Since estimation problems can be posed as optimization problems in the probability space, we devise a stochastic projected Wasserstein gradient flow that…

Systems and Control · Electrical Eng. & Systems 2023-04-07 Nicolas Lanzetti , Efe C. Balta , Dominic Liao-McPherson , Florian Dörfler

In some applications of frequency estimation, it is challenging to sample at as high as the Nyquist rate due to hardware limitations. An effective solution is to use multiple sub-Nyquist channels with coprime undersampling ratios to jointly…

Information Theory · Computer Science 2017-05-26 Shan Huang , Haijian Zhang , Hong Sun , Lei Yu

The quickest change detection problem is considered in the context of monitoring large-scale independent normal distributed data streams with possible changes in some of the means. It is assumed that for each individual local data stream,…

Statistics Theory · Mathematics 2016-03-18 Yuan Wang , Yajun Mei

Kernel density estimation is a simple and effective method that lies at the heart of many important machine learning applications. Unfortunately, kernel methods scale poorly for large, high dimensional datasets. Approximate kernel density…

Data Structures and Algorithms · Computer Science 2019-12-06 Benjamin Coleman , Anshumali Shrivastava

The estimation of the frequencies of multiple superimposed exponentials in noise is an important research problem due to its various applications from engineering to chemistry. In this paper, we propose an efficient and accurate algorithm…

Numerical Analysis · Mathematics 2016-05-05 Shanglin Ye , Elias Aboutanios

Modern technological advances have expanded the scope of applications requiring analysis of large-scale datastreams that comprise multiple indefinitely long time series. There is an acute need for statistical methodologies that perform…

Methodology · Statistics 2021-11-03 Jingshen Wang , Lilun Du , Changliang Zou , Zhenke Wu

A streaming algorithm to compute the spectral proper orthogonal decomposition (SPOD) of stationary random processes is presented. As new data becomes available, an incremental update of the truncated eigenbasis of the estimated…

Fluid Dynamics · Physics 2019-01-14 Oliver T. Schmidt , Aaron Towne

Detecting frequent elements is among the oldest and most-studied problems in the area of data streams. Given a stream of $m$ data items in $\{1, 2, \dots, n\}$, the objective is to output items that appear at least $d$ times, for some…

Data Structures and Algorithms · Computer Science 2021-02-16 Christian Konrad

In this paper, we propose a fully distributed algorithm for frequency offsets estimation in decentralized systems. With the proposed algorithm, each node estimates its frequency offsets by local computations and limited exchange of…

Information Theory · Computer Science 2016-07-12 Jian Du , Yik-Chung Wu

Problems involving the efficient arrangement of simple objects, as captured by bin packing and makespan scheduling, are fundamental tasks in combinatorial optimization. These are well understood in the traditional online and offline cases,…

Data Structures and Algorithms · Computer Science 2026-01-27 Graham Cormode , Pavel Veselý

This study tackles the challenge of efficiently classifying streaming data in envi-ronments with limited memory and computational resources. It delves into the application of data distillation as an innovative approach to improve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Rwad Khatib , Yehudit Aperstein

In a typical multi-standard military communication receiver, fast and reliable spectrum sensing unit is required to extract the information of multiple channels (frequency bands) present in a wideband input signal. In this paper, an energy…

Information Theory · Computer Science 2016-08-16 S. J. Darak , A. P. Vinod , E. M-K. Lai

The challenges of graph stream algorithms are twofold. First, each edge needs to be processed only once, and second, it needs to work on highly constrained memory. Diffusion degree is a measure of node centrality that can be calculated (for…

Data Structures and Algorithms · Computer Science 2024-02-01 Vinit Ramesh Gore , Suman Kundu , Anggy Eka Pratiwi

The use of in-situ digital sensors for water quality monitoring is becoming increasingly common worldwide. While these sensors provide near real-time data for science, the data are prone to technical anomalies that can undermine the…