English
Related papers

Related papers: In-stream Probabilistic Cardinality Estimation for…

200 papers

In everyday life, we often observe unusually frequent interactions among people before or during important events, e.g., people send/receive more greetings to/from their friends on holidays than regular days. We also observe that some…

Social and Information Networks · Computer Science 2017-08-31 Junzhou Zhao , Pinghui Wang , John C. S. Lui , Don Towsley , Xiaohong Guan

We consider streaming over a peer-to-peer network with homogeneous nodes in which a single source broadcasts a data stream to all the users in the system. Peers are allowed to enter or leave the system (adversarially) arbitrarily. Previous…

Networking and Internet Architecture · Computer Science 2014-07-09 Shaileshh Bojja Venkatakrishnan , Pramod Viswanath

Network-based clustering methods frequently require the number of communities to be specified \emph{a priori}. Moreover, most of the existing methods for estimating the number of communities assume the number of communities to be fixed and…

Methodology · Statistics 2022-01-14 Chetkar Jha , Mingyao Li , Ian Barnett

Stochastic computing is a paradigm in which logical operations are performed on randomly generated bit streams. Complex arithmetic operations can be executed by simple logic circuits, resulting in a much smaller area footprint compared to…

Emerging Technologies · Computer Science 2023-07-10 Yadu Kiran , Marc Riedel

Recently, there has been a surge of interest in incorporating neural networks into particle filters, e.g. differentiable particle filters, to perform joint sequential state estimation and model learning for non-linear non-Gaussian…

Machine Learning · Computer Science 2025-01-07 Xiongjie Chen , Yunpeng Li

Probabilistic cataloging (PCAT) outperforms traditional cataloging methods on single-band optical data in crowded fields (Portillo et al. 2017). We extend our work to multiple bands, achieving greater sensitivity ($\sim$ 0.4 mag) and…

Instrumentation and Methods for Astrophysics · Physics 2020-03-25 Richard M. Feder , Stephen K. N. Portillo , Tansu Daylan , Douglas Finkbeiner

In data stream applications, one of the critical issues is to estimate the frequency of each item in the specific multiset. The multiset means that each item in this set can appear multiple times. The data streams in many applications are…

Data Structures and Algorithms · Computer Science 2020-01-07 Ning Li

Maximizing submodular functions under cardinality constraints lies at the core of numerous data mining and machine learning applications, including data diversification, data summarization, and coverage problems. In this work, we study this…

Data Structures and Algorithms · Computer Science 2016-11-01 Alessandro Epasto , Silvio Lattanzi , Sergei Vassilvitskii , Morteza Zadimoghaddam

Cardinality potentials are a generally useful class of high order potential that affect probabilities based on how many of D binary variables are active. Maximum a posteriori (MAP) inference for cardinality potential models is…

Machine Learning · Computer Science 2012-10-19 Daniel Tarlow , Kevin Swersky , Richard S. Zemel , Ryan Prescott Adams , Brendan J. Frey

The task of detecting anomalous data patterns is as important in practical applications as challenging. In the context of spatial data, recognition of unexpected trajectories brings additional difficulties, such as high dimensionality and…

Random walks can be used to search a complex networks for a desired resource. To reduce the number of hops necessary to find the resource, we propose a search mechanism based on building random walks connecting together partial walks that…

Networking and Internet Architecture · Computer Science 2013-04-19 Víctor López Millán , Vicent Cholvi , Luis López , Antonio Fernández Anta

We develop a novel clustering method for distributional data, where each data point is regarded as a probability distribution on the real line. For distributional data, it has been challenging to develop a clustering method that utilizes…

Methodology · Statistics 2025-06-24 Ryo Okano , Masaaki Imaizumi

We present a novel approach for the problem of frequency estimation in data streams that is based on optimization and machine learning. Contrary to state-of-the-art streaming frequency estimation algorithms, which heavily rely on random…

Data Structures and Algorithms · Computer Science 2022-07-19 Dimitris Bertsimas , Vassilis Digalakis

Density peaks clustering (DP) has the ability of detecting clusters of arbitrary shape and clustering non-Euclidean space data, but its quadratic complexity in both computing and storage makes it difficult to scale for big data. Various…

Machine Learning · Computer Science 2024-06-19 Ji Xu , Tianlong Xiao , Jinye Yang , Panpan Zhu

Query optimizers rely on accurate cardinality estimation (CardEst) to produce good execution plans. The core problem of CardEst is how to model the rich joint distribution of attributes in an accurate and compact manner. Despite decades of…

Databases · Computer Science 2021-05-20 Rong Zhu , Ziniu Wu , Yuxing Han , Kai Zeng , Andreas Pfadler , Zhengping Qian , Jingren Zhou , Bin Cui

Bloom filters are used in query processing to perform early data reduction and improve query performance. The optimal query plan may be different when Bloom filters are used, indicating the need for Bloom filter-aware query optimization. To…

Databases · Computer Science 2025-05-07 Tim Zeyl , Qi Cheng , Reza Pournaghi , Jason Lam , Weicheng Wang , Calvin Wong , Chong Chen , Per-Ake Larson

Multi-target tracking (MTT) serves as a cornerstone technology in information fusion, yet faces significant challenges in robustness and efficiency when dealing with model uncertainties, clutter interference, and target interactions.…

Systems and Control · Electrical Eng. & Systems 2025-07-21 Ming Lei , Shufan Wu

This paper presents a novel high speed clustering scheme for high dimensional data streams. Data stream clustering has gained importance in different applications, for example, in network monitoring, intrusion detection, and real-time…

Databases · Computer Science 2015-10-13 Irshad Ahmed , Irfan Ahmed , Waseem Shahzad

Fast and accurate estimation of quantiles on data streams coming from communication networks, Internet of Things (IoT), and alike, is at the heart of important data processing applications including statistical analysis, latency monitoring,…

Data Structures and Algorithms · Computer Science 2025-06-13 Massimo Cafaro , Aneglo Coluccia , Italo Epicoco , Marco Pulimeno

Although many successful ensemble clustering approaches have been developed in recent years, there are still two limitations to most of the existing approaches. First, they mostly overlook the issue of uncertain links, which may mislead the…

Machine Learning · Statistics 2016-06-06 Dong Huang , Jian-Huang Lai , Chang-Dong Wang