English
Related papers

Related papers: Fast Bayesian Record Linkage for Streaming Data Co…

200 papers

The exponential growth of data storage demands has necessitated the evolution of hierarchical storage management strategies [1]. This study explores the application of streaming machine learning [3] to revolutionize data prefetching within…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-30 Chiyu Cheng , Chang Zhou , Yang Zhao , Jin Cao

Combining data from various sources empowers researchers to explore innovative questions, for example those raised by conducting healthcare monitoring studies. However, the lack of a unique identifier often poses challenges. Record linkage…

Methodology · Statistics 2025-09-16 Kayané Robach , Stéphanie L van der Pas , Mark A van de Wiel , Michel H Hof

Multiple-systems or capture-recapture estimation are common techniques for population size estimation, particularly in the quantitative study of human rights violations. These methods rely on multiple samples from the population, along with…

Methodology · Statistics 2018-12-27 Mauricio Sadinle

An underlying assumption in conventional multi-view learning algorithms is that all views can be simultaneously accessed. However, due to various factors when collecting and pre-processing data from different views, the streaming view…

Machine Learning · Statistics 2016-04-29 Chang Xu , Dacheng Tao , Chao Xu

Streaming data are increasingly present in real-world applications such as sensor measurements, satellite data feed, stock market, and financial data. The main characteristics of these applications are the online arrival of data…

Machine Learning · Computer Science 2020-07-01 Vinicius M. A. Souza , Denis M. dos Reis , Andre G. Maletzke , Gustavo E. A. P. A. Batista

Computing the matching statistics of patterns with respect to a text is a fundamental task in bioinformatics, but a formidable one when the text is a highly compressed genomic database. Bannai et al. gave an efficient solution for this…

Data Structures and Algorithms · Computer Science 2021-02-12 Christina Boucher , Travis Gagie , Tomohiro I , Dominik Köppl , Ben Langmead , Giovanni Manzini , Gonzalo Navarro , Alejandro Pacheco , Massimiliano Rossi

The challenge of estimating similarity between sets has been a significant concern in data science, finding diverse applications across various domains. However, previous approaches, such as MinHash, have predominantly centered around…

Data Structures and Algorithms · Computer Science 2024-05-31 Fenghao Dong , Yang He , Yutong Liang , Zirui Liu , Yuhan Wu , Peiqing Chen , Tong Yang

Traffic flow count data in networks arise in many applications, such as automobile or aviation transportation, certain directed social network contexts, and Internet studies. Using an example of Internet browser traffic flow through…

Methodology · Statistics 2022-06-07 Xi Chen , Kaoru Irie , David Banks , Robert Haslinger , Jewell Thomas , Mike West

Finite mixture models are frequently used to uncover latent structures in high-dimensional datasets (e.g.\ identifying clusters of patients in electronic health records). The inference of such structures can be performed in a Bayesian…

Pattern matching of streaming time series with lower latency under limited computing resource comes to a critical problem, especially as the growth of Industry 4.0 and Industry Internet of Things. However, against traditional single pattern…

Databases · Computer Science 2018-05-18 Rong Kang , Chen Wang , Peng Wang , Yuting Ding , Jianmin Wang

In today's world, we follow news which is distributed globally. Significant events are reported by different sources and in different languages. In this work, we address the problem of tracking of events in a large multilingual stream.…

Information Retrieval · Computer Science 2015-12-23 Jan Rupnik , Andrej Muhic , Gregor Leban , Primoz Skraba , Blaz Fortuna , Marko Grobelnik

Matching households and individuals across different databases poses challenges due to the lack of unique identifiers, typographical errors, and changes in attributes over time. Record linkage tools play a crucial role in overcoming these…

Applications · Statistics 2024-04-09 Thais Pacheco Menezes , Thomas Brendan Murphy , Michael Fop

Long-form document matching aims to judge the relevance between two documents and has been applied to various scenarios. Most existing works utilize hierarchical or long context models to process documents, which achieve coarse…

Information Retrieval · Computer Science 2024-12-25 Youchao Zhou , Heyan Huang , Zhijing Wu , Yuhang Liu , Xinglin Wang

This paper proposes an online visual multi-object tracking algorithm using a top-down Bayesian formulation that seamlessly integrates state estimation, track management, clutter rejection, occlusion and mis-detection handling into a single…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Du Yong Kim , Ba-Ngu Vo , Ba-Tuong Vo

While most work on evaluating machine learning (ML) models focuses on computing accuracy on batches of data, tracking accuracy alone in a streaming setting (i.e., unbounded, timestamp-ordered datasets) fails to appropriately identify when…

Machine Learning · Computer Science 2022-05-24 Shreya Shankar , Bernease Herman , Aditya G. Parameswaran

Recently, considerable research attention has been paid to network embedding, a popular approach to construct feature vectors of vertices. Due to the curse of dimensionality and sparsity in graphical datasets, this approach has become…

Machine Learning · Computer Science 2018-11-15 Xi Liu , Ping-Chun Hsieh , Nick Duffield , Rui Chen , Muhe Xie , Xidao Wen

Streaming graphs are drawing increasing attention in both academic and industrial communities as many graphs in real applications evolve over time. Continuous subgraph matching (shorted as CSM) aims to report the incremental matches of a…

Data Structures and Algorithms · Computer Science 2023-04-26 Rongjian Yang , Zhijie Zhang , Weiguo Zheng , Jeffery Xu Yu

We present statistical methods for big data arising from online analytical processing, where large amounts of data arrive in streams and require fast analysis without storage/access to the historical data. In particular, we develop…

Computation · Statistics 2018-06-13 Elizabeth D. Schifano , Jing Wu , Chun Wang , Jun Yan , Ming-Hui Chen

In large-scale applications including medical imaging, collocation differential equation solvers, and estimation with differential privacy, the underlying linear inverse problem can be reformulated as a streaming problem. In theory, the…

Numerical Analysis · Mathematics 2024-01-31 Nathaniel Pritchard , Vivak Patel

Frequency estimation in data streams is one of the classical problems in streaming algorithms. Following much research, there are now almost matching upper and lower bounds for the trade-off needed between the number of samples and the…

Computational Complexity · Computer Science 2023-01-16 Shachar Lovett , Jiapeng Zhang