English
Related papers

Related papers: Distinct Sampling on Streaming Data with Near-Dupl…

200 papers

We generalize the continuous observation privacy setting from Dwork et al. '10 and Chan et al. '11 by allowing each event in a stream to be a subset of some (possibly unknown) universe of items. We design differentially private (DP)…

Data Structures and Algorithms · Computer Science 2022-01-06 Adrian Rivera Cardoso , Ryan Rogers

In the real world, data streams are ubiquitous -- think of network traffic or sensor data. Mining patterns, e.g., outliers or clusters, from such data must take place in real time. This is challenging because (1) streams often have high…

Machine Learning · Computer Science 2021-01-08 Edouard Fouché , Florian Kalinke , Klemens Böhm

To alleviate the reliance of deep neural networks on large-scale datasets, dataset distillation aims to generate compact, high-quality synthetic datasets that can achieve comparable performance to the original dataset. The integration of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Mingzhuo Li , Guang Li , Jiafeng Mao , Linfeng Ye , Takahiro Ogawa , Miki Haseyama

Low-tubal-rank tensor approximation has been proposed to analyze large-scale and multi-dimensional data. However, finding such an accurate approximation is challenging in the streaming setting, due to the limited computational resources. To…

Machine Learning · Computer Science 2021-08-24 Qianxin Yi , Chenhao Wang , Kaidong Wang , Yao Wang

We consider a streaming data model in which n sensors observe individual streams of data, presented in a turnstile model. Our goal is to analyze the singular value decomposition (SVD) of the matrix of data defined implicitly by the stream…

Information Theory · Computer Science 2012-11-05 Anna C. Gilbert , Jae Young Park , Michael B. Wakin

Data stream processing is an increasingly important topic due to the prevalence of smart devices and the demand for real-time analytics. Geo-distributed streaming systems, where cloud-based queries utilize data streams from multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-22 Joel Wolfrath , Abhishek Chandra

Detecting near duplicate images is fundamental to the content ecosystem of photo sharing web applications. However, such a task is challenging when involving a web-scale image corpus containing billions of images. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Andrey Gusev , Jiajing Xu

This work develops a parallelized algorithm to compute the dynamic mode decomposition (DMD) on a graphics processing unit using the streaming method of snapshots singular value decomposition. This allows the algorithm to operate efficiently…

Numerical Analysis · Mathematics 2016-12-26 Seth D. Pendergrass , J. Nathan Kutz , Steven L. Brunton

We propose and analyze a generalized splitting method to sample approximately from a distribution conditional on the occurrence of a rare event. This has important applications in a variety of contexts in operations research, engineering,…

Methodology · Statistics 2019-09-10 Zdravko I. Botev , Pierre L'Ecuyer

The rare-event sampling problem has long been the central limiting factor in molecular dynamics (MD), especially in biomolecular simulation. Recently, diffusion models such as BioEmu have emerged as powerful equilibrium samplers that…

Many real-world applications of flow-based generative models desire a diverse set of samples that cover multiple modes of the target distribution. However, the predominant approach for obtaining diverse sets is not sample-efficient, as it…

Machine Learning · Computer Science 2025-04-11 Mashrur M. Morshed , Vishnu Boddeti

Monitoring network traffic data to detect any hidden patterns of anomalies is a challenging and time-consuming task that requires high computing resources. To this end, an appropriate summarization technique is of great importance, where it…

Machine Learning · Computer Science 2021-12-21 Samira Ghodratnama , Mehrdad Zakershahrak , Fariborz Sobhanmanesh

We develop a new sampling method to estimate eigenvector centrality on incomplete networks. Our goal is to estimate this global centrality measure having at disposal a limited amount of data. This is the case in many real-world scenarios…

Social and Information Networks · Computer Science 2020-10-29 Nicolò Ruggeri , Caterina De Bacco

Distributed multi-party learning provides an effective approach for training a joint model with scattered data under legal and practical constraints. However, due to the quagmire of a skewed distribution of data labels across participants…

Machine Learning · Computer Science 2021-11-01 Maoguo Gong , Yuan Gao , Yue Wu , A. K. Qin

We introduce a novel generative model, the Discrete Distribution Networks (DDN), that approximates data distribution using hierarchical discrete distributions. We posit that since the features within a network inherently capture…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Lei Yang

A text stream is an ordered sequence of text documents generated over time. A massive amount of such text data is generated by online social platforms every day. Designing an algorithm for such text streams to extract useful information is…

Information Retrieval · Computer Science 2024-09-04 Jay Kumar

Sampling technique has become one of the recent research focuses in the graph-related fields. Most of the existing graph sampling algorithms tend to sample the high degree or low degree nodes in the complex networks because of the…

Social and Information Networks · Computer Science 2018-02-02 Junpeng Zhu , Hui Li , Mei Chen , Zhenyu Dai , Ming Zhu

Given a set of vectors $X = \{ x_1,\dots, x_n \} \subset \mathbb{R}^d$, the Euclidean max-cut problem asks to partition the vectors into two parts so as to maximize the sum of Euclidean distances which cross the partition. We design new…

Data Structures and Algorithms · Computer Science 2025-03-19 Nicolas Menand , Erik Waingarten

We present a numerically robust, computationally efficient approach for non-I.I.D. data stream sampling in federated client systems, where resources are limited and labeled data for local model adaptation is sparse and expensive. The…

Machine Learning · Computer Science 2024-09-02 Manuel Röder , Frank-Michael Schleif

Streaming computations on massive data sets are an attractive candidate for parallelization, particularly when they exhibit independence (and hence data parallelism) between items in the stream. However, some streaming computations are…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-16 Stephen Timcheck , Jeremy Buhler