English
Related papers

Related papers: Measuring Independence of Datasets

200 papers

A streaming algorithm to compute the spectral proper orthogonal decomposition (SPOD) of stationary random processes is presented. As new data becomes available, an incremental update of the truncated eigenbasis of the estimated…

Fluid Dynamics · Physics 2019-01-14 Oliver T. Schmidt , Aaron Towne

We design and implement two single-pass semi-streaming algorithms for the maximum weight $k$-disjoint matching ($k$-DM) problem. Given an integer $k$, the $k$-DM problem is to find $k$ pairwise edge-disjoint matchings such that the sum of…

Data Structures and Algorithms · Computer Science 2024-07-09 S M Ferdous , Bhargav Samineni , Alex Pothen , Mahantesh Halappanavar , Bala Krishnamoorthy

We study the maximum geometric independent set and clique problems in the streaming model. Given a collection of geometric objects arriving in an insertion only stream, the aim is to find a subset such that all objects in the subset are…

Computational Geometry · Computer Science 2022-07-05 Sujoy Bhore , Fabian Klute , Jelle J. Oostveen

Statistical heterogeneity is a measure of how skewed the samples of a dataset are. It is a common problem in the study of differential privacy that the usage of a statistically heterogeneous dataset results in a significant loss of…

Machine Learning · Computer Science 2024-12-02 Mary Scott , Graham Cormode , Carsten Maple

In machine learning, the performance of a classifier depends on both the classifier model and the separability/complexity of datasets. To quantitatively measure the separability of datasets, we create an intrinsic measure -- the…

Machine Learning · Computer Science 2021-09-14 Shuyue Guan , Murray Loew

In this paper, we propose a novel framework that converts streaming algorithms for monotone submodular maximization into streaming algorithms for non-monotone submodular maximization. This reduction readily leads to the currently tightest…

Data Structures and Algorithms · Computer Science 2020-02-11 Ran Haba , Ehsan Kazemi , Moran Feldman , Amin Karbasi

We study how to release summary statistics on a data stream subject to the constraint of differential privacy. In particular, we focus on releasing the family of symmetric norms, which are invariant under sign-flips and coordinate-wise…

Data Structures and Algorithms · Computer Science 2023-07-11 Vladimir Braverman , Joel Manning , Zhiwei Steven Wu , Samson Zhou

A set of intervals is independent when the intervals are pairwise disjoint. In the interval selection problem we are given a set $\mathbb{I}$ of intervals and we want to find an independent subset of intervals of largest cardinality. Let…

Data Structures and Algorithms · Computer Science 2015-02-05 Sergio Cabello , Pablo Pérez-Lantero

We study the fundamental problem of frequency estimation under both privacy and communication constraints, where the data is distributed among $k$ parties. We consider two application scenarios: (1) one-shot, where the data is static and…

Cryptography and Security · Computer Science 2021-06-01 Ziyue Huang , Yuan Qiu , Ke Yi , Graham Cormode

A novel algorithm is introduced to improve estimations of daily streamflow time series at sites with incomplete records based on the concept of conditional independence in graphical models. The goal is to fill in gaps of historical data or…

Applications · Statistics 2020-04-07 German A. Villalba , Xu Liang , Yao Liang

The turnstile continual release model of differential privacy captures scenarios where a privacy-preserving real-time analysis is sought for a dataset evolving through additions and deletions. In typical applications of real-time data…

Data Structures and Algorithms · Computer Science 2025-05-30 Rachel Cummings , Alessandro Epasto , Jieming Mao , Tamalika Mukherjee , Tingting Ou , Peilin Zhong

Big data streams are possibly one of the most essential underlying notions. However, data streams are often challenging to handle owing to their rapid pace and limited information lifetime. It is difficult to collect and communicate stream…

Machine Learning · Computer Science 2022-03-03 Christos Karras , Aristeidis Karras , Spyros Sioutas

We present a differentially private mechanism to display statistics (e.g., the moving average) of a stream of real valued observations where the bound on each observation is either too conservative or unknown in advance. This is…

Cryptography and Security · Computer Science 2018-11-09 Victor Perrier , Hassan Jameel Asghar , Dali Kaafar

We resolve an open question of Jain, Raskhodnikova, Sivakumar, and Smith (ICML 2023) by exhibiting a problem separating differential privacy under continual observation in the oblivious and adaptive settings. The continual observation…

Cryptography and Security · Computer Science 2026-04-06 Mark Bun , Marco Gaboardi , Connor Wagaman

Big data problems frequently require processing datasets in a streaming fashion, either because all data are available at once but collectively are larger than available memory or because the data intrinsically arrive one data point at a…

Computation · Statistics 2018-08-08 Andrea Giovannucci , Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii

We present the first feasible method for sampling a dynamic data stream with deletions, where the sample consists of pairs $(k,C_k)$ of a value $k$ and its exact total count $C_k$. Our algorithms are for both Strict Turnstile data streams…

Data Structures and Algorithms · Computer Science 2012-09-26 Neta Barkay , Ely Porat , Bar Shalem

The past decade has witnessed many interesting algorithms for maintaining statistics over a data stream. This paper initiates a theoretical study of algorithms for monitoring distributed data streams over a time-based sliding window (which…

Data Structures and Algorithms · Computer Science 2010-02-03 Ho-Leung Chan , Tak-Wah Lam , Lap-Kei Lee , Hing-Fung Ting

We consider the problem of computing distance between a pattern of length $n$ and all $n$-length subwords of a text in the streaming model. In the streaming setting, only the Hamming distance ($L_0$) has been studied. It is known that…

Data Structures and Algorithms · Computer Science 2020-11-10 Tatiana Starikovskaya , Michal Svagerka , Przemysław Uznański

In the matroid center problem, which generalizes the $k$-center problem, we need to pick a set of centers that is an independent set of a matroid with rank $r$. We study this problem in streaming, where elements of the ground set arrive in…

Data Structures and Algorithms · Computer Science 2020-07-21 Sagar Kale

We introduce a new computational model for data streams: asymptotically exact streaming algorithms. These algorithms have an approximation ratio that tends to one as the length of the stream goes to infinity while the memory used by the…

Data Structures and Algorithms · Computer Science 2014-08-11 Marc Heinrich , Alexander Munteanu , Christian Sohler