English
Related papers

Related papers: Measuring Independence of Datasets

200 papers

In this thesis, we explore streaming algorithms for approximating constraint satisfaction problems (CSPs). The setup is roughly the following: A computer has limited memory space, sees a long "stream" of local constraints on a set of…

Data Structures and Algorithms · Computer Science 2023-04-14 Noah G. Singer

High dimensional random dynamical systems are ubiquitous, including -- but not limited to -- cyber-physical systems, daily return on different stocks of S&P 1500 and velocity profile of interacting particle systems around McKeanVlasov…

Statistics Theory · Mathematics 2023-10-17 Muhammad Abdullah Naeem , Amir Khazraei , Miroslav Pajic

We study the problem of partitioning integer sequences in the one-pass data streaming model. Given is an input stream of integers $X \in \{0, 1, \dots, m \}^n$ of length $n$ with maximum element $m$, and a parameter $p$. The goal is to…

Data Structures and Algorithms · Computer Science 2014-07-08 Christian Konrad , László Kozma

Fueled by massive data, important decision making is being automated with the help of algorithms, therefore, fairness in algorithms has become an especially important research topic. In this work, we design new streaming and distributed…

Data Structures and Algorithms · Computer Science 2020-02-25 Ashish Chiplunkar , Sagar Kale , Sivaramakrishnan Natarajan Ramamoorthy

We present data streaming algorithms for the $k$-median problem in high-dimensional dynamic geometric data streams, i.e. streams allowing both insertions and deletions of points from a discrete Euclidean space $\{1, 2, \ldots \Delta\}^d$.…

Data Structures and Algorithms · Computer Science 2017-06-14 Vladimir Braverman , Gereon Frahling , Harry Lang , Christian Sohler , Lin F. Yang

Data stream processing is an increasingly important topic due to the prevalence of smart devices and the demand for real-time analytics. Geo-distributed streaming systems, where cloud-based queries utilize data streams from multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-22 Joel Wolfrath , Abhishek Chandra

In recent years, the problem of computing the frequencies of the induced $k$-vertex subgraphs of a graph, or \emph{$k$-graphlets}, has become central. One approach for this problem is to sample $k$-graphlets randomly. Classic algorithms for…

Data Structures and Algorithms · Computer Science 2026-04-29 Marco Bressan , T-H. Hubert Chan , Qipeng Kuang , Mauro Sozio

The streaming model describes the mapping between real and redshift space for 2-point clustering statistics. Its key element is the probability density function (PDF) of line-of-sight pairwise peculiar velocities. Following a kinetic-theory…

Cosmology and Nongalactic Astrophysics · Physics 2018-07-24 Joseph Kuruvilla , Cristiano Porciani

A new computationally efficient dependence measure, and an adaptive statistical test of independence, are proposed. The dependence measure is the difference between analytic embeddings of the joint distribution and the product of the…

Machine Learning · Statistics 2016-10-18 Wittawat Jitkrittum , Zoltan Szabo , Arthur Gretton

A technique introduced by Indyk and Woodruff [STOC 2005] has inspired several recent advances in data-stream algorithms. We show that a number of these results follow easily from the application of a single probabilistic method called…

Data Structures and Algorithms · Computer Science 2011-04-26 Alexandr Andoni , Robert Krauthgamer , Krzysztof Onak

In the $k$-mismatch problem we are given a pattern of length $n$ and a text and must find all locations where the Hamming distance between the pattern and the text is at most $k$. A series of recent breakthroughs have resulted in an…

Data Structures and Algorithms · Computer Science 2021-06-22 Paweł Gawrychowski , Tatiana Starikovskaya

Besides the classical offline setup of machine learning, stream learning constitutes a well-established setup where data arrives over time in potentially non-stationary environments. Concept drift, the phenomenon that the underlying…

Machine Learning · Computer Science 2024-12-13 Fabian Hinder , Valerie Vaquet , David Komnick , Barbara Hammer

In this paper we consider the problem of finding a maximum weight set subject to a $k$-extendible constraint in the data stream model. The only non-trivial algorithm known for this problem to date---to the best of our knowledge---is a…

Data Structures and Algorithms · Computer Science 2019-06-12 Moran Feldman , Ran Haba

Extracting the valuable features and information in Big Data has become one of the important research issues in Data Science. In most Internet of Things (IoT) applications, the collected data are uncertain and imprecise due to sensor device…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-27 Chuan-Chi Lai , Tien-Chun Wang , Chuan-Ming Liu , Li-Chun Wang

Differential privacy is the state-of-the-art definition for privacy, guaranteeing that any analysis performed on a sensitive dataset leaks no information about the individuals whose data are contained therein. In this thesis, we develop…

Machine Learning · Computer Science 2023-11-29 Vassilis Digalakis

Test of independence plays a fundamental role in many statistical techniques. Among the nonparametric approaches, the distance-based methods (such as the distance correlation based hypotheses testing for independence) have numerous…

Methodology · Statistics 2017-01-24 Cheng Huang , Xiaoming Huo

We present a streaming algorithm for the vertex connectivity problem in dynamic streams with a (nearly) optimal space bound: for any $n$-vertex graph $G$ and any integer $k \geq 1$, our algorithm with high probability outputs whether or not…

Data Structures and Algorithms · Computer Science 2022-11-10 Sepehr Assadi , Vihan Shah

Internet of Things (IoT) Analytics often involves applying machine learning (ML) models on data streams. In such scenarios, traditional ML paradigms face obstacles related to continuous learning while dealing with concept drifts, temporal…

Machine Learning · Computer Science 2026-03-11 Federico Giannini , Emanuele Della Valle

Stream stochastic gradient descent (SGD) is a simple and efficient method for solving online optimization problems in operations research (OR), where data is generated by parameter-dependent Markov chains. Unlike traditional approaches…

Optimization and Control · Mathematics 2025-09-03 Xiang Li , Jiadong Liang , Xinyun Chen , Zhihua Zhang

The efficient estimation of frequency moments of a data stream in one-pass using limited space and time per item is one of the most fundamental problem in data stream processing. An especially important estimation is to find the number of…

Data Structures and Algorithms · Computer Science 2010-10-29 Gokarna Sharma , Costas Busch , Srikanta Tirthapura