English
Related papers

Related papers: Measuring Independence of Datasets

200 papers

Consider a random sample $X_1 , X_2 , ..., X_n$ drawn independently and identically distributed from some known sampling distribution $P_X$. Let $X_{(1)} \le X_{(2)} \le ... \le X_{(n)}$ represent the order statistics of the sample. The…

Information Theory · Computer Science 2020-09-28 Alex Dytso , Martina Cardone , Cynthia Rush

In this paper, we study the problem of publishing a stream of real-valued data satisfying differential privacy (DP). One major challenge is that the maximal possible value can be quite large; thus it is necessary to estimate a threshold so…

Cryptography and Security · Computer Science 2023-12-11 Tianhao Wang , Joann Qiongna Chen , Zhikun Zhang , Dong Su , Yueqiang Cheng , Zhou Li , Ninghui Li , Somesh Jha

Streaming data can arise from a variety of contexts. Important use cases are continuous sensor measurements such as temperature, light or radiation values. In the process, streaming data may also contain data errors that should be cleaned…

Databases · Computer Science 2025-07-29 Valerie Restat , Niklas Rodenhausen , Carina Antonin , Uta Störl

Many real-world applications pose challenges in incorporating fairness constraints into the $k$-center clustering problem, where the dataset consists of $m$ demographic groups, each with a specified upper bound on the number of centers to…

Data Structures and Algorithms · Computer Science 2026-01-19 Longkun Guo , Zeyu Lin , Chaoqi Jia , Chao Chen

The edit distance is a way of quantifying how similar two strings are to one another by counting the minimum number of character insertions, deletions, and substitutions required to transform one string into the other. In this paper we…

Data Structures and Algorithms · Computer Science 2016-07-14 Diptarka Chakraborty , Elazar Goldenberg , Michal Koucký

Finding a basis/coordinate system that can efficiently represent an input data stream by viewing them as realizations of a stochastic process is of tremendous importance in many fields including data compression and computational…

Numerical Analysis · Mathematics 2025-10-20 Bertrand Benichou , Naoki Saito

We propose a new method for training a supervised source separation system that aims to learn the interdependent relationships between all combinations of sources in a mixture. Rather than independently estimating each source from a mix, we…

Sound · Computer Science 2022-03-30 Ethan Manilow , Curtis Hawthorne , Cheng-Zhi Anna Huang , Bryan Pardo , Jesse Engel

Spectral dimensionality reduction is frequently used to identify low-dimensional structure in high-dimensional data. However, learning manifolds, especially from the streaming data, is computationally and memory expensive. In this paper, we…

Machine Learning · Statistics 2017-10-20 Frank Schoeneman , Suchismit Mahapatra , Varun Chandola , Nils Napp , Jaroslaw Zola

Motivated by machine learning applications in networks of sensors, internet-of-things (IoT) devices, and autonomous agents, we propose techniques for distributed stochastic convex learning from high-rate data streams. The setup involves a…

Machine Learning · Statistics 2019-06-11 Matthew Nokleby , Waheed U. Bajwa

Optimal Transport (OT) distances are now routinely used as loss functions in ML tasks. Yet, computing OT distances between arbitrary (i.e. not necessarily discrete) probability distributions remains an open problem. This paper introduces a…

Optimization and Control · Mathematics 2020-07-03 Arthur Mensch , Gabriel Peyré

Predicting the future occupancy states of the surrounding environment is a vital task for autonomous driving. However, current best-performing single-modality methods or multi-modality fusion perception methods are only able to predict…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Yining Shi , Kun Jiang , Ke Wang , Jiusi Li , Yunlong Wang , Mengmeng Yang , Diange Yang

Many streaming algorithms provide only a high-probability relative approximation. These two relaxations, of allowing approximation and randomization, seem necessary -- for many streaming problems, both relaxations must be employed…

Data Structures and Algorithms · Computer Science 2023-05-16 Vladimir Braverman , Robert Krauthgamer , Aditya Krishnan , Shay Sapir

An unsupervised online streaming model is considered where samples arrive in an online fashion over $T$ slots. There are $M$ classifiers, whose confusion matrices are unknown a priori. In each slot, at most one sample can be labeled by any…

Machine Learning · Computer Science 2021-12-06 R. Vaze , Santanu Rathod

The number of triangles in a graph is a fundamental metric, used in social network analysis, link classification and recommendation, and more. Driven by these applications and the trend that modern graph datasets are both large and dynamic,…

Databases · Computer Science 2013-08-12 Kanat Tangwongsan , A. Pavan , Srikanta Tirthapura

In this paper we study how to perform distinct sampling in the streaming model where data contain near-duplicates. The goal of distinct sampling is to return a distinct element uniformly at random from the universe of elements, given that…

Data Structures and Algorithms · Computer Science 2018-10-31 Jiecao Chen , Qin Zhang

This paper addresses the following foundational question: what is the maximum theoretical delay performance achievable by an overlay peer-to-peer streaming system where the streamed content is subdivided into chunks? As shown in this paper,…

Many machine learning problems can be formulated as predicting labels for a pair of objects. Problems of that kind are often referred to as pairwise learning, dyadic prediction or network inference problems. During the last decade kernel…

Machine Learning · Statistics 2018-03-06 Michiel Stock , Tapio Pahikkala , Antti Airola , Bernard De Baets , Willem Waegeman

In this paper, we focus on the problem of statistical dependence estimation using characteristic functions. We propose a statistical dependence measure, based on the maximum-norm of the difference between joint and product-marginal…

Machine Learning · Computer Science 2022-08-18 Povilas Daniušis , Shubham Juneja , Lukas Kuzma , Virginijus Marcinkevičius

Given a dataset of points in a metric space and an integer $k$, a diversity maximization problem requires determining a subset of $k$ points maximizing some diversity objective measure, e.g., the minimum or the average distance between two…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-24 Matteo Ceccarello , Andrea Pietracaprina , Geppino Pucci , Eli Upfal

Clustering is a fundamental tool for analyzing large data sets. A rich body of work has been devoted to designing data-stream algorithms for the relevant optimization problems such as $k$-center, $k$-median, and $k$-means. Such algorithms…

Data Structures and Algorithms · Computer Science 2018-12-06 Kook Jin Ahn , Graham Cormode , Sudipto Guha , Andrew McGregor , Anthony Wirth