English
Related papers

Related papers: Testing Distributions of Huge Objects

200 papers

Advancements in data collection have led to increasingly common repeated observations with complex structures in biomedical studies. Treating these observations as random objects, rather than summarizing features as vectors, avoids feature…

Methodology · Statistics 2025-03-04 Jingru Zhang , Shengjie Zhang , Christopher W Jones , Mathias Basner , Haochang Shou

Test of independence is of fundamental importance in modern data analysis, with broad applications in variable selection, graphical models, and causal inference. When the data is high dimensional and the potential dependence signal is…

Methodology · Statistics 2023-06-13 Zhanrui Cai , Jing Lei , Kathryn Roeder

We study the problem of testing, using only a single sample, between mean field distributions (like Curie-Weiss, Erd\H{o}s-R\'enyi) and structured Gibbs distributions (like Ising model on sparse graphs and Exponential Random Graphs). Our…

Statistics Theory · Mathematics 2018-05-24 Guy Bresler , Dheeraj Nagaraj

We study the complexity of the problem of searching for a set of patterns that separate two given sets of strings. This problem has applications in a wide variety of areas, most notably in data mining, computational biology, and in…

Computational Complexity · Computer Science 2016-12-20 Giuseppe Lancia , Luke Mathieson , Pablo Moscato

This paper introduces a novel framework for distributed two-sample testing using the Integrated Transportation Distance (ITD), an extension of the Optimal Transport distance. The approach addresses the challenges of detecting distributional…

Methodology · Statistics 2025-06-23 Zhengqi Lin , Yan Chen

Learning the similarity between images constitutes the foundation for numerous vision tasks. The common paradigm is discriminative metric learning, which seeks an embedding that separates different training classes. However, the main…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Timo Milbich , Karsten Roth , Biagio Brattoli , Björn Ommer

In this paper we consider several variants of the pattern matching problem. In particular, we investigate the following problems: 1) Pattern matching with k mismatches; 2) Approximate counting of mismatches; and 3) Pattern matching with…

Data Structures and Algorithms · Computer Science 2013-07-05 Marius Nicolae , Sanguthevar Rajasekaran

Understanding the shape of a distribution of data is of interest to people in a great variety of fields, as it may affect the types of algorithms used for that data. We study one such problem in the framework of distribution property…

Machine Learning · Computer Science 2022-12-06 Maryam Aliakbarpour , Amartya Shankha Biswas , Kavya Ravichandran , Ronitt Rubinfeld

Model checking and testing are two areas with a similar goal: to verify that a system satisfies a property. They start with different hypothesis on the systems and develop many techniques with different notions of approximation, when an…

Logic in Computer Science · Computer Science 2013-04-19 M. C. Gaudel , R. Lassaigne , F. Magniez , M. de Rougemont

We give a general unified method that can be used for $L_1$ {\em closeness testing} of a wide range of univariate structured distribution families. More specifically, we design a sample optimal and computationally efficient algorithm for…

Data Structures and Algorithms · Computer Science 2015-08-25 Ilias Diakonikolas , Daniel M. Kane , Vladimir Nikishkin

The study on architecture and parameter characteristics remains the hot topic in the research of large language models. In this paper we concern with the characteristics of weight which are used to analyze the correlations and differences…

Machine Learning · Computer Science 2025-09-24 Chunming Ye , Wenquan Tian , Yalan Gao , Songzhou Li

In this paper we propose a Bayesian answer to testing problems when the hypotheses are not well separated. The idea of the method is to study the posterior distribution of a discrepancy measure between the parameter and the model we want to…

Statistics Theory · Mathematics 2017-06-28 Jean-Bernard Salomond

In this paper, we propose a new spectral-based approach to hypothesis testing for populations of networks. The primary goal is to develop a test to determine whether two given samples of networks come from the same random model or…

Methodology · Statistics 2020-11-26 Li Chen , Nathaniel Josephs , Lizhen Lin , Jie Zhou , Eric D. Kolaczyk

We study the problem of hypothesis testing between two discrete distributions, where we only have access to samples after the action of a known reversible Markov chain, playing the role of noise. We derive instance-dependent minimax rates…

Statistics Theory · Mathematics 2018-08-15 Quentin Berthet , Varun Kanade

Permutation tests are a distribution free way of performing hypothesis tests. These tests rely on the condition that the observed data are exchangeable among the groups being tested under the null hypothesis. This assumption is easily…

Methodology · Statistics 2017-12-14 Daniell Toth

Two-sample testing, where we aim to determine whether two distributions are equal or not equal based on samples from each one, is challenging if we cannot place assumptions on the properties of the two distributions. In particular,…

Machine Learning · Statistics 2026-04-13 Rohan Hore , Rina Foygel Barber

We study the statistical properties of large random networks with specified degree distributions. New techniques are presented for analyzing the structure of social networks. Specifically, we address the question of how many nodes exist at…

Physics and Society · Physics 2007-05-23 Erik Volz

We hereby present a solution to a semantic textual similarity (STS) problem in which it is necessary to match two sentences containing, as the only distinguishing factor, highly specific information (such as names, addresses, identification…

Computation and Language · Computer Science 2023-11-29 Gioele Cadamuro , Marco Gruppo

Given samples from an unknown multivariate distribution $p$, is it possible to distinguish whether $p$ is the product of its marginals versus $p$ being far from every product distribution? Similarly, is it possible to distinguish whether…

Data Structures and Algorithms · Computer Science 2019-07-12 Constantinos Daskalakis , Nishanth Dikkala , Gautam Kamath

In the Bayes paradigm and for a given loss function, we propose the construction of a new type of posterior distributions, that extends the classical Bayes one, for estimating the law of an $n$-sample. The loss functions we have in mind are…

Statistics Theory · Mathematics 2024-01-05 Yannick Baraud