English
Related papers

Related papers: Some Impossibility Results for Inference With Clus…

200 papers

Identifying dependency in multivariate data is a common inference task that arises in numerous applications. However, existing nonparametric independence tests typically require computation that scales at least quadratically with the sample…

Methodology · Statistics 2021-07-08 Shai Gorsky , Li Ma

In empirical work it is common to estimate parameters of models and report associated standard errors that account for "clustering" of units, where clusters are defined by factors such as geography. Clustering adjustments are typically…

Statistics Theory · Mathematics 2022-09-21 Alberto Abadie , Susan Athey , Guido Imbens , Jeffrey Wooldridge

Evaluating the performance of clustering models is a challenging task where the outcome depends on the definition of what constitutes a cluster. Due to this design, current existing metrics rarely handle multiple clustering models with…

Machine Learning · Computer Science 2025-05-08 Louis Ohl , Fredrik Lindsten

Identifying dependency between two random variables is a fundamental problem. The clear interpretability and ability of a procedure to provide information on the form of possible dependence is particularly important when exploring…

Methodology · Statistics 2026-04-27 Bogdan Ćmiel , Teresa Ledwina

Causal inference on populations embedded in social networks poses technical challenges, since the typical no interference assumption frequently does not hold. Existing methods developed in the context of network interference rely upon the…

Methodology · Statistics 2024-04-12 Vanessa McNealis , Erica E. M. Moodie , Nema Dean

In real-world scenarios, typical visual recognition systems could fail under two major causes, i.e., the misclassification between known classes and the excusable misbehavior on unknown-class images. To tackle these deficiencies, flexible…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Lei Fan , Bo Liu , Haoxiang Li , Ying Wu , Gang Hua

A common assumption in causal inference from observational data is that there is no hidden confounding. Yet it is, in general, impossible to verify this assumption from a single dataset. Under the assumption of independent causal mechanisms…

Methodology · Statistics 2023-11-07 Rickard K. A. Karlsson , Jesse H. Krijthe

The study of causality or causal inference - how much a given treatment causally affects a given outcome in a population - goes way beyond correlation or association analysis of variables, and is critical in making sound data driven…

Databases · Computer Science 2017-08-09 Sudeepa Roy , Babak Salimi

Independence testing plays a central role in statistical and causal inference from observational data. Standard independence tests assume that the data samples are independent and identically distributed (i.i.d.) but that assumption is…

Machine Learning · Statistics 2022-07-04 Ragib Ahsan , Zahra Fatemi , David Arbour , Elena Zheleva

In this paper, we test whether two datasets share a common clustering structure. As a leading example, we focus on comparing clustering structures in two independent random samples from two mixtures of multivariate normal distributions.…

Statistics Theory · Mathematics 2022-11-21 Chao Gao , Zongming Ma

The cluster analysis of very large objects is an important problem, which spans several theoretical as well as applied branches of mathematics and computer science. Here we suggest a novel approach: under assumption of local convergence of…

Combinatorics · Mathematics 2015-10-28 Jaroslav Nesetril , Patrice Ossona de Mendez

This paper presents robust inference methods for general linear hypotheses in linear panel data models with latent group structure in the coefficients. We employ a selective conditional inference approach, deriving the conditional…

Econometrics · Economics 2025-11-25 Oguzhan Akgun , Ryo Okui

Interference occurs when a unit's treatment (or exposure) affects another unit's outcome. In some settings, units may be grouped into clusters such that it is reasonable to assume that interference, if present, only occurs between…

Methodology · Statistics 2023-08-24 Chanhwa Lee , Donglin Zeng , Michael G. Hudgens

I introduce a simple permutation procedure to test conventional (non-sharp) hypotheses about the effect of a binary treatment in the presence of a finite number of large, heterogeneous clusters when the treatment effect is identified by…

Econometrics · Economics 2023-02-08 Andreas Hagemann

An important aspect of multiple hypothesis testing is controlling the significance level, or the level of Type I error. When the test statistics are not independent it can be particularly challenging to deal with this problem, without…

Statistics Theory · Mathematics 2009-03-04 Sandy Clarke , Peter Hall

The abundance of galaxy clusters in the low-redshift universe provides an important cosmological test, constraining a product of the initial amplitude of fluctuations and the amount by which they have grown since early times. The degeneracy…

Cosmology and Nongalactic Astrophysics · Physics 2021-09-21 Yuba Amoura , Nicole E. Drakos , Anael Berrouet , James E. Taylor

The correct identification of clusters is crucial for an accurate monitoring of the spread of a disease and also in many other natural, social and physical phenomena which exhibit an epidemic structure. Nevertheless, even when an accurate…

Physics and Society · Physics 2021-04-12 Eugenio Lippiello , Polytzois Bountzis

Quality assessments of models in unsupervised learning and clustering verification in particular have been a long-standing problem in the machine learning research. The lack of robust and universally applicable cluster validity scores often…

Machine Learning · Statistics 2018-03-30 Luzie Helfmann , Johannes von Lindheim , Mattes Mollenhauer , Ralf Banisch

Stationarity is a very general, qualitative assumption, that can be assessed on the basis of application specifics. It is thus a rather attractive assumption to base statistical analysis on, especially for problems for which less general…

Statistics Theory · Mathematics 2019-04-02 Daniil Ryabko

Inferring the causal structure that links n observables is usually based upon detecting statistical dependences and choosing simple graphs that make the joint measure Markovian. Here we argue why causal inference is also possible when only…

Statistics Theory · Mathematics 2008-04-24 Dominik Janzing , Bernhard Schoelkopf