English
Related papers

Related papers: Measuring Evidence against Exchangeability and Gro…

200 papers

Predictive performance of machine learning models trained with empirical risk minimization (ERM) can degrade considerably under distribution shifts. The presence of spurious correlations in training datasets leads ERM-trained models to…

Machine Learning · Computer Science 2023-02-08 Simon Roburin , Charles Corbière , Gilles Puy , Nicolas Thome , Matthieu Aubry , Renaud Marlet , Patrick Pérez

The e-value is gaining traction as a robust alternative to p-values and Bayes factors for quantifying statistical evidence. e-values are a promising method for adaptive clinical trials due to their anytime-validity: e-values ensure type I…

Methodology · Statistics 2026-05-28 Stef Baas , Judith ter Schure , Joost van Rosmalen

In group testing, simple binary-output tests are designed to identify a small number $t$ of defective items that are present in a large population of $N$ items. Each test takes as input a group of items and produces a binary output…

Information Theory · Computer Science 2017-04-11 Alexander Barg , Arya Mazumdar

With the increase in availability of large pre-trained language models (LMs) in Natural Language Processing (NLP), it becomes critical to assess their fit for a specific target task a priori - as fine-tuning the entire space of available…

Computation and Language · Computer Science 2022-10-21 Elisa Bassignana , Max Müller-Eberstein , Mike Zhang , Barbara Plank

Renormalization group theory is a powerful and intriguing technique with a wide range of applications. One of the main successes of renormalization group theory is the description of continuous phase transitions and the development of…

Statistical Mechanics · Physics 2025-02-04 Luca Di Carlo

We establish that temporal averaging over multiple observations is the degenerate case of algebraic group action with the trivial group $G=\{e\}$. A General Replacement Theorem proves that a group-averaged estimator from one snapshot…

Machine Learning · Computer Science 2026-05-05 Mitchell A. Thornton

Invariance to nuisance transformations is one of the desirable properties of effective representations. We consider transformations that form a \emph{group} and propose an approach based on kernel methods to derive local group invariant…

Machine Learning · Computer Science 2017-05-25 Anant Raj , Abhishek Kumar , Youssef Mroueh , P. Thomas Fletcher , Bernhard Schölkopf

When observations are organized into groups where commonalties exist amongst them, the dependent random measures can be an ideal choice for modeling. One of the propositions of the dependent random measures is that the atoms of the…

Machine Learning · Statistics 2016-06-28 Cheng Luo , Richard Yi Da Xu , Yang Xiang

The classical de Finetti Theorem classifies the $\mathrm{Sym}(\mathbb N)$-invariant probability measures on $[0,1]^{\mathbb N}$. More precisely it states that those invariant measures are combinations of measures of the form…

Probability · Mathematics 2024-11-05 Colin Jahel , Pierre Perruchaud

Trait allocations are a class of combinatorial structures in which data may belong to multiple groups and may have different levels of belonging in each group. Often the data are also exchangeable, i.e., their joint distribution is…

Statistics Theory · Mathematics 2020-01-28 Trevor Campbell , Diana Cai , Tamara Broderick

Many data sets consist of variables with an inherent group structure. The problem of group selection has been well studied, but in this paper, we seek to do the opposite: our goal is to select at least one variable from each group in the…

Methodology · Statistics 2015-05-29 Frederick Campbell , Genevera I. Allen

Inspired by constraints from physical law, equivariant machine learning restricts the learning to a hypothesis class where all the functions are equivariant with respect to some group action. Irreducible representations or invariant theory…

Machine Learning · Statistics 2024-11-11 Ben Blum-Smith , Soledad Villar

Many flexible families of positive random variables exhibit non-closed forms of the density and distribution functions and this feature is considered unappealing for modelling purposes. However, such families are often characterized by a…

Statistics Theory · Mathematics 2025-06-09 Lucio Barabesi , Antonio Di Noia , Marzia Marcheselli , Caterina Pisani , Luca Pratelli

In a group testing scheme, a set of tests is designed to identify a small number $t$ of defective items that are present among a large number $N$ of items. Each test takes as input a group of items and produces a binary output indicating…

Information Theory · Computer Science 2016-11-17 Arya Mazumdar

Invariant and equivariant models incorporate the symmetry of an object to be estimated (here non-parametric regression functions $f : \mathcal{X} \rightarrow \mathbb{R}$). These models perform better (with respect to $L^2$ loss) and are…

Machine Learning · Statistics 2022-05-31 Louis G. Christie , John A. D. Aston

In this paper, we propose algorithms that leverage a known community structure to make group testing more efficient. We consider a population organized in connected communities: each individual participates in one or more communities, and…

Information Theory · Computer Science 2021-03-18 Pavlos Nikolopoulos , Sundara Rajan Srinivasavaradhan , Tao Guo , Christina Fragouli , Suhas Diggavi

We analyze in this paper a random feature map based on a theory of invariance I-theory introduced recently. More specifically, a group invariant signal signature is obtained through cumulative distributions of group transformed random…

Machine Learning · Computer Science 2015-12-07 Youssef Mroueh , Stephen Voinea , Tomaso Poggio

This paper presents a novel numerical method for the hybrid reliability analysis by using the uncertainty theory. Aleatory uncertainty and epistemic uncertainty are considered simultaneously in this method. Epistemic uncertainty is…

Computational Engineering, Finance, and Science · Computer Science 2020-09-18 Lei Zhang

Conformal prediction, a post-hoc, distribution-free, finite-sample method of uncertainty quantification that offers formal coverage guarantees under the assumption of data exchangeability. Unfortunately, the resulting uncertainty regions…

Machine Learning · Computer Science 2026-04-21 Nikolaos Bousias , Lars Lindemann , George Pappas

We introduce a general scheme to detect various multiparticle entanglement structures from global non-permutationally invariant observables. In particular, we derive bounds on the variance of non-permutationally invariant and collective…

Quantum Physics · Physics 2017-08-24 Oliver Marty , Marcus Cramer , Giuseppe Vitagliano , Geza Toth , Martin B. Plenio