English
Related papers

Related papers: A general framework for estimation and inference f…

200 papers

We develop tools for selective inference in the setting of group sparsity, including the construction of confidence intervals and p-values for testing selected groups of variables. Our main technical result gives the precise distribution of…

Methodology · Statistics 2016-07-28 Fan Yang , Rina Foygel Barber , Prateek Jain , John Lafferty

Many questions of fundamental interest in todays science can be formulated as inference problems: Some partial, or noisy, observations are performed over a set of variables and the goal is to recover, or infer, the values of the variables…

Statistical Mechanics · Physics 2018-01-24 Lenka Zdeborová , Florent Krzakala

When scholars suspect units are dependent on each other within clusters but independent of each other across clusters, they employ cluster-robust standard errors (CRSEs). Nevertheless, what to cluster over is sometimes unknown. For…

Methodology · Statistics 2025-11-12 Kentaro Fukumoto

In group sequential designs, where several data looks are conducted for early stopping, we generally assume the vector of test statistics from the sequential analyses follows (at least approximately or asymptotially) a multivariate normal…

Statistics Theory · Mathematics 2024-04-22 Long-Hao Xu , Tobias Mütze , Frank Konietschke , Tim Friede

Unnormalized (or energy-based) models provide a flexible framework for capturing the characteristics of data with complex dependency structures. However, the application of standard Bayesian inference methods has been severely limited…

Methodology · Statistics 2026-03-11 Naruki Sonobe , Shonosuke Sugasawa , Daichi Mochihashi , Takeru Matsuda

In many modern statistical problems, the limited available data must be used both to develop the hypotheses to test, and to test these hypotheses-that is, both for exploratory and confirmatory data analysis. Reusing the same dataset for…

Methodology · Statistics 2023-07-24 Youngjoo Yun , Rina Foygel Barber

Pre-validation is a way to build prediction model with two datasets of significantly different feature dimensions. Previous work showed that the asymptotic distribution of the resulting test statistic for the pre-validated predictor…

Methodology · Statistics 2025-05-23 Jing Shang , Sourav Chatterjee , Trevor Hastie , Robert Tibshirani

Preparation and measurement of physical systems are the operational building blocks of any physical experiment, and to describe them is the first purpose of any physical theory. It is remarkable that, in some situations, even when only…

Quantum Physics · Physics 2021-07-28 Carlos de Gois , George Moreno , Ranieri Nery , Samuraí Brito , Rafael Chaves , Rafael Rabelo

Neuroimaging research has predominantly drawn conclusions based on classical statistics, including null-hypothesis testing, t-tests, and ANOVA. Throughout recent years, statistical learning methods enjoy increasing popularity, including…

Machine Learning · Statistics 2016-05-05 Danilo Bzdok

In this paper we study a new, generalized version of the well-known group testing problem. In the classical model of group testing we are given n objects, some of which are considered to be defective. We can test certain subsets of the…

Combinatorics · Mathematics 2012-04-09 Dániel Gerbner , Balázs Keszegh , Dömötör Pálvölgyi , Gábor Wiener

Estimating a large alphabet probability distribution from a limited number of samples is a fundamental problem in machine learning and statistics. A variety of estimation schemes have been proposed over the years, mostly inspired by the…

Machine Learning · Statistics 2018-08-20 Amichai Painsky , Meir Feder

The comparison of a parameter in $k$ populations is a classical problem in statistics. Testing for the equality of means or variances are typical examples. Most procedures designed to deal with this problem assume that $k$ is fixed and that…

In this article we provide a systematic experimental method for sorting animals according to socially relevant traits, without assaying them or even tagging them individually. Instead, they are repeatedly subjected to behavioural assays in…

Quantitative Methods · Quantitative Biology 2017-02-23 Alex Szorkovszky , Alexander Kotrschal , James E. Herbert Read , David J. T. Sumpter , Niclas Kolm , Kristiaan Pelckmans

This paper presents robust inference methods for general linear hypotheses in linear panel data models with latent group structure in the coefficients. We employ a selective conditional inference approach, deriving the conditional…

Econometrics · Economics 2025-11-25 Oguzhan Akgun , Ryo Okui

Classification is a fundamental task in supervised learning, while achieving valid misclassification rate control remains challenging due to possibly the limited predictive capability of the classifiers or the intrinsic complexity of the…

Methodology · Statistics 2025-09-16 Yinrui Sun , Yin Xia

The stochastic block model is a popular tool for detecting community structures in network data. Detecting the difference between two community structures is an important issue for stochastic block models. However, the two-sample test has…

Methodology · Statistics 2022-12-21 Kang Fu , Jianwei Hu , Seydou Keita , Hao Liu

This paper addresses the problem of making statistical inference about a population that can only be identified through classifier predictions. The problem is motivated by scientific studies in which human labels of a population are…

Applications · Statistics 2021-06-15 Ciaran Evans , Zara Y. Weinberg , Manojkumar A. Puthenveedu , Max G'Sell

A probabilistic expert system emulates the decision-making ability of a human expert through a directional graphical model. The first step in building such systems is to understand data generation mechanism. To this end, one may try to…

Methodology · Statistics 2021-09-29 Vahid Partovi Nia , Xinlin Li , Masoud Asgharian , Shoubo Hu , Zhitang Chen , Yanhui Geng

We consider cross-sectional genetic association studies (common and rare variants) where non-genetic information is available, or feasible to obtain for $N$ individuals, but where it is infeasible to genotype all $N$ individuals. We…

Applications · Statistics 2020-02-06 Thea Bjørnland , Anja Bye , Einar Ryeng , Ulrik Wisløff , Mette Langaas

Permutation tests are a distribution free way of performing hypothesis tests. These tests rely on the condition that the observed data are exchangeable among the groups being tested under the null hypothesis. This assumption is easily…

Methodology · Statistics 2017-12-14 Daniell Toth