English
Related papers

Related papers: Guarding against Spurious Discoveries in High Dime…

200 papers

Conformal prediction has received tremendous attention in recent years and has offered new solutions to problems in missing data and causal inference; yet these advances have not leveraged modern semiparametric efficiency theory for more…

Methodology · Statistics 2022-12-14 Yachong Yang , Arun Kumar Kuchibhotla , Eric Tchetgen Tchetgen

Confounding can lead to spurious associations. Typically, one must observe confounders in order to adjust for them, but in high-dimensional settings, recent research has shown that it becomes possible to adjust even for unobserved…

Methodology · Statistics 2025-10-07 Yujing Lu , Patrick Breheny

The topic of deep learning has seen a surge of interest in recent years both within and outside of the field of Statistics. Deep models leverage both nonlinearity and interaction effects to provide superior predictions in many cases when…

Methodology · Statistics 2020-09-18 Paul A. Parker , Scott H. Holan

For various applications, the relations between the dependent and independent variables are highly nonlinear. Consequently, for large scale complex problems, neural networks and regression trees are commonly preferred over linear models…

Machine Learning · Computer Science 2017-05-23 Samet Oymak , Mehrdad Mahdavi , Jiasi Chen

Neuroimage analysis usually involves learning thousands or even millions of variables using only a limited number of samples. In this regard, sparse models, e.g. the lasso, are applied to select the optimal features and achieve high…

Machine Learning · Computer Science 2015-03-26 Bo Xin , Lingjing Hu , Yizhou Wang , Wen Gao

Matching methods are widely used to reduce confounding effects in observational studies, but conventional approaches often treat all covariates as equally important, which can result in poor performance when covariates differ in their…

Machine Learning · Statistics 2025-09-01 Hongzhe Zhang , Jiasheng Shi , Jing Huang

The problem of assessing a parametric regression model in the presence of spatial correlation is addressed in this work. For that purpose, a goodness-of-fit test based on a $L_2$-distance comparing a parametric and a nonparametric…

Signal detection in environments with unknown signal bandwidth and time intervals is a fundamental problem in adversarial and spectrum-sharing scenarios. This paper addresses the problem of detecting signals occupying unknown degrees of…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Ali Rasteh , Sundeep Rangan

In longitudinal data a response variable is measured over time, or under different conditions, for a cohort of individuals. In many situations all intended measurements are not available which results in missing values. If the missing value…

Methodology · Statistics 2022-08-10 Ahmed M. Gad , Nesma M. Darwish

Recent research has revealed that deep neural networks often take dataset biases as a shortcut to make decisions rather than understand tasks, leading to failures in real-world applications. In this study, we focus on the spurious…

Computation and Language · Computer Science 2023-06-23 Yanrui Du , Jing Yan , Yan Chen , Jing Liu , Sendong Zhao , Qiaoqiao She , Hua Wu , Haifeng Wang , Bing Qin

In recent years, there has been an increasing demand on efficient algorithms for large scale change point detection problems. To this end, we propose seeded binary segmentation, an approach relying on a deterministic construction of…

Methodology · Statistics 2023-03-13 Solt Kovács , Housen Li , Peter Bühlmann , Axel Munk

In this work, the distributional properties of the goodness-of-fit term in likelihood-based information criteria are explored. These properties are then leveraged to construct a novel goodness-of-fit test for normal linear regression models…

Methodology · Statistics 2023-09-20 Scott H. Koeneman , Joseph E. Cavanaugh

Goodness-of-fit tests are often used in data analysis to test the agreement of a distribution to a set of data. These tests can be used to detect an unknown signal against a known background or to set limits on a proposed signal…

Methodology · Statistics 2023-03-20 Lolian Shtembari , Allen Caldwell

The problem of non-iterative one-shot and non-destructive correction of unavoidable mistakes arises in all Artificial Intelligence applications in the real world. Its solution requires robust separation of samples with errors from samples…

Machine Learning · Computer Science 2017-09-05 A. N. Gorban , I. Y. Tyukin

We present a novel subset scan method to detect if a probabilistic binary classifier has statistically significant bias -- over or under predicting the risk -- for some subgroup, and identify the characteristics of this subgroup. This form…

Machine Learning · Statistics 2017-07-05 Zhe Zhang , Daniel B. Neill

To avoid failures on out-of-distribution data, recent works have sought to extract features that have an invariant or stable relationship with the label across domains, discarding "spurious" or unstable features whose relationship with the…

Accurately specifying covariance structures is critical for valid inference in longitudinal and functional data analysis, particularly when data are sparsely observed. In this study, we develop a global goodness-of-fit test to assess…

Methodology · Statistics 2025-03-31 Dhrubajyoti Ghosh , Zhuolin Song , Luo Xiao , Sheng Luo

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

Machine Learning · Computer Science 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

We introduce a novel methodology for addressing systematic uncertainties in unbinned inclusive cross-section measurements and related collider-based inference problems. Our approach incorporates known analytic dependencies on parameters of…

High Energy Physics - Phenomenology · Physics 2026-01-21 Lisa Benato , Cristina Giordano , Claudius Krause , Ang Li , Robert Schöfbeck , Dennis Schwarz , Maryam Shooshtari , Daohan Wang

One fundamental statistical question for research areas such as precision medicine and health disparity is about discovering effect modification of treatment or exposure by observed covariates. We propose a semiparametric framework for…

Methodology · Statistics 2020-08-04 Muxuan Liang , Menggang Yu