English
Related papers

Related papers: The permuted score test for robust differential ex…

200 papers

We consider finite-sample inference for a single regression coefficient in the fixed-design linear model $Y = Z\beta + bX + \varepsilon$, where $\varepsilon\in\mathbb{R}^n$ may exhibit complex dependence or heterogeneity. We develop a group…

Methodology · Statistics 2026-04-20 Zonghan Li , Hongyi Zhou , Zhiheng Zhang

Score-based statistical models play an important role in modern machine learning, statistics, and signal processing. For hypothesis testing, a score-based hypothesis test is proposed in \cite{wu2022score}. We analyze the performance of this…

Signal Processing · Electrical Eng. & Systems 2024-02-06 Enmao Diao , Taposh Banerjee , Vahid Tarokh

Bayesian (deep) neural networks (BNN) are often more attractive than the vanilla point-estimate deep learning in various aspects including uncertainty quantification, robustness to noise, resistance to overfitting, and more. The variational…

Machine Learning · Computer Science 2026-05-22 Minyoung Kim

One of the most common analysis tasks in genomic research is to identify genes that are differentially expressed (DE) between experimental conditions. Empirical Bayes (EB) statistical tests using moderated genewise variances have been very…

Applications · Statistics 2016-07-28 Belinda Phipson , Stanley Lee , Ian J. Majewski , Warren S. Alexander , Gordon K. Smyth

Researchers in genetics and other life sciences commonly use permutation tests to evaluate differences between groups. Permutation tests have desirable properties, including exactness if data are exchangeable, and are applicable even when…

Computation · Statistics 2018-11-01 Brian Segal , Thomas Braun , Michael Elliott , Hui Jiang

Reliable estimation of feature contributions in machine learning models is essential for trust, transparency and regulatory compliance, especially when models are proprietary or otherwise operate as black boxes. While permutation-based…

Machine Learning · Statistics 2025-12-24 Albert Dorador

The existence of label noise imposes significant challenges (e.g., poor generalization) on the training process of deep neural networks (DNN). As a remedy, this paper introduces a permutation layer learning approach termed PermLL to…

Machine Learning · Computer Science 2022-11-30 Salman Alsubaihi , Mohammed Alkhrashi , Raied Aljadaany , Fahad Albalawi , Bernard Ghanem

This paper develops permutation versions of identification-robust tests in linear instrumental variables (IV) regression. Unlike the existing randomization and rank-based tests in which independence between the instruments and the error…

Econometrics · Economics 2024-07-24 Purevdorj Tuvaandorj

Discriminative analysis in neuroimaging by means of deep/machine learning techniques is usually tested with validation techniques, whereas the associated statistical significance remains largely under-developed due to their computational…

Deep neural networks trained with standard cross-entropy loss are more prone to memorize noisy labels, which degrades their performance. Negative learning using complementary labels is more robust when noisy labels intervene but with an…

Machine Learning · Computer Science 2022-09-07 Chen-Chen Zong , Zheng-Tao Cao , Hong-Tao Guo , Yun Du , Ming-Kun Xie , Shao-Yuan Li , Sheng-Jun Huang

Reliable inference for spatial regression remains challenging because it requires the correct specification of the spatial dependence structure, the mean trend, and the error distribution. Existing parametric testing methods rely on…

Methodology · Statistics 2026-05-12 Kanghyun Wi , Hyoeun Kim , Tomáš Mrkvička , Jorge Mateu , Jaewoo Park

In this paper, a robust weighted score for unbalanced data (ROWSU) is proposed for selecting the most discriminative feature for high dimensional gene expression binary classification with class-imbalance problem. The method addresses one…

Machine Learning · Statistics 2024-01-24 Zardad Khan , Amjad Ali , Saeed Aldahmani

Determining conditional independence (CI) relationships between random variables is a fundamental yet challenging task in machine learning and statistics, especially in high-dimensional settings. Existing generative model-based CI testing…

Machine Learning · Computer Science 2025-05-30 Yixin Ren , Chenghou Jin , Yewei Xia , Li Ke , Longtao Huang , Hui Xue , Hao Zhang , Jihong Guan , Shuigeng Zhou

In genetic association studies, detecting phenotype-genotype association is a primary goal. We assume that the relationship between the data -phenotype, genetic markers and environmental covariates - can be modelled by a generalized linear…

Methodology · Statistics 2020-04-13 K. K. Halle , Ø. Bakke , S. Djurovic , A. Bye , E. Ryeng , U. Wisløff , O. A. Andreassen , M. Langaas

We present a novel method for training score-based generative models which uses nonlinear noising dynamics to improve learning of structured distributions. Generalizing to a nonlinear drift allows for additional structure to be incorporated…

Machine Learning · Statistics 2025-07-10 Jeremiah Birrell , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang , Wei Zhu

Identification of features is a critical task in microbiome studies that is complicated by the fact that microbial data are high dimensional and heterogeneous. Masked by the complexity of the data, the problem of separating signals from…

Methodology · Statistics 2020-09-18 Liangliang Zhang , Yushu Shi , Kim-Anh Do , Christine B. Peterson , Robert R. Jenq

We develop a new permutation test for inference on a subvector of coefficients in linear models. The test is exact when the regressors and the error terms are independent. Then, we show that the test is asymptotically of correct level,…

Econometrics · Economics 2023-09-13 Xavier D'Haultfœuille , Purevdorj Tuvaandorj

Statistical significance tests can provide evidence that the observed difference in performance between two methods is not due to chance. In Information Retrieval, some studies have examined the validity and suitability of such tests for…

Information Retrieval · Computer Science 2019-04-09 Javier Parapar , David E. Losada , Manuel A. Presedo-Quindimil , Alvaro Barreiro

Along with accurate prediction, understanding the contribution of each feature to the making of the prediction, i.e., the importance of the feature, is a desirable and arguably necessary component of a machine learning model. For a complex…

Machine Learning · Computer Science 2025-07-11 Aaron Foote , Danny Krizanc

Permutation tests are widely recognized as robust alternatives to tests based on normal theory. Random permutation tests have been frequently employed to assess the significance of variables in linear models. Despite their widespread use,…

Methodology · Statistics 2023-12-29 Leying Guan