English
Related papers

Related papers: Large Deviation Analysis of Score-based Hypothesis…

200 papers

Score-based diffusion models provide a powerful way to model images using the gradient of the data distribution. Leveraging the learned score function as a prior, here we introduce a way to sample data from a conditional distribution given…

Image and Video Processing · Electrical Eng. & Systems 2022-07-19 Hyungjin Chung , Jong Chul Ye

We revisit the fundamental question of simple-versus-simple hypothesis testing with an eye towards computational complexity, as the statistically optimal likelihood ratio test is often computationally intractable in high-dimensional…

Statistics Theory · Mathematics 2025-05-05 Ankur Moitra , Alexander S. Wein

Selective inference (post-selection inference) is a methodology that has attracted much attention in recent years in the fields of statistics and machine learning. Naive inference based on data that are also used for model selection tends…

Methodology · Statistics 2021-11-25 Yoshiyuki Ninomiya , Yuta Umezu , Ichiro Takeuchi

We propose a novel method for testing the null hypothesis of no effect of a covariate on the response in the context of functional linear concurrent regression. We establish an equivalent random effects formulation of our functional…

Methodology · Statistics 2019-12-16 Rahul Ghosal , Arnab Maity

We study the performance of machine learning binary classification techniques in terms of error probabilities. The statistical test is based on the Data-Driven Decision Function (D3F), learned in the training phase, i.e., what is…

Machine Learning · Computer Science 2023-01-19 Paolo Braca , Leonardo M. Millefiori , Augusto Aubry , Antonio De Maio , Peter Willett

In this work, we introduce statistical testing under distributional shifts. We are interested in the hypothesis $P^* \in H_0$ for a target distribution $P^*$, but observe data from a different distribution $Q^*$. We assume that $P^*$ is…

Methodology · Statistics 2022-05-03 Nikolaj Thams , Sorawit Saengkyongam , Niklas Pfister , Jonas Peters

For a set of dependent random variables, without stationary or the strong mixing assumptions, we derive the asymptotic independence between their sums and maxima. Then we apply this result to high-dimensional testing problems, where we…

Methodology · Statistics 2022-05-12 Long Feng , Tiefeng Jiang , Xiaoyun Li , Binghui Liu

Robust classification algorithms have been developed in recent years with great success. We take advantage of this development and recast the classical two-sample test problem in the framework of classification. Based on the estimates of…

Statistics Theory · Mathematics 2019-09-18 Haiyan Cai , Bryan Goggin , Qingtang Jiang

Neural Posterior Estimation methods for simulation-based inference can be ill-suited for dealing with posterior distributions obtained by conditioning on multiple observations, as they tend to require a large number of simulator calls to…

Machine Learning · Computer Science 2023-07-11 Tomas Geffner , George Papamakarios , Andriy Mnih

Score matching is an estimation procedure that has been developed for statistical models whose probability density function is known up to proportionality but whose normalizing constant is intractable, so that maximum likelihood is…

Methodology · Statistics 2024-04-23 Jiazhen Xu , Janice L. Scealy , Andrew T. A. Wood , Tao Zou

Motivated by the likelihood ratio test under the Gaussian assumption, we develop a maximum sum-of-squares test for conducting hypothesis testing on high dimensional mean vector. The proposed test which incorporates the dependence among the…

Methodology · Statistics 2015-10-21 Xianyang Zhang

This paper proposes a decorrelation-based approach to test hypotheses and construct confidence intervals for the low dimensional component of high dimensional proportional hazards models. Motivated by the geometric projection principle, we…

Machine Learning · Statistics 2014-12-17 Ethan X. Fang , Yang Ning , Han Liu

Statistical hypothesis testing serves as statistical evidence for scientific innovation. However, if the reported results are intentionally biased, hypothesis testing no longer controls the rate of false discovery. In particular, we study…

Methodology · Statistics 2018-10-12 Junpei Komiyama , Takanori Maehara

In this paper, we investigate the adequacy testing problem of high-dimensional factor-augmented regression model. Existing test procedures perform not well under dense alternatives. To address this critical issue, we introduce a novel…

Methodology · Statistics 2025-04-04 Yanmei Shi , Leheng Cai , Xu Guo , Shurong Zheng

Consider a nonparametric regression model with one-sided errors and regression function in a general H\"older class. We estimate the regression function via minimization of the local integral of a polynomial approximation. We show uniform…

Methodology · Statistics 2016-10-12 Holger Drees , Natalie Neumeyer , Leonie Selk

These notes survey and explore an emerging method, which we call the low-degree method, for predicting and understanding statistical-versus-computational tradeoffs in high-dimensional inference problems. In short, the method posits that a…

Statistics Theory · Mathematics 2019-07-29 Dmitriy Kunisky , Alexander S. Wein , Afonso S. Bandeira

In supervised learning, automatically assessing the quality of the labels before any learning takes place remains an open research question. In certain particular cases, hypothesis testing procedures have been proposed to assess whether a…

Machine Learning · Computer Science 2023-12-19 Weisong Yang , Rafael Poyiadzi , Niall Twomey , Raul Santos Rodriguez

We consider Bayesian multiple hypothesis problem with independent and identically distributed observations. The classical, Sanov's theorem-based, analysis of the error probability allows one to characterize the best achievable error…

Information Theory · Computer Science 2021-11-01 Hüseyin Afşer

Gene expression and phenotype association can be affected by potential unmeasured confounders from multiple sources, leading to biased estimates of the associations. Since genetic variants largely explain gene expression variations, they…

Methodology · Statistics 2019-10-23 Jiarui Lu , Hongzhe Li

Score-based diffusion models have emerged as one of the most promising frameworks for deep generative modelling. In this work we conduct a systematic comparison and theoretical analysis of different approaches to learning conditional…

Machine Learning · Computer Science 2021-11-29 Georgios Batzolis , Jan Stanczuk , Carola-Bibiane Schönlieb , Christian Etmann