English
Related papers

Related papers: Testing linear hypotheses in high-dimensional regr…

200 papers

In this paper, we use the empirical likelihood method to construct the confidence regions for the difference between the parameters of a two-phases nonlinear model with random design. We show that the empirical likelihood ratio has an…

Statistics Theory · Mathematics 2015-02-18 Zahraa Salloum

Many statistical hypotheses can be formulated in terms of polynomial equalities and inequalities in the unknown parameters and thus correspond to semi-algebraic subsets of the parameter space. We consider large sample asymptotics for the…

Statistics Theory · Mathematics 2009-04-03 Mathias Drton

Straightforward methods for adapting the familiar chi^2 statistic to histograms of discrete events and other Poisson distributed data generally yield biased estimates of the parameters of a model. The bias can be important even when the…

Data Analysis, Statistics and Probability · Physics 2014-03-12 Joseph W. Fowler

Maximum Likelihood Estimation (MLE) and Likelihood Ratio Test (LRT) are widely used methods for estimating the transition probability matrix in Markov chains and identifying significant relationships between transitions, such as equality.…

Methodology · Statistics 2024-06-04 Yining Zhou , Ming Gao , Yiting Chen , Xiaoping Shi

This paper revisits the classical inference results for profile quasi maximum likelihood estimators (profile MLE) in the semiparametric estimation problem. We mainly focus on two prominent theorems: the Wilks phenomenon and Fisher expansion…

Statistics Theory · Mathematics 2014-06-18 Andreas Andresen , Vladimir Spokoiny

This paper studies the dimension effect of the linear discriminant analysis (LDA) and the regularized linear discriminant analysis (RLDA) classifiers for large dimensional data where the observation dimension $p$ is of the same order as the…

Statistics Theory · Mathematics 2018-09-24 Cheng Wang , Binyan Jiang

Pairwise likelihood is a useful approximation to the full likelihood function for covariance estimation in high-dimensional context. It simplifies high-dimensional dependencies by combining marginal bivariate likelihood objects, thus making…

Methodology · Statistics 2024-07-25 Alessandro Casa , Davide Ferrari , Zhendong Huang

While the problem of testing multivariate normality has received considerable attention in the classical low-dimensional setting where the sample size $n$ is much larger than the feature dimension $d$ of the data, there is presently a…

Methodology · Statistics 2025-12-23 Xin Bing , Derek Latremouille

This paper presents a selective survey of recent developments in statistical inference and multiple testing for high-dimensional regression models, including linear and logistic regression. We examine the construction of confidence…

Methodology · Statistics 2023-01-26 T. Tony Cai , Zijian Guo , Yin Xia

We propose a likelihood ratio based inferential framework for high dimensional semiparametric generalized linear models. This framework addresses a variety of challenging problems in high dimensional data analysis, including incomplete…

Machine Learning · Statistics 2015-11-24 Yang Ning , Tianqi Zhao , Han Liu

Sign tests are among the most successful procedures in multivariate nonparametric statistics. In this paper, we consider several testing problems in multivariate analysis, directional statistics and multivariate time series analysis, and we…

Statistics Theory · Mathematics 2016-03-31 Davy Paindaveine , Thomas Verdebout

Pearson's Chi-square test is a widely used tool for analyzing categorical data, yet its statistical power has remained theoretically underexplored. Due to the difficulties in obtaining its power function in the usual manner, Cochran (1952)…

Methodology · Statistics 2024-09-24 Qingyang Zhang

We propose a likelihood ratio test framework for testing normal mean vectors in high-dimensional data under two common scenarios: the one-sample test and the two-sample test with equal covariance matrices. We derive the test statistics…

Methodology · Statistics 2018-09-25 Zongliang Hu , Tiejun Tong , Marc G. Genton

Recently, several authors have re-examined the power of the classical F-test in linear regression in a `large-p, large-n' framework (cf. Zhong and Chen (2011), Wang and Cui (2013)). They highlight the loss of power as the number of…

Statistics Theory · Mathematics 2016-11-08 Lukas Steinberger

This paper considers testing a covariance matrix $\Sigma$ in the high dimensional setting where the dimension $p$ can be comparable or much larger than the sample size $n$. The problem of testing the hypothesis $H_0:\Sigma=\Sigma_0$ for a…

Statistics Theory · Mathematics 2013-12-18 T. Tony Cai , Zongming Ma

Leave-one-out cross-validation (LOOCV) can be particularly accurate among cross-validation (CV) variants for machine learning assessment tasks -- e.g., assessing methods' error or variability. But it is expensive to re-fit a model $N$ times…

Machine Learning · Statistics 2020-06-24 William T. Stephenson , Tamara Broderick

Pearson's chi-squared test, from 1900, is the standard statistical tool for "hypothesis testing on distributions": namely, given samples from an unknown distribution $Q$ that may or may not equal a hypothesis distribution $P$, we want to…

Statistics Theory · Mathematics 2023-10-17 Trung Dang , Walter McKelvie , Paul Valiant , Hongao Wang

This paper is devoted to the study of the general linear hypothesis testing (GLHT) problem of multi-sample high-dimensional mean vectors. For the GLHT problem, we introduce a test statistic based on $L^2$-norm and random integration method,…

Statistics Theory · Mathematics 2024-10-22 Mingxiang Cao , Yelong Qiu , Junyong Park

In this paper, we develop invariance-based procedures for testing and inference in high-dimensional regression models. These procedures, also known as randomization tests, provide several important advantages. First, for the global null…

Methodology · Statistics 2023-12-27 Wenxuan Guo , Panos Toulis

In this paper, under the assumption that the dimension is much larger than the sample size, i.e., $p \asymp n^{\alpha}, \alpha>1,$ we consider the (unnormalized) sample covariance matrices $Q = \Sigma^{1/2} XX^*\Sigma^{1/2}$, where…

Statistics Theory · Mathematics 2023-08-22 Xiucai Ding , Zhenggang Wang