English
Related papers

Related papers: Uniformly most powerful tests in linear models

200 papers

Often the question arises whether $Y$ can be predicted based on $X$ using a certain model. Especially for highly flexible models such as neural networks one may ask whether a seemingly good prediction is actually better than fitting pure…

Methodology · Statistics 2024-04-30 Michał Ciszewski , Jakob Söhl , Ton Leenen , Bart van Trigt , Geurt Jongbloed

The log-normal distribution is one of the most common distributions used for modeling skewed and positive data. It frequently arises in many disciplines of science, specially in the biological and medical sciences. The statistical analysis…

Methodology · Statistics 2020-01-01 Ayanendranath Basu , Abhijit Mandal , Nirian Martin , Leandro Pardo

We propose a test of many zero parameter restrictions in a high dimensional linear iid regression model with $k$ $>>$ $n$ regressors. The test statistic is formed by estimating key parameters one at a time based on many low dimension…

Statistics Theory · Mathematics 2023-12-12 Jonathan B. Hill

Hypothesis tests in models whose dimension far exceeds the sample size can be formulated much like the classical studentized tests only after the initial bias of estimation is removed successfully. The theory of debiased estimators can be…

Machine Learning · Statistics 2017-02-22 Jelena Bradic , Mladen Kolar

Detecting dependence between two random variables is a fundamental problem. Although the Pearson correlation is effective for capturing linear dependency, it can be entirely powerless for detecting nonlinear and/or heteroscedastic patterns.…

Methodology · Statistics 2016-11-21 Xufei Wang , Bo Jiang , Jun S. Liu

We consider finite-sample inference for a single regression coefficient in the fixed-design linear model $Y = Z\beta + bX + \varepsilon$, where $\varepsilon\in\mathbb{R}^n$ may exhibit complex dependence or heterogeneity. We develop a group…

Methodology · Statistics 2026-04-20 Zonghan Li , Hongyi Zhou , Zhiheng Zhang

Statistical techniques are used in all branches of science to determine the feasibility of quantitative hypotheses. One of the most basic applications of statistical techniques in comparative analysis is the test of equality of two…

Methodology · Statistics 2018-05-01 Ayanendranath Basu , Abhijit Mandal , Nirian Martin , Leandro Pardo

We consider the problem of robust inference under the generalized linear model (GLM) with stochastic covariates. We derive the properties of the minimum density power divergence estimator of the parameters in GLM with random design and use…

Methodology · Statistics 2020-04-06 Ayanendranath Basu , Abhik Ghosh , Abhijit Mandal , Nirian Martin , Leandro Pardo

We develop a class of optimal tests for a structural break occurring at an unknown date in infinite and growing-order time series regression models, such as AR($\infty$), linear regression with increasingly many covariates, and…

Econometrics · Economics 2025-10-15 Abhimanyu Gupta , Myung Hwan Seo

We introduce a new procedure for testing the significance of a set of regression coefficients in a Gaussian linear model with $n \geq d$. Our method, the $L$-test, provides the same statistical validity guarantee as the classical $F$-test,…

Methodology · Statistics 2025-12-01 Danielle Paulson , Souhardya Sengupta , Lucas Janson

Nonparametric two sample testing deals with the question of consistently deciding if two distributions are different, given samples from both, without making any parametric assumptions about the form of the distributions. The current…

Statistics Theory · Mathematics 2014-11-25 Aaditya Ramdas , Sashank J. Reddi , Barnabas Poczos , Aarti Singh , Larry Wasserman

Test statistics which are invariant under various subgroups of the orthogonal group are shown to provide tests whose powers are asymptotically equal to their level against the usual type of contiguous alternative in models where the number…

Statistics Theory · Mathematics 2016-08-23 Richard A Lockhart

We study uniform consistency in nonparametric mixture models as well as closely related mixture of regression (also known as mixed regression) models, where the regression functions are allowed to be nonparametric and the error…

Statistics Theory · Mathematics 2022-12-29 Bryon Aragam , Ruiyi Yang

The scope of this paper is the presentation of a test that enables to detect heteroscedasticity in univariate regression model. The test is simple to compute and very general since no hypothesis is made on the regularity of the response…

Methodology · Statistics 2010-03-23 Jean-Baptiste Aubin , Samuela Leoni-Aubin

Regression is one of the most commonly used statistical techniques. However, testing regression systems is a great challenge because of the absence of test oracle in general. In this paper, we show that Metamorphic Testing is an effective…

Methodology · Statistics 2021-08-24 Quang-Hung Luu , Man F. Lau , Sebastian P. H. Ng , Tsong Yueh Chen

Designing learning algorithms that are resistant to perturbations of the underlying data distribution is a problem of wide practical and theoretical importance. We present a general approach to this problem focusing on unsupervised…

Machine Learning · Computer Science 2021-02-22 Andreas Maurer , Daniela A. Parletta , Andrea Paudice , Massimiliano Pontil

We consider the problem of constructing optimal designs for model discrimination between competing regression models. Various new properties of optimal designs with respect to the popular $T$-optimality criterion are derived, which in many…

Statistics Theory · Mathematics 2009-08-14 Holger Dette , Stefanie Titoff

We introduce a rank-based bent linear regression with an unknown change point. Using a linear reparameterization technique, we propose a rank-based estimate that can make simultaneous inference on all model parameters, including the…

Methodology · Statistics 2016-06-08 Feipeng Zhang , Qunhua Li

Permutation tests are a powerful and flexible approach to inference via resampling. As computational methods become more ubiquitous in the statistics curriculum, use of permutation tests has become more tractable. At the heart of the…

Methodology · Statistics 2025-06-09 Johanna Hardin , Lauren Quesada , Julie Ye , Nicholas J. Horton

We improve a known result on the strong consistency of M-estimates of the regression parameters in a linear model for independent and identically distributed random errors under some mild conditions.

Statistics Theory · Mathematics 2015-05-28 Xinghui Wang , Shuhe Hu