English
Related papers

Related papers: Dyson Equation for Correlated Linearizations and T…

200 papers

Testing restrictions on regression coefficients in linear models often requires correcting the conventional F-test for potential heteroskedasticity or autocorrelation amongst the disturbances, leading to so-called heteroskedasticity and…

Statistics Theory · Mathematics 2016-12-21 David Preinerstorfer , Benedikt M. Pötscher

We revisit the classical problem of comparing regression functions, a fundamental question in statistical inference with broad relevance to modern applications such as data integration, transfer learning, and causal inference. Existing…

Methodology · Statistics 2025-10-29 Jian Yan , Zhuoxi Li , Yang Ning , Yong Chen

Heteroscedasticity testing is of importance in regression analysis. Existing local smoothing tests suffer severely from curse of dimensionality even when the number of covariates is moderate because of use of nonparametric estimation. In…

Methodology · Statistics 2015-10-14 Xuehu Zhu , Fei Chen , Xu Guo , Lixing Zhu

Regression adjustment is broadly applied in randomized trials under the premise that it usually improves the precision of a treatment effect estimator. However, previous work has shown that this is not always true. To further understand…

Methodology · Statistics 2022-10-11 Katarzyna Reluga , Ting Ye , Qingyuan Zhao

Asymptotic equivalence theory developed in the literature so far are only for bounded loss functions. This limits the potential applications of the theory because many commonly used loss functions in statistical inference are unbounded. In…

Statistics Theory · Mathematics 2009-09-03 T. Tony Cai , Harrison H. Zhou

We propose a method for detecting differential gene expression that exploits the correlation between genes. Our proposal averages the univariate scores of each feature with the scores in correlation neighborhoods. In a number of real and…

Statistics Theory · Mathematics 2007-06-13 Robert Tibshirani , Larry Wasserman

Regression models usually tend to recover a noisy signal in the form of a combination of regressors, also called features in machine learning, themselves being the result of a learning process.The alignment of the prior covariance feature…

Statistical Mechanics · Physics 2023-01-25 Cyril Furtlehner

A finite-support constraint on the parameter space is used to derive a lower bound on the error of an estimator of the correlation coefficient in the bivariate exponential distribution. The bound is then exploited to examine optimality of…

Methodology · Statistics 2017-02-13 W. J. Szajnowski

This work is concerned with the estimation of multidimensional regression and the asymptotic behaviour of the test involved in selecting models. The main problem with such models is that we need to know the covariance matrix of the noise to…

Statistics Theory · Mathematics 2008-02-20 Joseph Rynkiewicz

Not a matter of serious contention, Pearson's correlation coefficient is still the most important statistical association measure. Restricted to just two variables, this measure sometimes doesn't live up to users' needs and expectations.…

Mathematical Finance · Quantitative Finance 2024-02-02 Reza Salimi , Kamran Pakizeh

We study the problem of distributed mean estimation and optimization under communication constraints. We propose a correlated quantization protocol whose leading term in the error guarantee depends on the mean deviation of data points…

Machine Learning · Computer Science 2022-07-12 Ananda Theertha Suresh , Ziteng Sun , Jae Hun Ro , Felix Yu

Many probabilistic models that have an intractable normalizing constant may be extended to contain covariates. Since the evaluation of the exact likelihood is difficult or even impossible for these models, score matching was proposed to…

Statistics Theory · Mathematics 2022-03-21 Jiazhen Xu , Janice L. Scealy , Andrew T. A. Wood , Tao Zou

Providing non-conservative uncertainty quantification for function estimates derived from noisy observations remains a fundamental challenge in statistical machine learning, particularly for applications in safety-critical domains. In this…

Machine Learning · Computer Science 2026-05-12 Johannes Teutsch , Oleksii Molodchyk , Marion Leibold , Timm Faulwasser , Armin Lederer

We provide a unified analysis of the predictive risk of ridge regression and regularized discriminant analysis in a dense random effects model. We work in a high-dimensional asymptotic regime where $p, n \to \infty$ and $p/n \to \gamma \in…

Statistics Theory · Mathematics 2015-11-05 Edgar Dobriban , Stefan Wager

We consider the problem of efficient statistical inference for comparing two regression curves estimated from two samples of dependent measurements. Based on a representation of the best pair of linear unbiased estimators in continuous time…

Methodology · Statistics 2016-01-29 Holger Dette , Kirsten Schorning , Maria Konstantinou

Linear regression is often deemed inherently interpretable; however, challenges arise for high-dimensional data. We focus on further understanding how linear regression approximates nonlinear responses from high-dimensional functional data,…

Machine Learning · Computer Science 2024-11-20 Joachim Schaeffer , Jinwook Rhyu , Robin Droop , Rolf Findeisen , Richard Braatz

This manuscript considers the problem of learning a random Gaussian network function using a fully connected network with frozen intermediate layers and trainable readout layer. This problem can be seen as a natural generalization of the…

Machine Learning · Statistics 2023-02-02 Dominik Schröder , Hugo Cui , Daniil Dmitriev , Bruno Loureiro

Additive models play an essential role in studying non-linear relationships. Despite many recent advances in estimation, there is a lack of methods and theories for inference in high-dimensional additive models, including confidence…

Statistics Theory · Mathematics 2022-02-18 Zijian Guo , Wei Yuan , Cun-Hui Zhang

Sparse deep learning has become a popular technique for improving the performance of deep neural networks in areas such as uncertainty quantification, variable selection, and large-scale network compression. However, most existing research…

Machine Learning · Statistics 2023-10-06 Mingxuan Zhang , Yan Sun , Faming Liang

The effectiveness of non-parametric, kernel-based methods for function estimation comes at the price of high computational complexity, which hinders their applicability in adaptive, model-based control. Motivated by approximation techniques…

Statistics Theory · Mathematics 2023-03-17 Anna Scampicchio , Elena Arcari , Melanie N. Zeilinger