English
Related papers

Related papers: Exact results on high-dimensional linear regressio…

200 papers

Statistical inference is the science of drawing conclusions about some system from data. In modern signal processing and machine learning, inference is done in very high dimension: very many unknown characteristics about the system have to…

Disordered Systems and Neural Networks · Physics 2020-10-29 Jean Barbier

Predict a new response from a covariate is a challenging task in regression, which raises new question since the era of high-dimensional data. In this paper, we are interested in the inverse regression method from a theoretical viewpoint.…

Statistics Theory · Mathematics 2018-07-10 Emilie Devijver , Emeline Perthame

This paper presents a selective survey of recent developments in statistical inference and multiple testing for high-dimensional regression models, including linear and logistic regression. We examine the construction of confidence…

Methodology · Statistics 2023-01-26 T. Tony Cai , Zijian Guo , Yin Xia

For the last two decades, high-dimensional data and methods have proliferated throughout the literature. Yet, the classical technique of linear regression has not lost its usefulness in applications. In fact, many high-dimensional…

Statistics Theory · Mathematics 2021-05-18 Arun Kumar Kuchibhotla , Lawrence D. Brown , Andreas Buja , Edward I. George , Linda Zhao

Machine-learning techniques have become fundamental in high-energy physics and, for new physics searches, it is crucial to know their performance in terms of experimental sensitivity, understood as the statistical significance of the…

High Energy Physics - Phenomenology · Physics 2022-11-10 Ernesto Arganda , Xabier Marcano , Víctor Martín Lozano , Anibal D. Medina , Andres D. Perez , Manuel Szewc , Alejandro Szynkman

We consider linear regression problems with a varying number of random projections, where we provably exhibit a double descent curve for a fixed prediction problem, with a high-dimensional analysis based on random matrix theory. We first…

Machine Learning · Computer Science 2023-03-15 Francis Bach

Our predictions for particle physics processes are realized in a chain of complex simulators. They allow us to generate high-fidelity simulated data, but they are not well-suited for inference on the theory parameters with observed data. We…

High Energy Physics - Phenomenology · Physics 2020-11-03 Johann Brehmer , Kyle Cranmer

The purpose of this paper is to propose methodologies for statistical inference of low-dimensional parameters with high-dimensional data. We focus on constructing confidence intervals for individual coefficients and linear combinations of…

Methodology · Statistics 2012-11-05 Cun-Hui Zhang , Stephanie S. Zhang

Over the past two decades, the field of high-dimensional statistics has experienced substantial progress, driven largely by technological advances that have dramatically reduced the cost and effort for data collection and storage across a…

In this paper, we develop a systematic theory for high dimensional analysis of variance in multivariate linear regression, where the dimension and the number of coefficients can both grow with the sample size. We propose a new \emph{U}~type…

Methodology · Statistics 2023-01-12 Zhipeng Lou , Xianyang Zhang , Wei Biao Wu

For high dimensional data, some of the standard statistical techniques do not work well. So modification or further development of statistical methods are necessary. In this paper, we explore these modifications. We start with the important…

Statistical Finance · Quantitative Finance 2024-05-29 Arnab Chakrabarti , Rituparna Sen

We introduce linear regression using physics-based basis functions optimized through the geometry of an inner product space. This method addresses the challenge of surrogate modeling with high-dimensional input, as the physics-based basis…

Data Analysis, Statistics and Probability · Physics 2024-11-26 Ziqi Wang

In the next decade, high energy physicists will use very sophisticated equipment to record unprecedented amounts of data in the hope of making major advances in our understanding of particle phenomena. Some of the signals of new physics…

High Energy Physics - Experiment · Physics 2009-11-07 Pushpalatha C. Bhat

Modern applications require methods that are computationally feasible on large datasets but also preserve statistical efficiency. Frequently, these two concerns are seen as contradictory: approximation methods that enable computation are…

Methodology · Statistics 2021-06-11 Darren Homrighausen , Daniel J. McDonald

In this paper, we present a novel and effective inference approach to conduct both finite- and large-sample inference for high-dimensional linear regression models. This approach is developed under the so-called repro samples framework, in…

Methodology · Statistics 2025-12-01 Peng Wang , Min-Ge Xie , Linjun Zhang

We propose a new method of estimation in high-dimensional linear regression model. It allows for very weak distributional assumptions including heteroscedasticity, and does not require the knowledge of the variance of random errors. The…

Statistics Theory · Mathematics 2013-04-16 Eric Gautier , Alexandre Tsybakov

The ability to understand and solve high-dimensional inference problems is essential for modern data science. This article examines high-dimensional inference problems through the lens of information theory and focuses on the standard…

Information Theory · Computer Science 2019-07-05 Galen Reeves , Henry Pfister

This article is due to appear in the Handbook of Statistics, Vol. 43, Elsevier/North-Holland, Amsterdam, edited by Arni S. R. Srinivasa Rao and C. R. Rao. In modern day analytics, there is ever growing need to develop statistical models to…

Statistics Theory · Mathematics 2019-08-20 Deepak Nag Ayyala

We propose a methodology for testing linear hypothesis in high-dimensional linear models. The proposed test does not impose any restriction on the size of the model, i.e. model sparsity or the loading vector representing the hypothesis.…

Methodology · Statistics 2019-07-09 Yinchu Zhu , Jelena Bradic

High-dimensional linear regression is important in many scientific fields. This article considers discrete measured data of underlying smooth latent processes, as is often obtained from chemical or biological systems. Interpretation in high…

‹ Prev 1 2 3 10 Next ›