English
Related papers

Related papers: Optimal inference in a class of regression models

200 papers

Most modern learning problems are over-parameterized, where the number of learnable parameters is much greater than the number of training data points. In this over-parameterized regime, the training loss typically has infinitely many…

Machine Learning · Computer Science 2025-06-23 Kanumuri Nithin Varma , Babak Hassibi

We develop a uniform inference theory for high-dimensional slope parameters in threshold regression models, allowing for either cross-sectional or time series data. We first establish oracle inequalities for prediction errors, and L1…

Econometrics · Economics 2025-09-16 Jiatong Li , Hongqiang Yan

The problem of best subset selection in linear regression is considered with the aim to find a fixed size subset of features that best fits the response. This is particularly challenging when the total available number of features is very…

Methodology · Statistics 2023-11-28 Sarat Moka , Benoit Liquet , Houying Zhu , Samuel Muller

Linear regression models are among the models most used in practice, although the practitioners are often not sure whether their assumed linear regression model is at least approximately true. In such situations, only designs for which the…

Statistics Theory · Mathematics 2007-06-13 Wolfgang Bischoff , Frank Miller

We aim to construct a class of learning algorithms that are of practical value to applied researchers in fields such as biostatistics, epidemiology and econometrics, where the need to learn from incompletely observed information is…

Methodology · Statistics 2021-02-09 Alicia Curth , Ahmed M. Alaa , Mihaela van der Schaar

In semivarying coefficient models for longitudinal/clustered data, usually of primary interest is usually the parametric component which involves unknown constant coefficients. First, we study semiparametric efficiency bound for estimation…

Methodology · Statistics 2015-09-15 Ming-Yen Cheng , Toshio Honda , Jialiang Li

We introduce flexible robust functional regression models, using various heavy-tailed processes, including a Student $t$-process. We propose efficient algorithms in estimating parameters for the marginal mean inferences and in predicting…

Methodology · Statistics 2017-05-17 Chunzheng Cao , Jian Qing Shi , Youngjo Lee

Avoiding overfitting is a central challenge in machine learning, yet many large neural networks readily achieve zero training loss. This puzzling contradiction necessitates new approaches to the study of overfitting. Here we quantify…

Information Theory · Computer Science 2022-10-13 Vudtiwat Ngampruetikorn , David J. Schwab

Although neural networks are powerful function approximators, the underlying modelling assumptions ultimately define the likelihood and thus the hypothesis class they are parameterizing. In classification, these assumptions are minimal as…

Machine Learning · Computer Science 2021-11-24 Maria R. Cervera , Rafael Dätwyler , Francesco D'Angelo , Hamza Keurti , Benjamin F. Grewe , Christian Henning

Distributed machine learning systems have been receiving increasing attentions for their efficiency to process large scale data. Many distributed frameworks have been proposed for different machine learning tasks. In this paper, we study…

Machine Learning · Computer Science 2020-07-01 Hongwei Sun , Qiang Wu

Nonparametric regression problems with qualitative constraints such as monotonicity or convexity are ubiquitous in applications. For example, in predicting the yield of a factory in terms of the number of labor hours, the monotonicity of…

Statistics Theory · Mathematics 2023-11-21 Soham Mallick , Siddhaarth Sarkar , Arun Kumar Kuchibhotla

In this article we investigate consistency of selection in regression models via the popular Lasso method. Here we depart from the traditional linear regression assumption and consider approximations of the regression function $f$ with…

Statistics Theory · Mathematics 2008-12-18 Florentina Bunea

We study the behavior of linear discriminant functions for binary classification in the infinite-imbalance limit, where the sample size of one class grows without bound while the sample size of the other remains fixed. The coefficients of…

Machine Learning · Statistics 2023-05-15 Paul Glasserman , Mike Li

The earth system is exceedingly complex and often chaotic in nature, making prediction incredibly challenging: we cannot expect to make perfect predictions all of the time. Instead, we look for specific states of the system that lead to…

Machine Learning · Computer Science 2022-01-05 Elizabeth A. Barnes , Randal J. Barnes

Robins et al. (2008) introduced a class of influence functions (IFs) which could be used to obtain doubly robust moment functions for the corresponding parameters. However, that class does not include the IF of parameters for which the…

Machine Learning · Statistics 2022-03-08 AmirEmad Ghassami , Andrew Ying , Ilya Shpitser , Eric Tchetgen Tchetgen

In this paper, we introduce a novel method to generate interpretable regression function estimators. The idea is based on called data-dependent coverings. The aim is to extract from the data a covering of the feature space instead of a…

Statistics Theory · Mathematics 2021-01-27 Vincent Margot , Jean-Patrick Baudry , Frédéric Guilloux , Olivier Wintenberger

Given a collection of feature maps indexed by a set $\mathcal{T}$, we study the performance of empirical risk minimization (ERM) on regression problems with square loss over the union of the linear classes induced by these feature maps.…

Machine Learning · Statistics 2024-11-20 Ayoub El Hanchi , Chris J. Maddison , Murat A. Erdogdu

This paper addresses the classic problem of regression, which involves the inductive learning of a map, $y=f(x,z)$, $z$ denoting noise, $f:\mathbb{R}^n\times \mathbb{R}^k \rightarrow \mathbb{R}^m$. Recently, Conditional GAN (CGAN) has been…

Machine Learning · Computer Science 2020-03-04 Saurav Manchanda , Khoa Doan , Pranjul Yadav , S. Sathiya Keerthi

Performativity of predictions refers to the phenomenon where prediction-informed decisions influence the very targets they aim to predict -- a dynamic commonly observed in policy-making, social sciences, and economics. In this paper, we…

Machine Learning · Statistics 2025-10-28 Xiang Li , Yunai Li , Huiying Zhong , Lihua Lei , Zhun Deng

The problem of error density estimation for a functional single index model with dependent errors is studied. A Bayesian method is utilized to simultaneously estimate the bandwidths in the kernel-form error density and regression function,…

Applications · Statistics 2018-10-23 Han Lin Shang