English
Related papers

Related papers: Debiased Machine Learning of Aggregated Intersecti…

200 papers

Debiasing is a fundamental concept in high-dimensional statistics. While degrees-of-freedom adjustment is the state-of-the-art technique in high-dimensional linear regression, it is limited to i.i.d. samples and sub-Gaussian covariates.…

Statistics Theory · Mathematics 2026-01-01 Yufan Li , Pragya Sur

Algorithms are increasingly used to aid with high-stakes decision making. Yet, their predictive ability frequently exhibits systematic variation across population subgroups. To assess the trade-off between fairness and accuracy using finite…

Econometrics · Economics 2025-06-17 Yiqi Liu , Francesca Molinari

We propose a novel use of a broadcasting operation, which distributes univariate functions to all entries of the tensor covariate, to model the nonlinearity in tensor regression nonparametrically. A penalized estimation and the…

Methodology · Statistics 2024-04-02 Ya Zhou , Raymond K. W. Wong , Kejun He

This article deals with the analysis of high dimensional data that come from multiple sources (experiments) and thus have different possibly correlated responses, but share the same set of predictors. The measurements of the predictors may…

Methodology · Statistics 2020-07-01 Guorong Dai , Ursula U. Müller , Raymond J. Carroll

Cross-classified data frequently arise in scientific fields such as education, healthcare, and social sciences. A common modeling strategy is to introduce crossed random effects within a regression framework. However, this approach often…

Methodology · Statistics 2025-07-22 Shota Takeishi , Shonosuke Sugasawa

In this paper, we consider a high-dimensional quantile regression model where the sparsity structure may differ between two sub-populations. We develop $\ell_1$-penalized estimators of both regression coefficients and the threshold…

Methodology · Statistics 2018-12-07 Sokbae Lee , Yuan Liao , Myung Hwan Seo , Youngki Shin

This paper describes computationally efficient approaches and associated theoretical performance guarantees for the detection of known targets and anomalies from few projection measurements of the underlying signals. The proposed approaches…

Statistics Theory · Mathematics 2015-06-03 Kalyani Krishnamurthy , Rebecca Willett , Maxim Raginsky

For the estimation of cumulative link models for ordinal data, the bias-reducing adjusted score equations in \citet{firth:93} are obtained, whose solution ensures an estimator with smaller asymptotic bias than the maximum likelihood…

Methodology · Statistics 2018-02-16 Ioannis Kosmidis

We consider the optimization of a quadratic objective function whose gradients are only accessible through a stochastic oracle that returns the gradient at any given point plus a zero-mean finite variance random error. We present the first…

Optimization and Control · Mathematics 2016-02-25 Aymeric Dieuleveut , Nicolas Flammarion , Francis Bach

A central goal of causal inference is to detect and estimate the treatment effects of a given treatment or intervention on an outcome variable of interest, where a member known as the heterogeneous treatment effect (HTE) is of growing…

Statistics Theory · Mathematics 2020-10-27 Zijun Gao , Yanjun Han

Causal and nonparametric estimands in economics and biostatistics can often be viewed as the mean of a linear functional applied to an unknown outcome regression function. Naively learning the regression function and taking a sample mean of…

Machine Learning · Statistics 2025-11-12 Christian L. Hines , Oliver J. Hines

This paper studies the interpretability of neural network features from a Bayesian Gaussian view, where optimizing a cost is reaching a probabilistic bound; learning a model approximates a density that makes the bound tight and the cost…

Machine Learning · Computer Science 2025-11-18 Bo Hu , Jose C. Principe

Sequential estimation of a vector of linear regression coefficients is considered under both centralized and decentralized setups. In sequential estimation, the number of observations used for estimation is determined by the observed…

Applications · Statistics 2014-12-18 Yasin Yilmaz , George V. Moustakides , Xiaodong Wang

Multiple-subject network data are fast emerging in recent years, where a separate connectivity matrix is measured over a common set of nodes for each individual subject, along with subject covariates information. In this article, we propose…

Methodology · Statistics 2021-03-23 Jingfei Zhang , Will Wei Sun , Lexin Li

Modeling the interference effect is an important issue in the field of causal inference. Existing studies rely on explicit and often homogeneous assumptions regarding interference structures. In this paper, we introduce a low-rank and…

Methodology · Statistics 2024-10-31 Wei Zhang , Ying Yang , Fang Yao

In statistical exercises where there are several candidate models, the traditional approach is to select one model using some data driven criterion and use that model for estimation, testing and other purposes, ignoring the variability of…

Statistics Theory · Mathematics 2008-12-18 Snigdhansu Chatterjee , Nitai D. Mukhopadhyay

We study a functional linear regression model that deals with functional responses and allows for both functional covariates and high-dimensional vector covariates. The proposed model is flexible and nests several functional regression…

Statistics Theory · Mathematics 2022-08-24 Daren Wang , Zifeng Zhao , Yi Yu , Rebecca Willett

We propose a method for estimation in high-dimensional linear models with nominal categorical data. Our estimator, called SCOPE, fuses levels together by making their corresponding coefficients exactly equal. This is achieved using the…

Methodology · Statistics 2021-12-21 Benjamin G. Stokell , Rajen D. Shah , Ryan J. Tibshirani

Consider the problem of learning a large number of response functions simultaneously based on the same input variables. The training data consist of a single independent random sample of the input variables drawn from a common distribution…

Machine Learning · Statistics 2021-11-30 Vincent Plassier , François Portier , Johan Segers

We consider the problem of multi-task learning in the high dimensional setting. In particular, we introduce an estimator and investigate its statistical and computational properties for the problem of multiple connected linear regressions…

Machine Learning · Statistics 2023-07-03 Amir Asiaee , Samet Oymak , Kevin R. Coombes , Arindam Banerjee