English
Related papers

Related papers: On the implied weights of linear regression for ca…

200 papers

We study estimation and inference using data collected by reinforcement learning (RL) algorithms. These algorithms adaptively experiment by interacting with individual units over multiple stages, updating their strategies based on past…

Machine Learning · Statistics 2025-10-06 Vasilis Syrgkanis , Ruohan Zhan

Recent results in nonparametric regression show that for deep learning, i.e., for neural network estimates with many hidden layers, we are able to achieve good rates of convergence even in case of high-dimensional predictor variables,…

Statistics Theory · Mathematics 2019-12-12 Alina Braun , Michael Kohler , Adam Krzyzak

Many causal models of interest in epidemiology involve longitudinal exposures, confounders and mediators. However, repeated measurements are not always available or used in practice, leading analysts to overlook the time-varying nature of…

Methodology · Statistics 2023-02-21 Lola Etievant , Vivian Viallon

We develop a criterion to certify whether causal effects are identifiable in linear structural equation models with latent variables. Linear structural equation models correspond to directed graphs whose nodes represent the random variables…

Statistics Theory · Mathematics 2025-07-25 Nils Sturma , Mathias Drton

Many problems in signal processing require finding sparse solutions to under-determined, or ill-conditioned, linear systems of equations. When dealing with real-world data, the presence of outliers and impulsive noise must also be accounted…

Statistics Theory · Mathematics 2017-05-08 Jasin Machkour , Michael Muma , Bastian Alt , Abdelhak M. Zoubir

In Regression Discontinuity (RD) design, self-selection leads to different distributions of covariates on two sides of the policy intervention, which essentially violates the continuity of potential outcome assumption. The standard RD…

Methodology · Statistics 2019-11-22 Sida Peng , Yang Ning

Causal inference is known to be very challenging when only observational data are available. Randomized experiments are often costly and impractical and in instrumental variable regression the number of instruments has to exceed the number…

Methodology · Statistics 2018-06-19 Dominik Rothenhäusler , Peter Bühlmann , Nicolai Meinshausen

Given a response $Y$ and a vector $X = (X^1, \dots, X^d)$ of $d$ predictors, we investigate the problem of inferring direct causes of $Y$ among the vector $X$. Models for $Y$ that use all of its causal covariates as predictors enjoy the…

Statistics Theory · Mathematics 2020-03-12 Rune Christiansen , Jonas Peters

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Causal discovery from data affected by unobserved variables is an important but difficult problem to solve. The effects that unobserved variables have on the relationships between observed variables are more complex in nonlinear cases than…

Machine Learning · Computer Science 2021-06-07 Takashi Nicholas Maeda , Shohei Shimizu

In this paper, we propose a data-adaptive empirical likelihood-based approach for treatment effect estimation and inference, which overcomes the obstacle of the traditional empirical likelihood-based approaches in the high-dimensional…

Methodology · Statistics 2020-12-15 Wei Liang , Ying Yan

Generalized causal effect estimands, including the Mann-Whitney parameter and causal net benefit, provide flexible summaries of treatment effects in randomized experiments with non-Gaussian or multivariate outcomes. We develop a unified…

Methodology · Statistics 2026-02-27 Xinyuan Chen , Fan Li

Advancements in data collection techniques and the heterogeneity of data resources can yield high percentages of missing observations on variables, such as block-wise missing data. Under missing-data scenarios, traditional methods such as…

Methodology · Statistics 2022-05-17 Wei Lan , Xuerong Chen , Tao Zou , Chih-Ling Tsai

This paper is concerned with inference on the regression function of a high-dimensional linear model when outcomes are missing at random. We propose an estimator which combines a Lasso pilot estimate of the regression function with a bias…

Methodology · Statistics 2024-12-11 Yikun Zhang , Alexander Giessing , Yen-Chi Chen

Causal inference starts with a simple idea: compare groups that differ by treatment, not much else. Traditionally, similar groups are constructed using only observed covariates; however, it remains a long-standing challenge to incorporate…

Methodology · Statistics 2025-11-21 Ying Jin , José Zubizarreta

We consider an empirical likelihood framework for inference for a statistical model based on an informative sampling design. Covariate information is incorporated both through the weights and the estimating equations. The estimator is based…

Methodology · Statistics 2019-05-03 Sanjay Chaudhuri , Mark S. Handcock

Causal or unconfounded descriptive comparisons between multiple groups are common in observational studies. Motivated from a racial disparity study in health services research, we propose a unified propensity score weighting framework, the…

Methodology · Statistics 2019-07-10 Fan Li , Fan Li

Consider a scenario where we have access to train data with both covariates and outcomes while test data only contains covariates. In this scenario, our primary aim is to predict the missing outcomes of the test data. With this objective in…

Methodology · Statistics 2024-10-29 Masahiro Kato , Kota Matsui , Ryo Inokuchi

Modern statistical analysis often encounters high-dimensional problems but with a limited sample size. It poses great challenges to traditional statistical estimation methods. In this work, we adopt auxiliary learning to solve the…

Statistics Theory · Mathematics 2025-01-08 Hanchao Yan , Feifei Wang , Chuanxin Xia , Hansheng Wang

Statistical inference on the explained variation of an outcome by a set of covariates is of particular interest in practice. When the covariates are of moderate to high-dimension and the effects are not sparse, several approaches have been…

Methodology · Statistics 2022-01-24 Hua Yun Chen