English
Related papers

Related papers: From Weighting to Modeling: A Nonparametric Estima…

200 papers

The weighted nearest neighbors (WNN) estimator has been popularly used as a flexible and easy-to-implement nonparametric tool for mean regression estimation. The bagging technique is an elegant way to form WNN estimators with weights…

Machine Learning · Statistics 2022-07-19 Emre Demirkaya , Yingying Fan , Lan Gao , Jinchi Lv , Patrick Vossler , Jingbo Wang

Off-policy evaluation (OPE) in contextual bandits has seen rapid adoption in real-world systems, since it enables offline evaluation of new policies using only historic log data. Unfortunately, when the number of actions is large, existing…

Machine Learning · Computer Science 2022-06-17 Yuta Saito , Thorsten Joachims

When estimating causal effects from observational data with numerous covariates, employing penalized covariate selection can improve the estimation efficiency. Outcome-oriented covariate selection, which involves selecting covariates…

Methodology · Statistics 2025-01-14 Wataru Hongo , Shuji Ando , Jun Tsuchida , Takashi Sozu

Case-cohort studies are conducted within cohort studies, wherein collection of exposure data is limited to a subset of the cohort, leading to a large proportion of missing data by design. Standard analysis uses inverse probability weighting…

Recent advances in large language models (LLMs) have increasingly relied on reinforcement learning (RL) to improve their reasoning capabilities. Three types of approaches have been widely adopted: The first relies on a deep neural network…

Machine Learning · Computer Science 2026-05-19 Shijin Gong , Kai Ye , Jin Zhu , Xinyu Zhang , Hongyi Zhou , Chengchun Shi

The factor modeling for high-dimensional time series is powerful in discovering latent common components for dimension reduction and information extraction. Most available estimation methods can be divided into two categories: the…

Methodology · Statistics 2026-05-26 Xinghao Qiao , Zihan Wang , Qiwei Yao , Bo Zhang

For many machine learning algorithms, two main assumptions are required to guarantee performance. One is that the test data are drawn from the same distribution as the training data, and the other is that the model is correctly specified.…

Machine Learning · Computer Science 2020-02-03 Kun Kuang , Ruoxuan Xiong , Peng Cui , Susan Athey , Bo Li

We study counterfactual classification as a new tool for decision-making under hypothetical (contrary to fact) scenarios. We propose a doubly-robust nonparametric estimator for a general counterfactual classifier, where we can incorporate…

Machine Learning · Computer Science 2023-01-31 Kwangho Kim , Edward H. Kennedy , José R. Zubizarreta

Marginal structural models (MSMs) with inverse probability weighting offer an approach to estimating causal effects of treatment sequences on repeated outcome measures in the presence of time-varying confounding and dependent censoring.…

Methodology · Statistics 2018-07-02 Sean Yiu , Li Su

When examining a contrast between two interventions, longitudinal causal inference studies frequently encounter positivity violations when one or both regimes are impossible to observe for some subjects. Existing weighting methods either…

Methodology · Statistics 2025-08-11 Alec McClean , Iván Díaz

Comparative effectiveness research often involves evaluating the differences in the risks of an event of interest between two or more treatments using observational data. Often, the post-treatment outcome of interest is whether the event…

Methodology · Statistics 2022-05-18 Youfei Yu , Min Zhang , Bhramar Mukherjee

Treatment-induced confounders complicate analyses of time-varying treatment effects and causal mediation. Conditioning on these variables naively to estimate marginal effects may inappropriately block causal pathways and may induce spurious…

Applications · Statistics 2018-08-24 Geoffrey T. Wodtke , Zahide Alaca , Xiang Zhou

We study nonparametric estimation of univariate cumulative distribution functions (CDFs) pertaining to data missing at random. The proposed estimators smooth the inverse probability weighted (IPW) empirical CDF with the Bernstein operator,…

Statistics Theory · Mathematics 2026-03-30 Rihab Gharbi , Wissem Jedidi , Salah Khardani , Frédéric Ouimet

A key challenge in estimating causal effects from observational data is handling confounding and is commonly achieved through weighting methods that balance distribution of covariates between treatment and control groups. Weighting…

Methodology · Statistics 2025-12-23 Simion De , Jared D. Huling

We present a new approach to the problems of evaluating and learning personalized decision policies from observational data of past contexts, decisions, and outcomes. Only the outcome of the enacted decision is available and the historical…

Machine Learning · Statistics 2019-06-04 Nathan Kallus

Semi-parametric methods are often used for the estimation of intervention effects on correlated outcomes in cluster-randomized trials (CRTs). When outcomes are missing at random (MAR), Inverse Probability Weighted (IPW) methods…

Methodology · Statistics 2016-01-27 Melanie Prague , Rui Wang , Alisa Stephens , Eric Tchetgen Tchetgen , Victor DeGruttola

We propose a new weighted average estimator for the high dimensional parameters under the distributed learning system, in which the weight assigned to each coordinate is precisely proportional to the inverse of the variance of the local…

Methodology · Statistics 2025-02-06 Jun Lu , Xiaoyu Mao , Mengyao Li , Chenping Hou

Reinforcement Learning (RL) has made significant strides in complex tasks but struggles in multi-task settings with different embodiments. World model methods offer scalability by learning a simulation of the environment but often rely on…

Machine Learning · Computer Science 2025-02-25 Ignat Georgiev , Varun Giridhar , Nicklas Hansen , Animesh Garg

In estimating the average treatment effect in observational studies, the influence of confounders should be appropriately addressed. To this end, the propensity score is widely used. If the propensity scores are known for all the subjects,…

Methodology · Statistics 2023-12-08 Chengyao Tang , Yi Zhou , Ao Huang , Satoshi Hattori

Reinforcement learning (RL) algorithms still suffer from high sample complexity despite outstanding recent successes. The need for intensive interactions with the environment is especially observed in many widely popular policy gradient…

Machine Learning · Computer Science 2020-08-04 Samuele Tosatto , Joao Carvalho , Hany Abdulsamad , Jan Peters