English
Related papers

Related papers: How do dataset characteristics affect the performa…

200 papers

Propensity score weighting is a common method for estimating treatment effects with survey data. The method is applied to minimize confounding using measured covariates that are often different between individuals in treatment and control.…

Methodology · Statistics 2026-02-06 Yukang Zeng , Fan Li , Guangyu Tong

In this paper, we propose a robust method to estimate the average treatment effects in observational studies when the number of potential confounders is possibly much greater than the sample size. We first use a class of penalized…

Methodology · Statistics 2018-12-21 Yang Ning , Sida Peng , Kosuke Imai

Datasets for training recommender systems are often subject to distribution shift induced by users' and recommenders' selection biases. In this paper, we study the impact of selection bias on datasets with different quantization. We then…

Information Retrieval · Computer Science 2022-12-29 Fengyu Li , Sarah Dean

The comparison of different medical treatments from observational studies or across different clinical studies is often biased by confounding factors such as systematic differences in patient demographics or in the inclusion criteria for…

Methodology · Statistics 2025-05-15 Ekkehard Glimm , Lillian Yau

Propensity scores are commonly used to estimate treatment effects from observational data. We argue that the probabilistic output of a learned propensity score model should be calibrated -- i.e., a predictive treatment probability of 90%…

Methodology · Statistics 2024-06-06 Shachi Deshpande , Volodymyr Kuleshov

Propensity score weighting is a tool for causal inference to adjust for measured confounders in observational studies. In practice, data often present complex structures, such as clustering, which make propensity score modeling and…

Methodology · Statistics 2017-03-20 Shu Yang

Propensity score matching is commonly used to draw causal inference from observational survival data. However, its asymptotic properties have yet to be established, and variance estimation is still open to debate. We derive the statistical…

Methodology · Statistics 2024-12-24 Tongrong Wang , Honghe Zhao , Shu Yang , Shuhan Tang , Zhanglin Cui , Li Li , Douglas E. Faries

Rapid advancements in genome sequencing have led to the collection of vast amounts of genomics data. Researchers may be interested in using machine learning models on such data to predict the pathogenicity or clinical significance of a…

Quantitative Methods · Quantitative Biology 2024-08-15 Arshmeet Kaur , Morteza Sarmadi

Predicting the chemical properties of compounds is crucial in discovering novel materials and drugs with specific desired characteristics. Recent significant advances in machine learning technologies have enabled automatic predictive…

Quantitative Methods · Quantitative Biology 2021-12-10 Yang Liu , Hisashi Kashima

Standard methods in preference learning involve estimating the parameters of discrete choice models from data of selections (choices) made by individuals from a discrete set of alternatives (the choice set). While there are many models for…

Machine Learning · Computer Science 2021-08-18 Kiran Tomlinson , Johan Ugander , Austin R. Benson

When developing risk prediction models, shrinkage methods are recommended, especially when the sample size is limited. Several earlier studies have shown that the shrinkage of model coefficients can reduce overfitting of the prediction…

Methodology · Statistics 2019-07-29 Ben Van Calster , Maarten van Smeden , Ewout W. Steyerberg

A straightforward application of semi-supervised machine learning to the problem of treatment effect estimation would be to consider data as "unlabeled" if treatment assignment and covariates are observed but outcomes are unobserved.…

Methodology · Statistics 2020-09-15 Andrew Herren , P. Richard Hahn

Weighting estimators based on propensity scores are widely used for causal estimation in a variety of contexts, such as observational studies, marginal structural models and interference. They enjoy appealing theoretical properties such as…

Methodology · Statistics 2021-10-06 Linbo Wang , Yuexia Zhang , Thomas S. Richardson , Xiao-Hua Zhou

Missing data is frequently encountered in many areas of statistics. Propensity score weighting is a popular method for handling missing data. The propensity score method employs a response propensity model, but correct specification of the…

Methodology · Statistics 2024-03-28 Hengfang Wang , Jae Kwang Kim , Jeongseop Han , Youngjo Lee

Propensity Score Matching (PSM) stands as a widely embraced method in comparative effectiveness research. PSM crafts matched datasets, mimicking some attributes of randomized designs, from observational data. In a valid PSM design where all…

Methodology · Statistics 2024-11-15 Fei Wan

In clinical settings, we often face the challenge of building prediction models based on small observational data sets. For example, such a data set might be from a medical center in a multi-center study. Differences between centers might…

The growing availability of large health databases has expanded the use of observational studies for comparative effectiveness research. Unlike randomized trials, observational studies must adjust for systematic differences in patient…

Methodology · Statistics 2026-01-21 Haidong Lu , Fan Li , Laine E. Thomas , Fan Li

The partitioning of data for estimation and calibration critically impacts the performance of propensity score based estimators like inverse probability weighting (IPW) and double/debiased machine learning (DML) frameworks. We extend recent…

Machine Learning · Statistics 2025-05-20 Sven Klaassen , Jan Rabenseifner , Jannis Kueck , Philipp Bach

There is growing interest in a hybrid control design in which a randomized controlled trial is augmented with an external control arm from a previous trial or real world data. Existing methods for analyzing hybrid control studies include…

Methodology · Statistics 2025-01-30 Zhiwei Zhang , Jialuo Liu , Wei Liu

In observational studies, the recorded treatment assignment is not purely random, but it is influenced by external factors such as patient characteristics, reimbursement policies, and existing guidelines. Therefore, the treatment effect can…

Methodology · Statistics 2024-09-02 Sara Poletto , Enrico Longato , Erica Tavazzi , Martina Vettoretti