English
Related papers

Related papers: Randomization Bias in Field Trials to Evaluate Tar…

200 papers

Algorithms deployed in education can shape the learning experience and success of a student. It is therefore important to understand whether and how such algorithms might create inequalities or amplify existing biases. In this paper, we…

Computers and Society · Computer Science 2022-12-21 Jade Maï Cock , Muhammad Bilal , Richard Davis , Mirko Marras , Tanja Käser

Random forests are a statistical learning technique that use bootstrap aggregation to average high-variance and low-bias trees. Improvements to random forests, such as applying Lasso regression to the tree predictions, have been proposed in…

Machine Learning · Statistics 2025-11-13 Jing Shang , James Bannon , Benjamin Haibe-Kains , Robert Tibshirani

Drug-target binding affinity prediction is a fundamental task for drug discovery. It has been extensively explored in literature and promising results are reported. However, in this paper, we demonstrate that the results may be misleading…

Machine Learning · Computer Science 2025-04-15 Chenbin Zhang , Zhiqiang Hu , Chuchu Jiang , Wen Chen , Jie Xu , Shaoting Zhang

The goal of this article is to investigate how human participants allocate their limited time to decisions with different properties. We report the results of two behavioral experiments. In each trial of the experiments, the participant…

Neurons and Cognition · Quantitative Biology 2016-07-20 Arash Khodadadi , Pegah Fakhari , Jerome R. Busemeyer

Background. Designing trials to reduce treatment duration is important in several therapeutic areas, including TB and antibiotics. We recently proposed a new randomised trial design to overcome some of the limitations of standard two-arm…

Learning personalized decision policies that generalize to the target population is of great relevance. Since training data is often not representative of the target population, standard policy learning methods may yield policies that do…

Machine Learning · Statistics 2021-12-03 Tobias Hatt , Daniel Tschernutter , Stefan Feuerriegel

The rise of machine learning has shifted targeted resource allocation in policy and humanitarian settings toward algorithmic targeting based on predicted risk scores. This approach is typically cheaper and faster than traditional screening…

Artificial Intelligence · Computer Science 2026-05-11 Santiago Cortes-Gomez , Mateo Dulce Rubio , Carlos Patino , Bryan Wilder

In light of newly developed standardization methods, we evaluate, via simulation study, how propensity score weighting and standardization -based approaches compare for obtaining estimates of the marginal odds ratio and the marginal hazard…

Methodology · Statistics 2023-10-10 Harlan Campbell , Julie E Park , Jeroen P Jansen , Shannon Cope

A growing number of researchers are conducting randomized experiments to analyze causal relationships in network settings where units influence one another. A dominant methodology for analyzing these experiments is design-based, leveraging…

Methodology · Statistics 2024-07-30 Ambarish Chattopadhyay , Kosuke Imai , Jose R. Zubizarreta

Penalized logistic regression methods are frequently used to investigate the relationship between a binary outcome and a set of explanatory variables. The model performance can be assessed by measures such as the concordance statistic…

Methodology · Statistics 2021-01-20 Angelika Geroldinger , Lara Lusa , Mariana Nold , Georg Heinze

The generalization performance of a risk prediction model can be evaluated by its calibration, which measures the agreement between predicted and observed outcomes on external validation data. Here, methods for assessing the calibration of…

Methodology · Statistics 2020-01-31 Moritz Berger , Matthias Schmid

In model-based reinforcement learning, planning with an imperfect model of the environment has the potential to harm learning progress. But even when a model is imperfect, it may still contain information that is useful for planning. In…

Machine Learning · Computer Science 2021-03-09 Zaheer Abbas , Samuel Sokota , Erin J. Talvitie , Martha White

We consider methods for transporting a prediction model and assessing its performance for use in a new target population, when outcome and covariate information for model development is available from a simple random sample from the source…

Applications · Statistics 2021-04-15 Jon A. Steingrimsson , Constantine Gatsonis , Issa J. Dahabreh

Large language models (LLMs) have shown remarkable adaptability to diverse tasks, by leveraging context prompts containing instructions, or minimal input-output examples. However, recent work revealed they also exhibit label bias -- an…

Computation and Language · Computer Science 2024-05-07 Yuval Reif , Roy Schwartz

Design-consistent model-assisted estimation has become the standard practice in survey sampling. However, a general theory is lacking so far, which allows one to incorporate modern machine-learning techniques that can lead to potentially…

Machine Learning · Statistics 2020-03-26 Luis Sanguiao Sande , Li-Chun Zhang

Contrary to traditional deterministic notions of algorithmic fairness, this paper argues that fairly allocating scarce resources using machine learning often requires randomness. We address why, when, and how to randomize by proposing…

Computers and Society · Computer Science 2024-06-21 Shomik Jain , Kathleen Creel , Ashia Wilson

Significant evidence has become available that emphasizes the importance of personalization in medicine. In fact, it has become a common belief that personalized medicine is the future of medicine. The core of personalized medicine is the…

Methodology · Statistics 2020-04-30 Qiong Zhang , Amin Khademi , Yongjia Song

Observed events in recommendation are consequence of the decisions made by a policy, thus they are usually selectively labeled, namely the data are Missing Not At Random (MNAR), which often causes large bias to the estimate of true outcomes…

Machine Learning · Computer Science 2021-10-05 Zifeng Wang , Xi Chen , Rui Wen , Shao-Lun Huang

We consider constrained sampling problems in paid research studies or clinical trials. When qualified volunteers are more than the budget allowed, we recommend a D-optimal sampling strategy based on the optimal design theory and develop a…

Methodology · Statistics 2024-05-27 Yifei Huang , Liping Tong , Jie Yang

An innovative sampling strategy is proposed, which applies to large-scale population-based surveys targeting a rare trait that is unevenly spread over a geographical area of interest. Our proposal is characterised by the ability to tailor…

Methodology · Statistics 2020-04-07 Fulvia Mecatti , Charalambos Sismanidis , Emanuela Furfaro