English
Related papers

Related papers: Choosing a Proxy Metric from Past Experiments

200 papers

The recent explosion in the capabilities of large language models has led to a wave of interest in how best to prompt a model to perform a given task. While it may be tempting to simply choose a prompt based on average performance on a…

Machine Learning · Computer Science 2024-03-29 Thomas P. Zollo , Todd Morrill , Zhun Deng , Jake C. Snell , Toniann Pitassi , Richard Zemel

Aggregate outcome variables collected through surveys and administrative records are often subject to systematic measurement error. For instance, in disaster loss databases, county-level losses reported may differ from the true damages due…

Machine Learning · Computer Science 2026-03-17 Saketh Vishnubhatla , Shu Wan , Andre Harrison , Adrienne Raglin , Huan Liu

Latent factor model estimation typically relies on either using domain knowledge to manually pick several observed covariates as factor proxies, or purely conducting multivariate analysis such as principal component analysis. However, the…

Methodology · Statistics 2023-01-04 Runzhe Wan , Yingying Li , Wenbin Lu , Rui Song

Network interference occurs when treatments assigned to some units affect the outcomes of others. Traditional approaches often assume that the observed network correctly specifies the interference structure. However, in practice,…

Methodology · Statistics 2026-02-04 Bar Weinstein , Daniel Nevo

I develop a new identification strategy for treatment effects when noisy measurements of unobserved confounding factors are available. I use proxy variables to construct a random variable conditional on which treatment variables become…

Econometrics · Economics 2022-09-30 Kenichi Nagasawa

Understanding and quantifying cause and effect is an important problem in many domains. The generally-agreed solution to this problem is to perform a randomised controlled trial. However, even when randomised controlled trials can be…

Machine Learning · Statistics 2023-02-22 Graham Van Goffrier , Lucas Maystre , Ciarán Gilligan-Lee

The development of statistical methods to evaluate surrogate markers is an active area of research. In many clinical settings, the surrogate marker is not simply a single measurement but is instead a longitudinal trajectory of measurements…

Methodology · Statistics 2024-02-28 Denis Agniel , Layla Parast

Randomized experiments are the gold standard for estimating the causal effects of an intervention. In the simplest setting, each experimental unit is randomly assigned to receive treatment or control, and then the outcomes in each treatment…

Methodology · Statistics 2020-06-05 Guillaume Basse , Yi Ding , Panos Toulis

Modern language models are trained almost exclusively on token sequences produced by a fixed tokenizer, an external lossless compressor often over UTF-8 byte sequences, thereby coupling the model to that compressor. This work introduces…

Computation and Language · Computer Science 2026-05-15 Lin Zheng , Xinyu Li , Qian Liu , Xiachong Feng , Lingpeng Kong

Consider the problem of estimating average treatment effects when a large number of covariates are used to adjust for possible confounding through outcome regression and propensity score models. The conventional approach of model building…

Statistics Theory · Mathematics 2018-01-31 Zhiqiang Tan

Empirical research shows that individuals' responses to treatments vary along latent characteristics, such as innate ability or motivation. Therefore, a policymaker seeking to maximize welfare may consider designing policies based on…

Econometrics · Economics 2026-05-06 Giacomo Opocher

Monotonicity is a key qualitative prediction of a wide array of economic models derived via robust comparative statics. It is therefore important to design effective and practical econometric methods for testing this prediction in empirical…

Statistics Theory · Mathematics 2019-07-10 Denis Chetverikov

In a typical optimization problem, the task is to pick one of a number of options with the lowest cost or the highest value. In practice, these cost/value quantities often come through processes such as measurement or machine learning,…

Data Structures and Algorithms · Computer Science 2022-07-20 Mohammad Mahdian , Jieming Mao , Kangning Wang

Information that is of relevance for decision-making is often distributed, and held by self-interested agents. Decision markets are well-suited mechanisms to elicit such information and aggregate it into conditional forecasts that can be…

Computer Science and Game Theory · Computer Science 2023-03-21 Wenlong Wang , Thomas Pfeiffer

Although microarrays are routine analysis tools in biomedical research, they still yield noisy output that often requires experimental confirmation. Many studies have aimed at optimizing probe design and statistical analysis to tackle this…

Quantitative Methods · Quantitative Biology 2015-06-15 Alex E Pozhitkov , Peter A Noble , Jaroslaw Bryk , Diethard Tautz

When a new treatment is considered for use, whether a pharmaceutical drug or a search engine ranking algorithm, a typical question that arises is, will its performance exceed that of the current treatment? The conventional way to answer…

Machine Learning · Computer Science 2016-10-27 Nir Rosenfeld , Yishay Mansour , Elad Yom-Tov

We provide new results for nonparametric identification, estimation, and inference of causal effects using `proxy controls': observables that are noisy but informative proxies for unobserved confounding factors. Our analysis applies to…

Econometrics · Economics 2023-11-22 Ben Deaner

Recommendation systems are widespread, and through customized recommendations, promise to match users with options they will like. To that end, data on engagement is collected and used. Most recommendation systems are ranking-based, where…

Information Retrieval · Computer Science 2024-05-08 Omar Besbes , Yash Kanoria , Akshit Kumar

Developing large language models is expensive and involves making decisions with small experiments, typically by evaluating on large, multi-task evaluation suites. In this work, we analyze specific properties which make a benchmark more…

Computation and Language · Computer Science 2025-08-19 David Heineman , Valentin Hofmann , Ian Magnusson , Yuling Gu , Noah A. Smith , Hannaneh Hajishirzi , Kyle Lo , Jesse Dodge

In high-dimensional statistical inference in which the number of parameters to be estimated is larger than that of the holding data, regularized linear estimation techniques are widely used. These techniques have, however, some drawbacks.…

Methodology · Statistics 2025-08-06 Takashi Takahashi , Yoshiyuki Kabashima