English
Related papers

Related papers: The Bias-Variance Tradeoff in Long-Term Experiment…

200 papers

The increasing availability of passively observed data has yielded a growing methodological interest in "data fusion." These methods involve merging data from observational and experimental sources to draw causal conclusions -- and they…

Methodology · Statistics 2021-12-15 Evan Rosenman , Art B. Owen

The label bias and selection bias are acknowledged as two reasons in data that will hinder the fairness of machine-learning outcomes. The label bias occurs when the labeling decision is disturbed by sensitive features, while the selection…

Machine Learning · Computer Science 2021-07-08 Yixuan Zhang , Feng Zhou , Zhidong Li , Yang Wang , Fang Chen

Randomized experiments are the gold standard for evaluating the effects of changes to real-world systems. Data in these tests may be difficult to collect and outcomes may have high variance, resulting in potentially large measurement error.…

Machine Learning · Statistics 2018-06-27 Benjamin Letham , Brian Karrer , Guilherme Ottoni , Eytan Bakshy

Keeping a memory of evolving stimuli is ubiquitous in biology, an example of which is immune memory for evolving pathogens. However, learning and memory storage for dynamic patterns still pose challenges in machine learning. Here, we…

Biological Physics · Physics 2021-10-29 Oskar H Schnaack , Luca Peliti , Armita Nourmohammad

Biased stochastic estimators, such as finite-differences for noisy gradient estimation, often contain parameters that need to be properly chosen to balance impacts from the bias and the variance. While the optimal order of these parameters…

Methodology · Statistics 2019-02-14 Henry Lam , Xinyu Zhang , Xuhui Zhang

Machine learning models can capture and amplify biases present in data, leading to disparate test performance across social groups. To better understand, evaluate, and mitigate these biases, a deeper theoretical understanding of how model…

Machine Learning · Computer Science 2025-03-19 Arjun Subramonian , Samuel J. Bell , Levent Sagun , Elvis Dohmatob

Finding the optimal model complexity that minimizes the generalization error (GE) is a key issue of machine learning. For the conventional supervised learning, this task typically involves the bias-variance tradeoff: lowering the bias by…

Statistical Mechanics · Physics 2023-09-13 Gilhan Kim , Hojun Lee , Junghyo Jo , Yongjoo Baek

In this paper, we investigate the impact of test-time adversarial attacks on linear regression models and determine the optimal level of robustness that any model can reach while maintaining a given level of standard predictive performance…

Machine Learning · Statistics 2023-08-02 Elvis Dohmatob , Meyer Scetbon

Data-driven stochastic optimization is ubiquitous in machine learning and operational decision-making problems. Sample average approximation (SAA) and model-based approaches such as estimate-then-optimize (ETO) or integrated…

Machine Learning · Statistics 2025-10-22 Haixiang Lan , Luofeng Liao , Adam N. Elmachtoub , Christian Kroer , Henry Lam , Haofeng Zhang

When training deep learning models for least-squares regression, we cannot expect that the training error residuals of the final model, selected after a fixed training time or based on performance on a hold-out data set, sum to zero. This…

Machine Learning · Computer Science 2022-03-31 Christian Igel , Stefan Oehmcke

Quasi-experimental causal inference methods have become central in empirical operations management for guiding managerial decisions. Among these, empiricists utilize the Difference-in-Differences (DiD) estimator, which relies on the…

Methodology · Statistics 2026-05-13 Mingxuan Ge , Dae Woong Ham

We study the design and analysis of switchback experiments conducted on a single aggregate unit. The design problem is to partition the continuous time space into intervals and switch treatments between intervals, in order to minimize the…

Methodology · Statistics 2024-06-12 Ruoxuan Xiong , Alex Chin , Sean J. Taylor

While $\mathcal{H}_\infty$ methods can introduce robustness against worst-case perturbations, their nominal performance under conventional stochastic disturbances is often drastically reduced. Though this fundamental tradeoff between…

Systems and Control · Electrical Eng. & Systems 2023-05-29 Bruce D. Lee , Thomas T. C. K. Zhang , Hamed Hassani , Nikolai Matni

Using theory and experiments, this paper shows that the difficulty of making tradeoffs offers a parsimonious explanation for a wide range of behavioral phenomena. We develop a model of imprecise comparisons applicable to multiattribute,…

General Economics · Economics 2026-04-01 Cassidy Shubatt , Jeffrey Yang

Variance reduction is a family of powerful mechanisms for stochastic optimization that appears to be helpful in many machine learning tasks. It is based on estimating the exact gradient with some recursive sequences. Previously, many papers…

Optimization and Control · Mathematics 2025-11-07 Aleksandr Shestakov , Valery Parfenov , Aleksandr Beznosikov

Consider a target moving with a constant velocity on a unit-circumference circle, starting from an arbitrary location. To acquire the target, any region of the circle can be probed for its presence, but the associated measurement noise…

Information Theory · Computer Science 2014-08-19 Yonatan Kaspi , Ofer Shayevitz , Tara Javidi

There exist several methods developed for the canonical change point problem of detecting multiple mean shifts, which search for changes over sections of the data at multiple scales. In such methods, estimation of the noise level is often…

Methodology · Statistics 2022-11-07 Euan T. McGonigle , Haeran Cho

We investigate the competition dynamics of two microbial or viral strains that live in an environment that switches periodically between two states. One of the strains is adapted to the long-term environment, but pays a short-term cost,…

Populations and Evolution · Quantitative Biology 2013-05-29 Robert Forster , Claus O. Wilke

Achieving robustness to distributional shift is a longstanding and challenging goal of computer vision. Data augmentation is a commonly used approach for improving robustness, however robustness gains are typically not uniform across…

Machine Learning · Computer Science 2020-09-18 Dong Yin , Raphael Gontijo Lopes , Jonathon Shlens , Ekin D. Cubuk , Justin Gilmer

It is widely accepted that biased data leads to biased and thus potentially unfair models. Therefore, several measures for bias in data and model predictions have been proposed, as well as bias mitigation techniques whose aim is to learn…

Machine Learning · Computer Science 2024-03-26 Marco Favier , Toon Calders , Sam Pinxteren , Jonathan Meyer