English
Related papers

Related papers: Bias-Variance Tradeoffs in Single-Sample Binary Gr…

200 papers

Stochastic neurons can be useful for a number of reasons in deep learning models, but in many cases they pose a challenging problem: how to estimate the gradient of a loss function with respect to the input of such stochastic neurons, i.e.,…

Machine Learning · Computer Science 2013-05-15 Yoshua Bengio

Stochastic Gradient Descent (SGD) is arguably the most important single algorithm in modern machine learning. Although SGD with unbiased gradient estimators has been studied extensively over at least half a century, SGD variants relying on…

Machine Learning · Computer Science 2023-05-26 Yury Demidovich , Grigory Malinovsky , Igor Sokolov , Peter Richtárik

Variational approaches based on neural networks are showing promise for estimating mutual information (MI) between high dimensional variables. However, they can be difficult to use in practice due to poorly understood bias/variance…

Machine Learning · Computer Science 2020-03-25 Jiaming Song , Stefano Ermon

The Straight-Through Estimator (STE) is the dominant method for training neural networks with discrete variables, enabling gradient-based optimisation by routing gradients through a differentiable surrogate. However, existing STE variants…

Machine Learning · Computer Science 2026-02-24 Rushi Shah , Mingyuan Yan , Michael Curtis Mozer , Dianbo Liu

Stochastic neurons and hard non-linearities can be useful for a number of reasons in deep learning models, but in many cases they pose a challenging problem: how to estimate the gradient of a loss function with respect to the input of such…

Machine Learning · Computer Science 2013-08-16 Yoshua Bengio , Nicholas Léonard , Aaron Courville

The Doubly Robust (DR) estimation of ATE can be carried out in 2 steps, where in the first step, the treatment and outcome are modeled, and in the second step the predictions are inserted into the DR estimator. The model misspecification in…

Methodology · Statistics 2021-08-03 Mehdi Rostami , Olli Saarela , Michael Escobar

Breakthroughs in machine learning are rapidly changing science and society, yet our fundamental understanding of this technology has lagged far behind. Indeed, one of the central tenets of the field, the bias-variance trade-off, appears to…

Machine Learning · Statistics 2022-06-08 Mikhail Belkin , Daniel Hsu , Siyuan Ma , Soumik Mandal

Normalising flows (NFs) for discrete data are challenging because parameterising bijective transformations of discrete variables requires predicting discrete/integer parameters. Having a neural network architecture predict discrete…

Machine Learning · Computer Science 2020-06-12 Rob Hesselink , Wilker Aziz

Training large-scale mixture of experts models efficiently on modern hardware requires assigning datapoints in a batch to different experts, each with a limited capacity. Recently proposed assignment procedures lack a probabilistic…

Machine Learning · Computer Science 2021-12-09 Wouter Kool , Chris J. Maddison , Andriy Mnih

Data-driven stochastic optimization is ubiquitous in machine learning and operational decision-making problems. Sample average approximation (SAA) and model-based approaches such as estimate-then-optimize (ETO) or integrated…

Machine Learning · Statistics 2025-10-22 Haixiang Lan , Luofeng Liao , Adam N. Elmachtoub , Christian Kroer , Henry Lam , Haofeng Zhang

As we exhaust methods that reduces variance without introducing bias, reducing variance in experiments often requires accepting some bias, using methods like winsorization or surrogate metrics. While this bias-variance tradeoff can be…

Methodology · Statistics 2025-11-05 Daniel Ting , Kenneth Hung

The classical bias-variance trade-off predicts that bias decreases and variance increase with model complexity, leading to a U-shaped risk curve. Recent work calls this into question for neural networks and other over-parameterized models,…

Machine Learning · Computer Science 2020-12-09 Zitong Yang , Yaodong Yu , Chong You , Jacob Steinhardt , Yi Ma

Self-paced learning and hard example mining re-weight training instances to improve learning accuracy. This paper presents two improved alternatives based on lightweight estimates of sample uncertainty in stochastic gradient descent (SGD):…

Machine Learning · Statistics 2018-01-09 Haw-Shiuan Chang , Erik Learned-Miller , Andrew McCallum

Applications that deal with sensitive information may have restrictions placed on the data available to a machine learning (ML) classifier. For example, in some applications, a classifier may not have direct access to sensitive attributes,…

Machine Learning · Computer Science 2024-03-13 Zachary McBride Lazri , Danial Dervovic , Antigoni Polychroniadou , Ivan Brugere , Dana Dachman-Soled , Min Wu

Poisson-distributed latent variable models are widely used in computational neuroscience, but differentiating through discrete stochastic samples remains challenging. Two approaches address this: Exponential Arrival Time (EAT) simulation…

Machine Learning · Statistics 2026-02-05 Michael Ibrahim , Hanqi Zhao , Eli Sennesh , Zhi Li , Anqi Wu , Jacob L. Yates , Chengrui Li , Hadi Vafaii

When using machine learning for automated prediction, it is important to account for fairness in the prediction. Fairness in machine learning aims to ensure that biases in the data and model inaccuracies do not lead to discriminatory…

Machine Learning · Computer Science 2024-12-10 Jan Pablo Burgard , João Vitor Pamplona

Injecting discrete logical constraints into neural network learning is one of the main challenges in neuro-symbolic AI. We find that a straight-through-estimator, a method introduced to train binary neural networks, could effectively be…

Artificial Intelligence · Computer Science 2023-07-11 Zhun Yang , Joohyung Lee , Chiyoun Park

When a Genetic Algorithm (GA), or a stochastic algorithm in general, is employed in a statistical problem, the obtained result is affected by both variability due to sampling, that refers to the fact that only a sample is observed, and…

Computation · Statistics 2019-03-07 Manuel Rizzo , Francesco Battaglia

Prior studies have unveiled the vulnerability of the deep neural networks in the context of adversarial machine learning, leading to great recent attention into this area. One interesting question that has yet to be fully explored is the…

Machine Learning · Computer Science 2020-08-04 Hossein Aboutalebi , Mohammad Javad Shafiee , Michelle Karg , Christian Scharfenberger , Alexander Wong

An influential line of recent work has focused on the generalization properties of unregularized gradient-based learning procedures applied to separable linear classification with exponentially-tailed loss functions. The ability of such…

Machine Learning · Computer Science 2022-06-24 Matan Schliserman , Tomer Koren