English
Related papers

Related papers: Rate-Distortion Analysis of Minimum Excess Risk in…

200 papers

The Bayesian Cram\'er-Rao bound (CRB) provides a lower bound on the mean square error of any Bayesian estimator under mild regularity conditions. It can be used to benchmark the performance of statistical estimators, and provides a…

Machine Learning · Statistics 2024-09-09 Evan Scope Crafts , Xianyang Zhang , Bo Zhao

A rekindled the interest in auto-encoder algorithms has been spurred by recent work on deep learning. Current efforts have been directed towards effective training of auto-encoder architectures with a large number of coding units. Here, we…

Machine Learning · Computer Science 2014-04-18 Luis G. Sanchez Giraldo , Jose C. Principe

We investigate the problem of estimating the causal effect of a treatment on individual subjects from observational data, this is a central problem in various application domains, including healthcare, social sciences, and online…

Methodology · Statistics 2019-01-30 Ahmed M. Alaa , Mihaela van der Schaar

All biological and artificial agents must learn and make decisions given limits on their ability to process information. As such, a general theory of adaptive behavior should be able to account for the complex interactions between an…

Machine Learning · Computer Science 2023-05-08 Dilip Arumugam , Mark K. Ho , Noah D. Goodman , Benjamin Van Roy

This work proposes a Bayesian inference method for the reduced-order modeling of time-dependent systems. Informed by the structure of the governing equations, the task of learning a reduced-order model from data is posed as a Bayesian…

Numerical Analysis · Mathematics 2023-01-18 Mengwu Guo , Shane A. McQuarrie , Karen E. Willcox

Bayesian Knowledge Tracing (BKT) is a probabilistic model of a learner's state of mastery corresponding to a knowledge component. It considers the learner's state of mastery as a "hidden" or latent binary variable and updates this state…

Computers and Society · Computer Science 2024-01-19 Denis Shchepakin , Sreecharan Sankaranarayanan , Dawn Zimmaro

Minimising upper bounds on the population risk or the generalisation gap has been widely used in structural risk minimisation (SRM) -- this is in particular at the core of PAC-Bayesian learning. Despite its successes and unfailing surge of…

Machine Learning · Statistics 2023-10-30 Paul Viallard , Maxime Haddouche , Umut Şimşekli , Benjamin Guedj

Minimum Bayes Risk (MBR) decoding optimizes output selection by maximizing the expected utility value of an underlying human distribution. While prior work has shown the effectiveness of MBR decoding through empirical evaluation, few…

Computation and Language · Computer Science 2025-06-23 Yuki Ichihara , Yuu Jinnai , Kaito Ariu , Tetsuro Morimura , Eiji Uchibe

A key problem in the theory of meta-learning is to understand how the task distributions influence transfer risk, the expected error of a meta-learner on a new task drawn from the unknown task distribution. In this paper, focusing on fixed…

Machine Learning · Statistics 2021-06-15 Mikhail Konobeev , Ilja Kuzborskij , Csaba Szepesvári

Weighted empirical risk minimization is a common approach to prediction under distribution drift. This article studies its out-of-sample prediction error under nonstationarity. We provide a general decomposition of the excess risk into a…

Machine Learning · Statistics 2026-05-19 Tobias Brock , Thomas Nagler

We provide an exact non-asymptotic lower bound on the minimax expected excess risk (EER) in the agnostic probably-ap\-proximately-correct (PAC) machine learning classification model and identify minimax learning algorithms as certain…

Machine Learning · Computer Science 2018-01-03 Aryeh Kontorovich , Iosif Pinelis

The Bayes Error Rate (BER) is the fundamental limit on the achievable generalizable classification accuracy of any machine learning model due to inherent uncertainty within the data. BER estimators offer insight into the difficulty of any…

Machine Learning · Computer Science 2025-09-24 Lesley Wheat , Martin v. Mohrenschildt , Saeid Habibi

We consider the problem of estimating a random state vector when there is information about the maximum distances between its subvectors. The estimation problem is posed in a Bayesian framework in which the minimum mean square error (MMSE)…

Statistics Theory · Mathematics 2012-10-30 Dave Zachariah , Isaac Skog , Magnus Jansson , Peter Händel

An encoder, subject to a rate constraint, wishes to describe a Gaussian source under squared error distortion. The decoder, besides receiving the encoder's description, also observes side information consisting of uncompressed source symbol…

Information Theory · Computer Science 2013-05-10 Chris T. K. Ng , Chao Tian , Andrea J. Goldsmith , Shlomo Shamai

In this paper, we explore bounds on the expected risk when using deep neural networks for supervised classification from an information theoretic perspective. Firstly, we introduce model risk and fitting error, which are derived from…

Machine Learning · Computer Science 2024-10-08 Binchuan Qi

Empirical risk minimization stands behind most optimization in supervised machine learning. Under this scheme, labeled data is used to approximate an expected cost (risk), and a learning algorithm updates model-defining parameters in search…

Machine Learning · Statistics 2023-05-25 James Schmidt

We study learning algorithms when there is a mismatch between the distributions of the training and test datasets of a learning algorithm. The effect of this mismatch on the generalization error and model misspecification are quantified.…

Information Theory · Computer Science 2022-08-11 Saeed Masiha , Amin Gohari , Mohammad Hossein Yassaee , Mohammad Reza Aref

We consider the problem of aggregating pairwise comparisons to obtain a consensus ranking order over a collection of objects. We use the popular Bradley-Terry-Luce (BTL) model which allows us to probabilistically describe pairwise…

Information Theory · Computer Science 2019-01-30 Mine Alsan , Ranjitha Prasad , Vincent Y. F. Tan

Considering the problem of risk-sensitive parameter estimation, we propose a fairly wide family of lower bounds on the exponential moments of the quadratic error, both in the Bayesian and the non--Bayesian regime. This family of bounds,…

Information Theory · Computer Science 2017-03-02 Neri Merhav

Meta-learning, or "learning to learn", refers to techniques that infer an inductive bias from data corresponding to multiple related tasks with the goal of improving the sample efficiency for new, previously unobserved, tasks. A key…

Machine Learning · Computer Science 2021-02-24 Sharu Theresa Jose , Osvaldo Simeone