English
Related papers

Related papers: On Bayes Risk Lower Bounds

200 papers

In analyses with severe data-limitations, augmenting the target dataset with information from ancillary datasets in the application domain, called source datasets, can lead to significantly improved statistical procedures. However, existing…

Machine Learning · Statistics 2025-08-01 Nathan Wycoff , Ali Arab , Lisa O. Singh

We focus on a stochastic learning model where the learner observes a finite set of training examples and the output of the learning process is a data-dependent distribution over a space of hypotheses. The learned data-dependent distribution…

Machine Learning · Statistics 2020-12-29 Omar Rivasplata , Ilja Kuzborskij , Csaba Szepesvari , John Shawe-Taylor

Bayesian neural networks perform variational inference over the weights however calculation of the posterior distribution remains a challenge. Our work builds on variational inference techniques for bayesian neural networks using the…

Machine Learning · Computer Science 2021-06-23 Abhinav Sagar

In parametric Bayesian learning, a prior is assumed on the parameter $W$ which determines the distribution of samples. In this setting, Minimum Excess Risk (MER) is defined as the difference between the minimum expected loss achievable when…

Machine Learning · Computer Science 2021-07-20 Hassan Hafez-Kolahi , Behrad Moniri , Shohreh Kasaei , Mahdieh Soleymani Baghshah

Lower bounds involving $f$-divergences between the underlying probability measures are proved for the minimax risk in estimation problems. Our proofs just use simple convexity facts. Special cases and straightforward corollaries of our…

Statistics Theory · Mathematics 2011-02-22 Adityanand Guntuboyina

This paper extends the standard chaining technique to prove excess risk upper bounds for empirical risk minimization with random design settings even if the magnitude of the noise and the estimates is unbounded. The bound applies to many…

Machine Learning · Statistics 2016-09-08 Gábor Balázs , András György , Csaba Szepesvári

Bayesian classification labels observations based on given prior information, namely class-a priori and class-conditional probabilities. Bayes' risk is the minimum expected classification cost that is achieved by the Bayes' test, the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Frank Nielsen

Meta learning uses information from base learners (e.g. classifiers or estimators) as well as information about the learning problem to improve upon the performance of a single base learner. For example, the Bayes error rate of a given…

Machine Learning · Computer Science 2016-03-11 Kevin R. Moon , Veronique Delouille , Alfred O. Hero

We show how to compute lower bounds for the supremum Bayes error if the class-conditional distributions must satisfy moment constraints, where the supremum is with respect to the unknown class-conditional distributions. Our approach makes…

Machine Learning · Statistics 2012-01-31 Bela A. Frigyik , Maya R. Gupta

In statistical inference problems, we wish to obtain lower bounds on the minimax risk, that is to bound the performance of any possible estimator. A standard technique to obtain risk lower bounds involves the use of Fano's inequality. In an…

Information Theory · Computer Science 2018-04-06 Ramji Venkataramanan , Oliver Johnson

We derive explicit non-asymptotic PAC-Bayes generalization bounds for Gibbs posteriors, that is, data-dependent distributions over model parameters obtained by exponentially tilting a prior with the empirical risk. Unlike classical…

Machine Learning · Statistics 2026-04-21 Chenyang Wang , Yun Yang

We introduce a modified version of the excess risk, which can be used to obtain tighter, fast-rate PAC-Bayesian generalisation bounds. This modified excess risk leverages information about the relative hardness of data examples to reduce…

Machine Learning · Computer Science 2023-01-25 Felix Biggs , Benjamin Guedj

We consider the problem of aggregating pairwise comparisons to obtain a consensus ranking order over a collection of objects. We use the popular Bradley-Terry-Luce (BTL) model which allows us to probabilistically describe pairwise…

Information Theory · Computer Science 2019-01-30 Mine Alsan , Ranjitha Prasad , Vincent Y. F. Tan

Estimation of individual treatment effects is commonly used as the basis for contextual decision making in fields such as healthcare, education, and economics. However, it is often sufficient for the decision maker to have estimates of…

Machine Learning · Computer Science 2020-08-13 Maggie Makar , Fredrik D. Johansson , John Guttag , David Sontag

Consider the problem of estimating a multivariate normal mean with a known variance matrix, which is not necessarily proportional to the identity matrix. The coordinates are shrunk directly in proportion to their variances in Efron and…

Statistics Theory · Mathematics 2015-05-29 Zhiqiang Tan

The prior independent framework for algorithm design considers how well an algorithm that does not know the distribution of its inputs approximates the expected performance of the optimal algorithm for this distribution. This paper gives a…

Computer Science and Game Theory · Computer Science 2021-07-13 Jason Hartline , Aleck Johnsen

We present a unifying picture of PAC-Bayesian and mutual information-based upper bounds on the generalization error of randomized learning algorithms. As we show, Tong Zhang's information exponential inequality (IEI) gives a general recipe…

Machine Learning · Computer Science 2021-10-26 Pradeep Kr. Banerjee , Guido Montúfar

By leveraging experience from previous tasks, meta-learning algorithms can achieve effective fast adaptation ability when encountering new tasks. However it is unclear how the generalization property applies to new tasks. Probably…

Machine Learning · Computer Science 2021-02-09 Tianyu Liu , Jie Lu , Zheng Yan , Guangquan Zhang

In this work, the probability of an event under some joint distribution is bounded by measuring it with the product of the marginals instead (which is typically easier to analyze) together with a measure of the dependence between the two…

Information Theory · Computer Science 2020-10-22 Amedeo Roberto Esposito , Michael Gastpar , Ibrahim Issa

Prediction is a central task of statistics and machine learning, yet many inferential settings provide only partial information, typically in the form of moment constraints or estimating equations. We develop a finite, fully Bayesian…

Statistics Theory · Mathematics 2026-03-20 Nicholas G. Polson , Daniel Zantedeschi