English
Related papers

Related papers: Sharp bounds on aggregate expert error

200 papers

In this paper, we explore bounds on the expected risk when using deep neural networks for supervised classification from an information theoretic perspective. Firstly, we introduce model risk and fitting error, which are derived from…

Machine Learning · Computer Science 2024-10-08 Binchuan Qi

We consider the problem of estimating the probability of error in multi-hypothesis testing when MAP criterion is used. This probability, which is also known as the Bayes risk is an important measure in many communication and information…

Information Theory · Computer Science 2007-07-16 Nandakishore Santhi , Alexander Vardy

We consider the problem of distributed estimation, where local processors observe independent samples conditioned on a common random parameter of interest, map the observations to a finite number of bits, and send these bits to a remote…

Information Theory · Computer Science 2015-04-24 Aolin Xu , Maxim Raginsky

Some of the tightest information-theoretic generalization bounds depend on the average information between the learned hypothesis and a single training example. However, these sample-wise bounds were derived only for expected generalization…

Machine Learning · Computer Science 2022-12-14 Hrayr Harutyunyan , Greg Ver Steeg , Aram Galstyan

We show how to compute lower bounds for the supremum Bayes error if the class-conditional distributions must satisfy moment constraints, where the supremum is with respect to the unknown class-conditional distributions. Our approach makes…

Machine Learning · Statistics 2012-01-31 Bela A. Frigyik , Maya R. Gupta

Robust Bayesian inference is the calculation of posterior probability bounds given perturbations in a probabilistic model. This paper focuses on perturbations that can be expressed locally in Bayesian networks through convex sets of…

Artificial Intelligence · Computer Science 2013-02-08 Fabio Gagliardi Cozman

The following problem is considered: given a joint distribution $P_{XY}$ and an event $E$, bound $P_{XY}(E)$ in terms of $P_XP_Y(E)$ (where $P_XP_Y$ is the product of the marginals of $P_{XY}$) and a measure of dependence of $X$ and $Y$.…

Information Theory · Computer Science 2019-03-12 Ibrahim Issa , Amedeo Roberto Esposito , Michael Gastpar

We derive new and improved non-asymptotic deviation inequalities for the sample average approximation (SAA) of an optimization problem. Our results give strong error probability bounds that are "sub-Gaussian"~even when the randomness of the…

Optimization and Control · Mathematics 2022-03-28 Roberto I. Oliveira , Philip Thompson

The Gaussian theory of errors has been generalized to situations, where the Gaussian distribution and, hence, the Gaussian rules of error propagation are inadequate. The generalizations are based on Bayes' theorem and a suitable measure.…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Hanns L. Harney

We present some new and explicit error bounds for the approximation of distributions. The approximation error is quantified by the maximal density ratio of the distribution $Q$ to be approximated and its proxy $P$. This non-symmetric…

Statistics Theory · Mathematics 2022-09-02 Lutz Duembgen , Richard Samworth , Jon Wellner

In this paper we present a new error bound on sampling algorithms for frequent itemsets mining. We show that the new bound is asymptotically tighter than the state-of-art bounds, i.e., given the chosen samples, for small enough error…

Data Structures and Algorithms · Computer Science 2017-03-27 Shiyu Ji , Kun Wan

Approximate Bayesian computation performs approximate inference for models where likelihood computations are expensive or impossible. Instead simulations from the model are performed for various parameter values and accepted if they are…

Computation · Statistics 2015-12-16 Dennis Prangle

We consider the problem of binary prediction with expert advice in settings where experts have agency and seek to maximize their credibility. This paper makes three main contributions. First, it defines a model to reason formally about…

Computer Science and Game Theory · Computer Science 2021-03-16 Tim Roughgarden , Okke Schrijvers

We study optimal estimation when the likelihood may be misspecified. Building on tools from the theory of decision-making under uncertainty, we analyze a class of axiomatically grounded optimality criteria which nests several existing…

Econometrics · Economics 2026-04-28 Isaiah Andrews , Ricky Li , Yucheng Shang

We study the problem of robust forecast aggregation: combining expert forecasts with provable accuracy guarantees compared to the best possible aggregation of the underlying information. Prior work shows strong impossibility results, e.g.…

Computer Science and Game Theory · Computer Science 2025-12-08 Rafael Frongillo , Mary Monroe , Eric Neyman , Bo Waggoner

Selective classification, in which models can abstain on uncertain predictions, is a natural approach to improving accuracy in settings where errors are costly but abstentions are manageable. In this paper, we find that while selective…

Machine Learning · Computer Science 2021-04-15 Erik Jones , Shiori Sagawa , Pang Wei Koh , Ananya Kumar , Percy Liang

In statistical classification and machine learning, classification error is an important performance measure, which is minimized by the Bayes decision rule. In practice, the unknown true distribution is usually replaced with a model…

Machine Learning · Computer Science 2025-01-28 Zijian Yang , Vahe Eminyan , Ralf Schlüter , Hermann Ney

Consider a Bayesian binary decision-making problem in star networks, where local agents make selfish decisions independently, and a fusion agent makes a final decision based on aggregated decisions and its own private signal. In particular,…

Information Theory · Computer Science 2021-10-27 Daewon Seo , Ravi Kiran Raman , Lav R. Varshney

We prove new probabilistic upper bounds on generalization error of complex classifiers that are combinations of simple classifiers. Such combinations could be implemented by neural networks or by voting methods of combining the classifiers,…

Probability · Mathematics 2007-05-23 Vladimir Koltchinskii , Dmitry Panchenko

We present two sharp, closed-form empirical Bernstein inequalities for symmetric random matrices with bounded eigenvalues. By sharp, we mean that both inequalities adapt to the unknown variance in a tight manner: the deviation captured by…

Probability · Mathematics 2025-09-19 Hongjian Wang , Aaditya Ramdas