English
Related papers

Related papers: Nonsubjective priors via predictive relative entro…

200 papers

This expository paper discusses Bayesian decision analysis perspectives on problems of constrained forecasting. Foundational and pedagogic discussion contrasts decision analytic approaches with the traditional, but typically inappropriate,…

Methodology · Statistics 2021-12-01 Mike West

We analyse the conservatism and regret of distributionally robust (DR) stochastic model predictive control (SMPC) when using moment-based ambiguity sets for modeling unknown uncertainties. To quantify the conservatism, we compare the…

Systems and Control · Electrical Eng. & Systems 2024-03-15 Maik Pfefferkorn , Venkatraman Renganathan , Rolf Findeisen

We propose a two-component mixture of a noninformative (diffuse) and an informative prior distribution, weighted through the data in such a way to prefer the first component if a prior-data conflict arises. The data-driven approach for…

Methodology · Statistics 2017-08-02 Leonardo Egidi , Francesco Pauli , Nicola Torelli

Noninformative priors constructed for estimation purposes are usually not appropriate for model selection and testing. The methodology of integral priors was developed to get prior distributions for Bayesian model selection when comparing…

Methodology · Statistics 2026-03-05 Diego Salmerón , Juan Antonio Cano , Christian P. Robert

We present a new online learning algorithm for cumulative discounted gain. This learning algorithm does not use exponential weights on the experts. Instead, it uses a weighting scheme that depends on the regret of the master algorithm…

Computer Science and Game Theory · Computer Science 2008-07-01 Yoav Freund , Daniel Hsu

Bayesian inference typically relies on specifying a parametric model that approximates the data-generating process. However, misspecified models can yield poor convergence rates and unreliable posterior calibration. Bayesian empirical…

Methodology · Statistics 2025-10-27 Kenyon Ng , Weichang Yu , Howard D. Bondell

Relative entropy, as a divergence metric between two distributions, can be used for offline change-point detection and extends classical methods that mainly rely on moment-based discrepancies. To build a statistical test suitable for this…

Methodology · Statistics 2025-12-19 Matthieu Garcin , Louis Perot

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

We study data-driven decision-making problems in the Bayesian framework, where the expectation in the Bayes risk is replaced by a risk-sensitive entropic risk measure. We focus on problems where calculating the posterior distribution is…

Optimization and Control · Mathematics 2021-09-13 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

We propose a framework for analyzing the sensitivity of counterfactuals to parametric assumptions about the distribution of latent variables in structural models. In particular, we derive bounds on counterfactuals as the distribution of…

Econometrics · Economics 2024-03-26 Timothy Christensen , Benjamin Connault

In high-dimensional problems, choosing a prior distribution such that the corresponding posterior has desirable practical and theoretical properties can be challenging. This begs the question: can the data be used to help choose a good…

Statistics Theory · Mathematics 2019-09-25 Ryan Martin , Stephen G. Walker

Contextual bandits serve as a fundamental model for many sequential decision making tasks. The most popular theoretically justified approaches are based on the optimism principle. While these algorithms can be practical, they are known to…

Machine Learning · Computer Science 2020-03-17 Botao Hao , Tor Lattimore , Csaba Szepesvari

We investigate the utility to computational Bayesian analyses of a particular family of recursive marginal likelihood estimators characterized by the (equivalent) algorithms known as "biased sampling" or "reverse logistic regression" in the…

Methodology · Statistics 2014-10-16 Ewan Cameron , Anthony Pettitt

We present asymptotic results for the regression-adjusted version of approximate Bayesian computation introduced by Beaumont(2002). We show that for an appropriate choice of the bandwidth, regression adjustment will lead to a posterior…

Statistics Theory · Mathematics 2017-11-29 Wentao Li , Paul Fearnhead

Given i.i.d. data from an unknown distribution, we consider the problem of predicting future items. An adaptive way to estimate the probability density is to recursively subdivide the domain to an appropriate data-dependent granularity. A…

Probability · Mathematics 2009-12-30 Marcus Hutter

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

This article tackles the old problem of prediction via a nonparametric transformation model (NTM) in a new Bayesian way. Estimation of NTMs is known challenging due to model unidentifiability though appealing because of its robust…

Methodology · Statistics 2023-02-08 Chong Zhong , Jin Yang , Junshan Shen , Catherine Liu , Zhaohai Li

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide…

Statistical Mechanics · Physics 2020-05-11 S. E. Marzen , J. P. Crutchfield

We revisit the sequential variants of linear regression with the squared loss, classification problems with hinge loss, and logistic regression, all characterized by unbounded losses in the setup where no assumptions are made on the…

Machine Learning · Statistics 2025-09-08 Jian Qian , Alexander Rakhlin , Nikita Zhivotovskiy

The first-order autoregressive process, AR (1), has been widely used and implemented in time series analysis. Different estimation methods have been employed in order to estimate the autoregressive parameter. This article focuses on…

Methodology · Statistics 2016-11-29 Hossein Masoumi Karakani , Janet van Niekerk , Paul van Staden