English
Related papers

Related papers: Optimal designs for frequentist model averaging

200 papers

The main purpose of this article is to prove that, under certain assumptions in a linear prediction setting, optimal methods based upon model reduction and even an optimal predictor can be provided. The optimality is formulated in terms of…

Statistics Theory · Mathematics 2024-12-30 Inge S. Helland

Bayesian optimal experimental design (OED) seeks to conduct the most informative experiment under budget constraints to update the prior knowledge of a system to its posterior from the experimental data in a Bayesian framework. Such…

Machine Learning · Computer Science 2024-02-29 Rafael Orozco , Felix J. Herrmann , Peng Chen

We consider the problem of designing experiments for the comparison of two regression curves describing the relation between a predictor and a response in two groups, where the data between and within the group may be dependent. In order to…

Statistics Theory · Mathematics 2021-01-15 Kirsten Schorning , Holger Dette

Experimental design is an approach for selecting samples among a given set so as to obtain the best estimator for a given criterion. In the context of linear regression, several optimal designs have been derived, each associated with a…

Statistics Theory · Mathematics 2021-01-01 Geovani Rizk , Igor Colin , Albert Thomas , Moez Draief

We study stability properties of the expected utility function in Bayesian optimal experimental design. We provide a framework for this problem in a non-parametric setting and prove a convergence rate of the expected utility with respect to…

Statistics Theory · Mathematics 2023-11-07 Duc-Lam Duong , Tapio Helin , Jose Rodrigo Rojo-Garcia

We consider maximin and Bayesian $D$-optimal designs for nonlinear regression models. The maximin criterion requires the specification of a region for the nonlinear parameters in the model, while the Bayesian optimality criterion assumes…

Statistics Theory · Mathematics 2009-09-29 Dietrich Braess , Holger Dette

We consider the problem of how to assign treatment in a randomized experiment, in which the correlation among the outcomes is informed by a network available pre-intervention. Working within the potential outcome causal framework, we…

Methodology · Statistics 2017-05-19 Guillaume W. Basse , Edoardo M. Airoldi

Fractional polynomial models are potentially useful for response surfaces investigations. With the availability of routines for fitting nonlinear models in statistical packages they are increasingly being used. However, as in all…

Methodology · Statistics 2025-10-29 Luzia A. Trinca , Steven G. Gilmour

We consider optimal design of infinite-dimensional Bayesian linear inverse problems governed by partial differential equations that contain secondary reducible model uncertainties, in addition to the uncertainty in the inversion parameters.…

Optimization and Control · Mathematics 2020-06-23 Alen Alexanderian , Noemi Petra , Georg Stadler , Isaac Sunseri

Among the major difficulties that one may encounter when estimating parameters in a nonlinear regression model are the nonuniqueness of the estimator, its instability with respect to small perturbations of the observations and the presence…

Statistics Theory · Mathematics 2014-08-29 Andrej Pázman , Luc Pronzato

Using Bayesian experimental design techniques, we have shown that for a single two-level quantum mechanical system under strong (projective) measurement, the dynamical parameters of a model Hamiltonian can be estimated with exponentially…

Quantum Physics · Physics 2012-06-05 Christopher Ferrie , Christopher E. Granade , D. G. Cory

Implicit stochastic models, where the data-generation distribution is intractable but sampling is possible, are ubiquitous in the natural sciences. The models typically have free parameters that need to be inferred from data collected in…

Machine Learning · Statistics 2020-08-17 Steven Kleinegesse , Michael U. Gutmann

This article illustrates how indirect or prior information can be optimally used to construct a prediction region that maintains a target frequentist coverage rate. If the indirect information is accurate, the volume of the prediction…

Statistics Theory · Mathematics 2021-06-01 Peter Hoff

Determining the causal structure of a set of variables is critical for both scientific inquiry and decision-making. However, this is often challenging in practice due to limited interventional data. Given that randomized experiments are…

Methodology · Statistics 2019-02-28 Raj Agrawal , Chandler Squires , Karren Yang , Karthik Shanmugam , Caroline Uhler

This work is concerned with the estimation of multidimensional regression and the asymptotic behaviour of the test involved in selecting models. The main problem with such models is that we need to know the covariance matrix of the noise to…

Statistics Theory · Mathematics 2008-02-20 Joseph Rynkiewicz

We develop a general theory to optimize the frequentist regret for sequential learning problems, where efficient bandit and reinforcement learning algorithms can be derived from unified Bayesian principles. We propose a novel optimization…

Machine Learning · Computer Science 2024-02-12 Yunbei Xu , Assaf Zeevi

Model averaging has gained significant attention in recent years due to its ability of fusing information from different models. The critical challenge in frequentist model averaging is the choice of weight vector. The bootstrap method,…

Methodology · Statistics 2024-12-10 Minghui Song , Guohua Zou , Alan T. K. Wan

The paper considers model selection in regression under the additional structural constraints on admissible models where the number of potential predictors might be even larger than the available sample size. We develop a Bayesian formalism…

Statistics Theory · Mathematics 2013-02-19 Felix Abramovich , Vadim Grinshtein

Bayesian experimental design involves the optimal allocation of resources in an experiment, with the aim of optimising cost and performance. For implicit models, where the likelihood is intractable but sampling from the model is possible,…

Machine Learning · Statistics 2019-02-26 Steven Kleinegesse , Michael Gutmann

This paper presents a new and efficient method for the construction of optimal designs for regression models with dependent error processes. In contrast to most of the work in this field, which starts with a model for a finite number of…

Methodology · Statistics 2015-11-06 Holger Dette , Maria Konstantinou , Anatoly Zhigljavsky