English
Related papers

Related papers: Optimal designs for nonlinear regression models wi…

200 papers

Optimal designs for generalized linear models require a prior knowledge of the regression parameters. At certain values of the parameters we propose particular assumptions which allow to derive a locally optimal design for a model without…

Statistics Theory · Mathematics 2019-06-26 Osama Idais

Results by van der Vaart (1991) from semi-parametric statistics about the existence of a non-zero Fisher information are reviewed in an infinite-dimensional non-linear Gaussian regression setting. Information-theoretically optimal inference…

Statistics Theory · Mathematics 2021-07-21 Richard Nickl , Gabriel Paternain

Linear regression models are among the models most used in practice, although the practitioners are often not sure whether their assumed linear regression model is at least approximately true. In such situations, only designs for which the…

Statistics Theory · Mathematics 2007-06-13 Wolfgang Bischoff , Frank Miller

Many scientific and engineering applications require fitting regression models that are nonlinear in the parameters. Advances in computer hardware and software in recent decades have made it easier to fit such models. Relative to fitting…

Methodology · Statistics 2024-03-20 Peng Liu , William Q. Meeker

Noninformative uniform priors are staples of Bayesian inference, especially in Bayesian machine learning. This study challenges the assumption that they are optimal and their use in Bayesian inference yields optimal outcomes. Instead of…

Machine Learning · Computer Science 2021-01-05 Ozan Kaan Kayaalp

Experimental designs based on the classical D-optimal criterion minimize the volume of the linear-approximation inference regions for the parameters using local sensitivity coefficients. For nonlinear models, these designs can be unreliable…

Methodology · Statistics 2021-01-22 Hana Sulieman

In this paper optimal designs for regression problems with spherical predictors of arbitrary dimension are considered. Our work is motivated by applications in material sciences, where crystallographic textures such as the missorientation…

Statistics Theory · Mathematics 2017-10-31 Holger Dette , Maria Konstantinou , Kirsten Schorning , Josua Gösmann

Optimal design of experiments for Bayesian inverse problems has recently gained wide popularity and attracted much attention, especially in the computational science and Bayesian inversion communities. An optimal design maximizes a…

Optimization and Control · Mathematics 2023-05-09 Ahmed Attia , Sven Leyffer , Todd Munson

We consider optimal non-sequential designs for a large class of (linear and nonlinear) regression models involving polynomials and rational functions with heteroscedastic noise also given by a polynomial or rational weight function. The…

Computation · Statistics 2011-08-30 Dávid Papp

Locally optimal designs for generalized linear models are derived at certain values of the regression parameters. In the present paper a general setup of the generalized linear model is considered. Analytic solutions for optimal designs are…

Statistics Theory · Mathematics 2019-06-06 Osama Idais

In objective Bayesian model selection, no single criterion has emerged as dominant in defining objective prior distributions. Indeed, many criteria have been separately proposed and utilized to propose differing prior choices. We first…

Statistics Theory · Mathematics 2012-09-25 M. J. Bayarri , J. O. Berger , A. Forte , G. García-Donato

Prior distributions elicited for modelling the natural fluctuations or the uncertainty on parameters of Bayesian fishery population models, can be chosen among a vast range of statistical laws. Since the statistical framework is defined by…

Statistics Theory · Mathematics 2010-10-12 Nicolas Bousquet

The generation of decision-theoretic Bayesian optimal designs is complicated by the significant computational challenge of minimising an analytically intractable expected loss function over a, potentially, high-dimensional design space. A…

Methodology · Statistics 2017-02-07 Antony M. Overstall , James M. McGree , Christopher C. Drovandi

In the context of a high-dimensional linear regression model, we propose the use of an empirical correlation-adaptive prior that makes use of information in the observed predictor variable matrix to adaptively address high collinearity,…

Methodology · Statistics 2022-07-04 Chang Liu , Yue Yang , Howard Bondell , Ryan Martin

Nonlinear metrics, such as the F1-score, Matthews correlation coefficient, and Fowlkes-Mallows index, are often used to evaluate the performance of machine learning models, in particular, when facing imbalanced datasets that contain more…

Machine Learning · Computer Science 2022-06-30 Emir Demirović , Peter J. Stuckey

We investigate the problem of estimating the causal effect of a treatment on individual subjects from observational data, this is a central problem in various application domains, including healthcare, social sciences, and online…

Methodology · Statistics 2019-01-30 Ahmed M. Alaa , Mihaela van der Schaar

We study full Bayesian procedures for high-dimensional linear regression under sparsity constraints. The prior is a mixture of point masses at zero and continuous distributions. Under compatibility conditions on the design matrix, the…

Statistics Theory · Mathematics 2015-10-15 Ismaël Castillo , Johannes Schmidt-Hieber , Aad van der Vaart

Performing optimal Bayesian design for discriminating between competing models is computationally intensive as it involves estimating posterior model probabilities for thousands of simulated datasets. This issue is compounded further when…

Methodology · Statistics 2022-04-07 Markus Hainy , David J. Price , Olivier Restif , Christopher Drovandi

Bayesian optimization is a methodology for global optimization of unknown and expensive objectives. It combines a surrogate Bayesian regression model with an acquisition function to decide where to evaluate the objective. Typical regression…

Machine Learning · Computer Science 2023-04-04 Afonso Eduardo , Michael U. Gutmann

We propose a variance-penalized formulation of Bayesian optimal experimental design for nonlinear models that augments the classical expected utility criterion with a penalty on utility variability, yielding a mean--variance objective that…

Methodology · Statistics 2026-04-07 Wanggang Shen , Xun Huan