English
Related papers

Related papers: In- and Equivariance for Optimal Designs in Genera…

200 papers

We prove some invariance principles for processes which generalize FARIMA processes, when the innovations are in the domain of attraction of a nonGaussian stable distribution. The limiting processes are extensions of the fractional L\'evy…

Probability · Mathematics 2010-07-06 Ph. Barbe , W. P. McCormick

We provide finite-sample distribution approximations, that are uniform in the parameter, for inference in linear mixed models. Focus is on variances and covariances of random effects in cases where existing theory fails because their…

Statistics Theory · Mathematics 2025-07-29 Karl Oskar Ekvall , Matteo Bottai

Traditional methods for covariate adjustment of treatment means in designed experiments are inherently conditional on the observed covariate values. In order to develop a coherent general methodology for analysis of covariance, we propose a…

Methodology · Statistics 2010-01-19 James G. Booth , Walter T. Federer , Martin T. Wells , Russell D. Wolfinger

We consider optimal design of infinite-dimensional Bayesian linear inverse problems governed by partial differential equations that contain secondary reducible model uncertainties, in addition to the uncertainty in the inversion parameters.…

Optimization and Control · Mathematics 2020-06-23 Alen Alexanderian , Noemi Petra , Georg Stadler , Isaac Sunseri

Optimal statistical decisions should transcend the language used to describe them. Yet, how do we guarantee that the choice of coordinates - the parameterisation of an optimisation problem - does not subtly dictate the solution? This paper…

Other Computer Science · Computer Science 2025-05-06 William Cook

Optimum designs for parameter estimation in generalized regression models are standardly based on the Fisher information matrix (cf. Atkinson et al (2014) for a recent exposition). The corresponding optimality criteria are related to the…

Statistics Theory · Mathematics 2015-07-28 Katarína Burclová , Andrej Pázman

This paper considers generalized linear models using rule-based features, also referred to as rule ensembles, for regression and probabilistic classification. Rules facilitate model interpretation while also capturing nonlinear dependences…

Machine Learning · Computer Science 2019-06-06 Dennis Wei , Sanjeeb Dash , Tian Gao , Oktay Günlük

Unsupervised approaches for learning representations invariant to common transformations are used quite often for object recognition. Learning invariances makes models more robust and practical to use in real-world scenarios. Since data…

Machine Learning · Computer Science 2024-02-27 Gauri Gupta , Ritvik Kapila , Keshav Gupta , Ramesh Raskar

Bayesian optimality criteria provide a robust design strategy to parameter misspecification. We develop an approximate design theory for Bayesian $D$-optimality for non-linear regression models with covariates subject to measurement errors.…

Methodology · Statistics 2016-05-16 Maria Konstantinou , Holger Dette

Equivariances provide useful inductive biases in neural network modeling, with the translation equivariance of convolutional neural networks being a canonical example. Equivariances can be embedded in architectures through weight-sharing…

Machine Learning · Computer Science 2022-11-15 Tycho F. A. van der Ouderaa , David W. Romero , Mark van der Wilk

In the common linear regression model the problem of determining optimal designs for least squares estimation is considered in the case where the observations are correlated. A necessary condition for the optimality of a given design is…

Statistics Theory · Mathematics 2013-03-13 Holger Dette , Andrey Pepelyshev , Anatoly Zhigljavsky

Performing a computer experiment can be viewed as observing a mapping between the model parameters and the corresponding model outputs predicted by the computer model. In view of this, experimental design for computer experiments can be…

Computation · Statistics 2017-12-29 Chang-Han Rhee , Enlu Zhou , Peng Qiu

The problem of estimating location (scale) parameters $\theta_1$ and $\theta_2$ of two distributions when the ordering between them is known apriori (say, $\theta_1\leq \theta_2$) has been extensively studied in the literature. Many of…

Statistics Theory · Mathematics 2022-07-05 Naresh Garg , Neeraj Misra

Developing and deploying machine learning models safely depends on the ability to characterize and compare their abilities to generalize to new environments. Although recent work has proposed a variety of methods that can directly predict…

Machine Learning · Computer Science 2023-07-18 Nathan Ng , Neha Hulkund , Kyunghyun Cho , Marzyeh Ghassemi

In this paper we construct (locally) $D$-optimal designs for a wide class of non-linear multiple regression models, when the design region is a $k$-dimensional ball. For this construction we make use of the concept of invariance and…

Methodology · Statistics 2021-04-07 Martin Radloff , Rainer Schwabe

Invariances to translations have imbued convolutional neural networks with powerful generalization properties. However, we often do not know a priori what invariances are present in the data, or to what extent a model should be invariant to…

Machine Learning · Computer Science 2020-12-02 Gregory Benton , Marc Finzi , Pavel Izmailov , Andrew Gordon Wilson

We consider high-dimensional generalized linear models when the covariates are contaminated by measurement error. Estimates from errors-in-variables regression models are well-known to be biased in traditional low-dimensional settings if…

Computation · Statistics 2020-01-06 Michael Byrd , Monnie McGee

Numerous invariant (or equivariant) neural networks have succeeded in handling invariant data such as point clouds and graphs. However, a generalization theory for the neural networks has not been well developed, because several essential…

Machine Learning · Statistics 2021-06-22 Akiyoshi Sannai , Masaaki Imaizumi , Makoto Kawano

The bivariate Gaussian distribution has been a key model for many developments in statistics. However, many real-world phenomena generate data that follow asymmetric distributions, and consequently bivariate normal model is inappropriate in…

Methodology · Statistics 2022-12-08 Roberto Vila , Narayanaswamy Balakrishnan , Helton Saulo , Ana Protazio

We describe an approximate statistical model for the sample variance distribution of the non-linear matter power spectrum that can be calibrated from limited numbers of simulations. Our model retains the common assumption of a multivariate…