English
Related papers

Related papers: In- and Equivariance for Optimal Designs in Genera…

200 papers

This paper presents invariants under gamma correction and similarity transformations. The invariants are local features based on differentials which are implemented using derivatives of the Gaussian. The use of the proposed invariant…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Andreas Siebert

It is often said that a deep learning model is "invariant" to some specific type of transformation. However, what is meant by this statement strongly depends on the context in which it is made. In this paper we explore the nature of…

Machine Learning · Computer Science 2022-10-11 Henry Kvinge , Tegan H. Emerson , Grayson Jorgenson , Scott Vasquez , Timothy Doster , Jesse D. Lew

Previous analyses on the gauge invariance of the action for a generally covariant system are generalized. It is shown that if the action principle is properly improved, there is as much gauge freedom at the endpoints for an arbitrary gauge…

High Energy Physics - Theory · Physics 2009-10-22 Marc Henneaux , Claudio Teitelboim , J. David Vergara

We consider the problem of parameter estimation from a generalized linear model with a random design matrix that is orthogonally invariant in law. Such a model allows the design have an arbitrary distribution of singular values and only…

Statistics Theory · Mathematics 2026-02-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli

The issue of determining not only an adequate dose but also a dosing frequency of a drug arises frequently in Phase II clinical trials. This results in the comparison of models which have some parameters in common. Planning such studies…

Methodology · Statistics 2017-11-16 Kirsten Schorning , Maria Konstantinou

Gauge invariance was discovered in the development of classical electromagnetism and was required when the latter was formulated in terms of the scalar and vector potentials. It is now considered to be a fundamental principle of nature,…

Generalized linear models (GLMs) have been used widely for modelling the mean response both for discrete and continuous random variables with an emphasis on categorical response. Recently Yang, Mandal and Majumdar (2013) considered full…

Statistics Theory · Mathematics 2013-05-06 Jie Yang , Abhyuday Mandal

One method for obtaining generalizable solutions to machine learning tasks when presented with diverse training environments is to find \textit{invariant representations} of the data. These are representations of the covariates such that…

Machine Learning · Computer Science 2022-08-16 Advait Parulekar , Karthikeyan Shanmugam , Sanjay Shakkottai

The crucial role played by the underlying symmetries of high energy physics and lattice field theories calls for the implementation of such symmetries in the neural network architectures that are applied to the physical system under…

High Energy Physics - Lattice · Physics 2022-02-16 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

It is widely believed that engineering a model to be invariant/equivariant improves generalisation. Despite the growing popularity of this approach, a precise characterisation of the generalisation benefit is lacking. By considering the…

Machine Learning · Statistics 2021-07-07 Bryn Elesedy , Sheheryar Zaidi

In this paper, we discuss computational aspects to obtain accurate inferences for the parameters of the generalized gamma (GG) distribution. Usually, the solution of the maximum likelihood estimators (MLE) for the GG distribution have no…

Computation · Statistics 2017-07-26 Jorge Alberto Achcar , Pedro Luiz Ramos , Edson Zangiacomi Martinez

Generalized linear models (GLMs) arise in high-dimensional machine learning, statistics, communications and signal processing. In this paper we analyze GLMs when the data matrix is random, as relevant in problems such as compressed sensing,…

Information Theory · Computer Science 2019-04-01 Jean Barbier , Florent Krzakala , Nicolas Macris , Léo Miolane , Lenka Zdeborová

Machine learning models that are developed with invariance to certain types of data transformations have demonstrated superior generalization performance in practice. However, the underlying mechanism that explains why invariance leads to…

Machine Learning · Computer Science 2023-02-24 Sicheng Zhu , Bang An , Furong Huang

Generalized linear models (GLMs) have been used quite effectively in the modeling of a mean response under nonstandard conditions, where discrete as well as continuous data distributions can be accommodated. The choice of design for a GLM…

Statistics Theory · Mathematics 2016-08-14 André I. Khuri , Bhramar Mukherjee , Bikas K. Sinha , Malay Ghosh

Many chemical and biological experiments involve multiple treatment factors and often it is convenient to fit a nonlinear model in these factors. This nonlinear model can be mechanistic, empirical or a hybrid of the two. Motivated by…

Computation · Statistics 2018-10-09 Yuanzhi Huang , Steven Gilmour , Kalliopi Mylona , Peter Goos

Designing equivariance as an inductive bias into deep-nets has been a prominent approach to build effective models, e.g., a convolutional neural network incorporates translation equivariance. However, incorporating these inductive biases…

Machine Learning · Computer Science 2022-04-08 Raymond A. Yeh , Yuan-Ting Hu , Mark Hasegawa-Johnson , Alexander G. Schwing

The Poisson-Gamma model is a generalization of the Poisson model, which can be used for modelling count data. We show that the $D$-optimality criterion for the Poisson-Gamma model is equivalent to a combined weighted optimality criterion of…

Statistics Theory · Mathematics 2018-08-17 Marius Schmidt , Rainer Schwabe

Locally optimal designs for generalized linear models are derived at certain values of the regression parameters. In the present paper a general setup of the generalized linear model is considered. Analytic solutions for optimal designs are…

Statistics Theory · Mathematics 2019-06-06 Osama Idais

Achieving covariate balance in randomized experiments enhances the precision of treatment effect estimation. However, existing methods often require heuristic adjustments based on domain knowledge and are primarily developed for binary…

Methodology · Statistics 2025-02-25 Wenxuan Guo , Tengyuan Liang , Panos Toulis

We consider linear models with scalar responses and covariates from a separable Hilbert space. The aim is to detect change points in the error distribution, based on sequential residual empirical distribution functions. Expansions for those…

Statistics Theory · Mathematics 2024-11-08 Natalie Neumeyer , Leonie Selk