English
Related papers

Related papers: Quantifying nuisance parameter effects via decompo…

200 papers

We propose a general approach to construct weighted likelihood estimating equations with the aim of obtaining robust parameter estimates. We modify the standard likelihood equations by incorporating a weight that reflects the statistical…

Statistics Theory · Mathematics 2025-07-24 Claudio Agostinelli , Ayanendranath Basu , Giulia Bertagnolli , Arun Kumar Kuchibhotla

We investigate the role of noise in optimization algorithms for learning over-parameterized models. Specifically, we consider the recovery of a rank one matrix $Y^*\in R^{d\times d}$ from a noisy observation $Y$ using an…

Machine Learning · Computer Science 2022-02-09 Tianyi Liu , Yan Li , Enlu Zhou , Tuo Zhao

Many inverse problems include nuisance parameters which, while not of direct interest, are required to recover primary parameters. Structure present in these problems allows efficient optimization strategies - a well known example is…

Numerical Analysis · Mathematics 2015-06-05 Aleksandr Y. Aravkin , Tristan van Leeuwen

We often estimate a parameter of interest psi when the identifying conditions involve a nuisance parameter theta. Examples from causal inference are Inverse Probability Weighting, Marginal Structural Models and Structural Nested Models. To…

Statistics Theory · Mathematics 2022-08-30 Judith J. Lok

We provide an analytical argument for understanding the likely nature of parameter shifts between those coming from an analysis of a dataset and from a subset of that dataset, assuming differences are down to noise and any intrinsic…

Instrumentation and Methods for Astrophysics · Physics 2020-10-28 Steven Gratton , Anthony Challinor

In this paper we consider the problem of estimating a parameter of a probability distribution when we have some prior information on a nuisance parameter. We start by the very simple case where we know perfectly the value of the nuisance…

Data Analysis, Statistics and Probability · Physics 2007-08-23 Ali Mohammad-Djafari , Adel Mohammadpour

In this article we study a class of parameters with the so-called `mixed bias property'. For parameters with this property, the bias of the semiparametric efficient one step estimator is equal to the mean of the product of the estimation…

Statistics Theory · Mathematics 2019-05-07 Andrea Rotnitzky , Ezequiel Smucler , James M. Robins

We study the high-dimensional linear model with noise distribution known up to a scale parameter. With an $\ell_1$-penalty on the regression coefficients, we show that a transformation of the log-likelihood allows for a choice of the tuning…

Statistics Theory · Mathematics 2025-12-23 Sara van de Geer , Sylvain Sardy , Maximę van Cutsem

We examine the problem of variance components testing in general mixed effects models using the likelihood ratio test. We account for the presence of nuisance parameters, i.e. the fact that some untested variances might also be equal to…

Methodology · Statistics 2024-05-27 Tom Guédon , Charlotte Baey , Estelle Kuhn

Mixed linear models are commonly used in repeated measures studies. They account for the dependence amongst observations obtained from the same experimental unit. Oftentimes, the number of observations is small, and it is thus important to…

Methodology · Statistics 2011-08-05 Tatiane F. N. Melo , Silvia L. P. Ferrari , Francisco Cribari-Neto

Consider observing an undirected network that is `noisy' in the sense that there are Type I and Type II errors in the observation of edges. Such errors can arise, for example, in the context of inferring gene regulatory networks in genomics…

Machine Learning · Statistics 2014-01-03 Prakash Balachandran , Edoardo Airoldi , Eric Kolaczyk

We propose a two-sample extended empirical likelihood for inference on the difference between two p-dimensional parameters defined by estimating equations. The standard two-sample empirical likelihood for the difference is Bartlett…

Statistics Theory · Mathematics 2014-12-24 Min Tsao , Fan Wu

The penalized profile sampler for semiparametric inference is an extension of the profile sampler method (Lee, Kosorok and Fine, 2005) obtained by profiling a penalized log-likelihood. The idea is to base inference on the posterior…

Statistics Theory · Mathematics 2007-06-13 Guang Cheng , Michael R. Kosorok

We provide (high probability) bounds on the condition number of random feature matrices. In particular, we show that if the complexity ratio $\frac{N}{m}$ where $N$ is the number of neurons and $m$ is the number of data samples scales like…

Machine Learning · Statistics 2021-11-08 Zhijun Chen , Hayden Schaeffer

Random-effects models are frequently used to synthesise information from different studies in meta-analysis. While likelihood-based inference is attractive both in terms of limiting properties and of implementation, its application in…

Methodology · Statistics 2018-02-16 Ioannis Kosmidis , Annamaria Guolo , Cristiano Varin

Although treatment effects can be estimated from observed outcome distributions obtained from proper randomization in clinical trials, covariate adjustment is recommended to increase precision. For important treatment effects, such as odds…

Methodology · Statistics 2025-07-03 Susanne Dandl , Torsten Hothorn

Does the asymptotic variance of the maximum composite likelihood estimator of a parameter of interest always decrease when the nuisance parameters are known? Will a composite likelihood necessarily become more efficient by incorporating…

Statistics Theory · Mathematics 2016-12-22 Ximing Xu , Nancy Reid , Libai Xu

We obtain two theorems extending the use of a saddlepoint approximation to multiparameter problems for likelihood ratio-like statistics which allow their use in permutation and rank tests and could be used in bootstrap approximations. In…

Statistics Theory · Mathematics 2012-03-15 John Kolassa , John Robinson

Experimental research on behavior and cognition frequently rests on stimulus or subject selection where not all characteristics can be fully controlled, even when attempting strict matching. For example, when contrasting patients to…

Methodology · Statistics 2016-08-29 Jona Sassenhagen , Phillip M. Alday

Rank two parametric perturbations of operators and matrices are studied in various settings. In the finite dimensional case the formula for a characteristic polynomial is derived and the large parameter asymptotics of the spectrum is…

Functional Analysis · Mathematics 2016-05-03 Anna Kula , Michal Wojtylak , Janusz Wysoczański