English
Related papers

Related papers: On some information-theoretic aspects of non-linea…

200 papers

This paper considers the problem of estimation of the Fisher information for location from a random sample of size $n$. First, an estimator proposed by Bhattacharya is revisited and improved convergence rates are derived. Second, a new…

Information Theory · Computer Science 2020-05-08 Wei Cao , Alex Dytso , Michael Fauß , H. Vincent Poor , Gang Feng

Formulating a statistical inverse problem as one of inference in a Bayesian model has great appeal, notably for what this brings in terms of coherence, the interpretability of regularisation penalties, the integration of all uncertainties,…

Statistics Theory · Mathematics 2012-12-19 Natalia A. Bochkina , Peter J. Green

The optimal phase estimation strategy is derived when partial a priori knowledge on the estimated phase is available. The structure of the optimal measurements, estimators and the optimal probe states is analyzed. The results fill the gap…

Quantum Physics · Physics 2013-05-29 Rafal Demkowicz-Dobrzanski

In nonlinear regression models the Fisher information depends on the parameters of the model. Consequently, optimal designs maximizing some functional of the information matrix cannot be implemented directly but require some preliminary…

Methodology · Statistics 2013-11-05 Ina Burghaus , Holger Dette

I prove a semiparametric Bernstein-von Mises theorem for a partially linear regression model with independent priors for the low-dimensional parameter of interest and the infinite-dimensional nuisance parameters. My result avoids a…

Statistics Theory · Mathematics 2025-04-08 Christopher D. Walker

We develop a semiparametric Bayesian approach for estimating the mean response in a missing data model with binary outcomes and a nonparametrically modelled propensity score. Equivalently we estimate the causal effect of a treatment,…

Statistics Theory · Mathematics 2020-09-23 Kolyan Ray , Aad van der Vaart

Recently, several studies proposed non-linear transformations, such as a logarithmic or Gaussianization transformation, as efficient tools to recapture information about the (Gaussian) initial conditions. During non-linear evolution, part…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-16 Julien Carron , Istvan Szapudi

We consider a Bayesian approach for the recovery of scalar parameters arising in inverse problems. We consider a general signal-in white noise model where we have access to two independent noisy observations of a function, and of a linear…

Statistics Theory · Mathematics 2025-04-10 Adel Magra , Aad van der Vaart , Harry van Zanten

The problem of determining the intrinsic quality of a signal processing system with respect to the inference of an unknown deterministic parameter $\theta$ is considered. While the Fisher information measure $F(\theta)$ forms a classical…

Information Theory · Computer Science 2018-05-30 Manuel Stein , Josef A. Nossek

Bayesian inverse problem on an infinite dimensional separable Hilbert space with the whole state observed is well posed when the prior state distribution is a Gaussian probability measure and the data error covariance is a cylindric…

Probability · Mathematics 2017-01-31 Ivan Kasanický , Jan Mandel

For $D$ a bounded domain in $\mathbb R^d, d \ge 2,$ with smooth boundary $\partial D$, the non-linear inverse problem of recovering the unknown conductivity $\gamma$ determining solutions $u=u_{\gamma, f}$ of the partial differential…

Statistics Theory · Mathematics 2020-04-21 Kweku Abraham , Richard Nickl

The Fisher Information matrix is a widely used measure for applications ranging from statistical inference, information geometry, experiment design, to the study of criticality in biological systems. Yet there is no commonly accepted…

Computation · Statistics 2016-02-17 Omri Har Shemesh , Rick Quax , Borja Miñano , Alfons G. Hoekstra , Peter M. A. Sloot

In this paper we consider the estimation of unknown parameters in Bayesian inverse problems. In most cases of practical interest, there are several barriers to performing such estimation, This includes a numerical approximation of a…

Methodology · Statistics 2025-02-07 Neil K. Chada , Ajay Jasra , Mohamed Maama , Raul Tempone

We study the asymptotic behaviour of the posterior distribution in a broad class of statistical models where the "true" solution occurs on the boundary of the parameter space. We show that in this case Bayesian inference is consistent, and…

Statistics Theory · Mathematics 2014-10-02 Natalia A. Bochkina , Peter J. Green

In inverse problems, one attempts to infer spatially variable functions from indirect measurements of a system. To practitioners of inverse problems, the concept of "information" is familiar when discussing key questions such as which parts…

Numerical Analysis · Mathematics 2025-02-12 Wolfgang Bangerth , Chris R. Johnson , Dennis K. Njeru , Bart van Bloemen Waanders

We consider the Bayesian approach to linear inverse problems when the underlying operator depends on an unknown parameter. Allowing for finite dimensional as well as infinite dimensional parameters, the theory covers several models with…

Statistics Theory · Mathematics 2018-09-05 Mathias Trabs

We develop a general method to study the Fisher information distance in central limit theorem for nonlinear statistics. We first construct completely new representations for the score function. We then use these representations to derive…

Probability · Mathematics 2024-09-23 Nguyen Tien Dung

In a smooth semi-parametric model, the marginal posterior distribution for a finite dimensional parameter of interest is expected to be asymptotically equivalent to the sampling distribution of any efficient point-estimator. The assertion…

Statistics Theory · Mathematics 2018-03-26 Minwoo Chae , Yongdai Kim , Bas Kleijn

We study a nonparametric Bayesian approach to linear inverse problems under discrete observations. We use the discrete Fourier transform to convert our model into a truncated Gaussian sequence model, that is closely related to the classical…

Statistics Theory · Mathematics 2018-10-31 Shota Gugushvili , Aad van der Vaart , Dong Yan

The Bayesian approach to inverse problems provides a practical way to solve ill-posed problems by augmenting the observation model with prior information. Due to the measure-theoretic underpinnings, the approach has raised theoretical…

Numerical Analysis · Mathematics 2026-02-12 Daniela Calvetti , Erkki Somersalo