English
Related papers

Related papers: On some information-theoretic aspects of non-linea…

200 papers

The purpose of this article is to develop a general parametric estimation theory that allows the derivation of the limit distribution of estimators in non-regular models where the true parameter value may lie on the boundary of the…

Statistics Theory · Mathematics 2022-11-28 Junichiro Yoshida , Nakahiro Yoshida

Fisher (1934) argued that certain ancillary statistics form a relevant subset, a subset of the sample space on which inference should be restricted, and showed that conditioning on their observed value reduces the dimension of the data…

Methodology · Statistics 2021-06-18 Adam Lane

When the historical data are limited, the conditional probabilities associated with the nodes of Bayesian networks are uncertain and can be empirically estimated. Second order estimation methods provide a framework for both estimating the…

Machine Learning · Statistics 2022-08-09 Conrad D. Hougen , Lance M. Kaplan , Federico Cerutti , Alfred O. Hero

This note considers a finite dimensional statistical model for the Calder\'on problem with piecewise constant conductivities. In this setting it is shown that injectivity of the forward map and its linearisation suffice to prove the…

Statistics Theory · Mathematics 2022-06-17 Jan Bohr

When a mathematical or computational model is used to analyse some system, it is usual that some parameters resp.\ functions or fields in the model are not known, and hence uncertain. These parametric quantities are then identified by…

Probability · Mathematics 2016-07-01 Hermann G. Matthies , Elmar Zander , Bojana Rosic , Alexander Litvinenko

Observations or measurements taken of a quantum system (a small number of fundamental particles) are inherently random. If the state of the system depends on unknown parameters, then the distribution of the outcome depends on these…

Statistics Theory · Mathematics 2007-06-13 Richard D. Gill

We consider Bayesian inference in inverse regression problems where the objective is to infer about unobserved covariates from observed responses and covariates. We establish posterior consistency of such unobserved covariates in Bayesian…

Statistics Theory · Mathematics 2020-05-04 Debashis Chatterjee , Sourabh Bhattacharya

We derive upper bounds on the quantum Fisher information in interferometry with $N$ subsystems, e.g. two-level atoms or Gaussian modes, in the presence of arbitrarily correlated Gaussian dephasing including independent and collective…

Quantum Physics · Physics 2014-03-06 Katarzyna Macieszczak

The posterior distribution in a nonparametric inverse problem is shown to contract to the true parameter at a rate that depends on the smoothness of the parameter, and the smoothness and scale of the prior. Correct combinations of these…

Statistics Theory · Mathematics 2012-02-24 B. T. Knapik , A. W. van der Vaart , J. H. van Zanten

Consider the regression problem where the response $Y\in\mathbb{R}$ and the covariate $X\in\mathbb{R}^d$ for $d\geq 1$ are \textit{unmatched}. Under this scenario, we do not have access to pairs of observations from the distribution of $(X,…

Statistics Theory · Mathematics 2023-09-19 Mona Azadkia , Fadoua Balabdaoui

The quantum Fisher information of a quantum state with respect to a certain parameter quantifies the sensitivity of the quantum state to changes in that parameter. Maximizing the quantum Fisher information is essential for achieving the…

Quantum Physics · Physics 2026-02-06 Huining Zhang , X. X. Yi

When inferring parameters from a Gaussian-distributed data set by computing a likelihood, a covariance matrix is needed that describes the data errors and their correlations. If the covariance matrix is not known a priori, it may be…

Cosmology and Nongalactic Astrophysics · Physics 2016-01-27 Elena Sellentin , Alan F. Heavens

In this paper, a uniform (over some parameter space) moment bound for the inverse of Fisher's information matrix is established. This result is then applied to develop moment bounds for the normalized least squares estimate in (nonlinear)…

Statistics Theory · Mathematics 2012-11-22 Ngai Hang Chan , Ching-Kang Ing

Estimating the parameters of a probabilistic directed graphical model from incomplete data is a long-standing challenge. This is because, in the presence of latent variables, both the likelihood function and posterior distribution are…

Machine Learning · Computer Science 2024-06-04 Vy Vo , Trung Le , Tung-Long Vuong , He Zhao , Edwin Bonilla , Dinh Phung

Parameter inference with an estimated covariance matrix systematically loses information due to the remaining uncertainty of the covariance matrix. Here, we quantify this loss of precision and develop a framework to hypothetically restore…

Cosmology and Nongalactic Astrophysics · Physics 2017-03-16 Elena Sellentin , Alan F. Heavens

This paper considers the problem of kernel regression and classification with possibly unobservable response variables in the data, where the mechanism that causes the absence of information is unknown and can depend on both predictors and…

Statistics Theory · Mathematics 2022-12-07 Majid Mojirsheibani , William Pouliot , Andre Shakhbandaryan

We consider torsion in parameter manifolds that arises via conformal transformations of the Fisher information metric, and define it for information geometry of a wide class of physical systems. The torsion can be used to differentiate…

Classical Physics · Physics 2023-08-09 Kunal Pal , Kuntal Pal , Tapobrata Sarkar

We prove that the (square root) Fisher information functional is a strong Wasserstein upper gradient of the entropy on non-convex Riemannian domains. This fills a gap in the literature by allowing one to completely dispense from…

Analysis of PDEs · Mathematics 2025-12-08 Jean-Baptiste Casteras , Marco Flaim , Léonard Monsaingeon

Quantum Fisher information places the fundamental limit to the accuracy of estimating an unknown parameter. Here we shall provide the quantum Fisher information an operational meaning: a mixed state can be so prepared that a given…

Quantum Physics · Physics 2013-02-22 Sixia Yu

This paper brings a contribution to the Bayesian theory of nonparametric and semiparametric estimation. We are interested in the asymptotic normality of the posterior distribution in Gaussian linear regression models when the number of…

Statistics Theory · Mathematics 2012-03-05 Dominique Bontemps