English
Related papers

Related papers: On some information-theoretic aspects of non-linea…

200 papers

We consider the inverse source problem in the parabolic equation, where the unknown source possesses the semi-discrete formulation. Theoretically, we prove that the flux data from any nonempty open subset of the boundary can uniquely…

Numerical Analysis · Mathematics 2022-11-23 Guang Lin , Zecheng Zhang , Zhidong Zhang

Inverse problems and, in particular, inferring unknown or latent parameters from data are ubiquitous in engineering simulations. A predominant viewpoint in identifying unknown parameters is Bayesian inference where both prior information…

Computation · Statistics 2022-08-31 Vahid Keshavarzzadeh , Robert M. Kirby , Akil Narayan

Inverse problems, i.e., estimating parameters of physical models from experimental data, are ubiquitous in science and engineering. The Bayesian formulation is the gold standard because it alleviates ill-posedness issues and quantifies…

Machine Learning · Statistics 2024-05-28 Sharmila Karumuri , Ilias Bilionis

This paper studies a nonlinear filtering problem over an infinite time interval. The signal to be estimated is driven by a stochastic partial differential equation involves unknown parameters. Based on discrete observation, strongly…

Statistics Theory · Mathematics 2021-07-12 Qizhu Liang , Jie Xiong , Xingqiu Zhao

We review with a tutorial scope the information theory foundations of quantum statistical physics. Only a small proportion of the variables that characterize a system at the microscopic scale can be controlled, for both practical and…

Statistical Mechanics · Physics 2007-05-23 R. Balian

We consider the statistical linear inverse problem of making inference on an unknown source function in an elliptic partial differential equation from noisy observations of its solution. We employ nonparametric Bayesian procedures based on…

Statistics Theory · Mathematics 2024-07-26 Matteo Giordano

In a given problem, the Bayesian statistical paradigm requires the specification of a prior distribution that quantifies relevant information about the unknowns of main interest external to the data. In cases where little such information…

Statistics Theory · Mathematics 2017-10-11 Alexander Terenin , David Draper

Fisher information is a lower bound on the uncertainty in the statistical estimation of classical and quantum mechanical parameters. While some deterministic dynamical systems are not subject to random fluctuations, they do still have a…

Classical Physics · Physics 2023-10-06 Mohamed Sahbani , Swetamber Das , Jason R. Green

We address the fundamental limits of learning unknown parameters of any stochastic process from time-series data, and discover exact closed-form expressions for how optimal inference scales with observation length. Given a parametrized…

Machine Learning · Computer Science 2023-10-09 Paul M. Riechers

Fisher information is a measure of the best precision with which a parameter can be estimated from statistical data. It can also be defined for a continuous random variable without reference to any parameters, in which case it has a…

Data Analysis, Statistics and Probability · Physics 2009-03-22 S. Prasad , N. C. Menicucci

We study empirical and hierarchical Bayes approaches to the problem of estimating an infinite-dimensional parameter in mildly ill-posed inverse problems. We consider a class of prior distributions indexed by a hyperparameter that quantifies…

Statistics Theory · Mathematics 2013-05-30 B. T. Knapik , B. T. Szabó , A. W. van der Vaart , J. H. van Zanten

We study the evolution of the nonlinear version of the Fisher information along the quasilinear heat equation. We also provide a nonlinear version of a recent functional inequality (Cie\'slak--Fuest--Hajduk--Sier\.z\k{e}ga, 2024),…

Analysis of PDEs · Mathematics 2025-09-03 Tomasz Cieślak , Kentaro Fujie , Tatsuya Hosono

We study nonparametric Bayesian statistical inference for the parameters governing a pure jump process of the form $$Y_t = \sum_{k=1}^{N(t)} Z_k,~~~ t \ge 0,$$ where $N(t)$ is a standard Poisson process of intensity $\lambda$, and $Z_k$ are…

Statistics Theory · Mathematics 2019-10-02 Richard Nickl , Jakob Söhl

The analytic inference, e.g. predictive distribution being in closed form, may be an appealing benefit for machine learning practitioners when they treat wide neural networks as Gaussian process in Bayesian setting. The realistic widths,…

Disordered Systems and Neural Networks · Physics 2023-08-01 Chi-Ken Lu

A way of constructing a nonlinear filter close to the optimal Kolmogorov - Wiener filter is proposed within the framework of the statistical approach to inverse problems. Quasi-optimal filtering, which has no Bayesian assumptions, produces…

Mathematical Physics · Physics 2009-11-10 V. Yu. Terebizh

In this paper we focus on a type of inverse problem in which the data is expressed as an unknown function of the sought and unknown model function (or its discretised representation as a model parameter vector). In particular, we deal with…

Applications · Statistics 2019-08-19 Dalia Chakrabarty , Prasenjit Saha

Between Bayesian and frequentist inference, it's commonly believed that the former is for cases where one has a prior and the latter is for cases where one has no prior. But the prior/no-prior classification isn't exhaustive, and most…

Statistics Theory · Mathematics 2022-11-29 Ryan Martin

Consider the centered Gaussian vector $X$ in $\R^n$ with covariance matrix $ \Sigma.$ Randomize $\Sigma$ such that $ \Sigma^{-1}$ has a Wishart distribution with shape parameter $p>(n-1)/2$ and mean $p\sigma.$ We compute the density…

Statistics Theory · Mathematics 2022-11-28 Gérard G. Letac

We study full Bayesian procedures for high-dimensional linear regression. We adopt data-dependent empirical priors introduced in [1]. In their paper, these priors have nice posterior contraction properties and are easy to compute. Our paper…

Statistics Theory · Mathematics 2022-02-14 Xiao Fang , Malay Ghosh

We present a computational framework for estimating the uncertainty in the numerical solution of linearized infinite-dimensional statistical inverse problems. We adopt the Bayesian inference formulation: given observational data and their…

Numerical Analysis · Mathematics 2013-08-07 Tan Bui-Thanh , Omar Ghattas , James Martin , Georg Stadler