English
Related papers

Related papers: Inverting the Fisher information operator in non-l…

200 papers

Current experimental design techniques for dynamical systems often only incorporate measurement noise, while dynamical systems also involve process noise. To construct experimental designs we need to quantify their information content. The…

Methodology · Statistics 2026-03-24 Arno Strouwen , Bart M. Nicolaï , Peter Goos

The problem of estimating a parametric or nonparametric regression function in a model with normal errors is considered. For this purpose, a novel objective prior for the regression function is proposed, defined as the distribution…

Statistics Theory · Mathematics 2019-12-13 Wicher Bergsma

The intrinsic dimensionality of an inverse problem is affected by prior information, the accuracy and number of observations, and the smoothing properties of the forward operator. From a Bayesian perspective, changes from the prior to the…

Computation · Statistics 2016-05-03 Tiangang Cui , James Martin , Youssef M. Marzouk , Antti Solonen , Alessio Spantini

Reconstruction techniques are commonly used in cosmology to reduce complicated nonlinear behaviours to a more tractable linearized system. We study a new reconstruction technique that uses the Moving-Mesh algorithm to estimate the…

Cosmology and Nongalactic Astrophysics · Physics 2017-06-21 Qiaoyin Pan , Ue-Li Pen , Derek Inman , Hao-Ran Yu

Discrete-time diffusion-based generative models and score matching methods have shown promising results in modeling high-dimensional image data. Recently, Song et al. (2021) show that diffusion processes that transform data into noise can…

Machine Learning · Computer Science 2021-10-01 Chin-Wei Huang , Jae Hyun Lim , Aaron Courville

Information theory is a powerful framework to capture aspects of dynamical systems with multiple degrees of freedom. Mathematically, the dynamics can be represented as a continuous curve $\mathcal{C}$ on a suitable hyperplane in flat space…

Information Theory · Computer Science 2026-04-28 Mattia Carrino , Stefan Hohenegger

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

We introduce a framework for the reconstruction and representation of functions in a setting where these objects cannot be directly observed, but only indirect and noisy measurements are available, namely an inverse problem setting. The…

Methodology · Statistics 2020-09-15 Eardi Lila , Simon Arridge , John A. D. Aston

We introduce the Fisher information in the basis of decay modes of Markovian dynamics, arguing that it encodes important information about the behavior of nonequilibrium systems. In particular we generalize an orthonormality relation…

Statistical Mechanics · Physics 2014-09-16 Matteo Polettini

Wave packet revivals and fractional revivals are studied by means of a measure of nonclassicality based on the Fisher information. In particular, we show that the spreading and the regeneration of initially Gaussian wave packets in a…

Quantum Physics · Physics 2014-09-22 E. Romera , F. de los Santos

Our proposal is on a new stochastic optimizer for non-convex and possibly non-smooth objective functions typically defined over large dimensional design spaces. Towards this, we have tried to bridge noise-assisted global search and faster…

Machine Learning · Computer Science 2025-03-03 Uttam Suman , Mariya Mamajiwala , Mukul Saxena , Ankit Tyagi , Debasish Roy

We consider the inverse scattering problem for time-harmonic acoustic waves in a medium with pointwise inhomogeneities. In the Foldy-Lax model, the estimation of the scatterers' locations and intensities from far field measurements can be…

Numerical Analysis · Mathematics 2024-07-25 Giovanni S. Alberti , Romain Petit , Matteo Santacesaria

Single index model is a powerful yet simple model, widely used in statistics, machine learning, and other scientific fields. It models the regression function as $g(<a,x>)$, where a is an unknown index vector and x are the features. This…

Statistics Theory · Mathematics 2020-12-08 Zeljko Kereta , Timo Klock , Valeriya Naumova

Sparse recovery is one of the most fundamental and well-studied inverse problems. Standard statistical formulations of the problem are provably solved by general convex programming techniques and more practical, fast (nearly-linear time)…

Data Structures and Algorithms · Computer Science 2022-03-09 Jonathan A. Kelner , Jerry Li , Allen Liu , Aaron Sidford , Kevin Tian

We consider inverse problems estimating distributed parameters from indirect noisy observations through discretization of continuum models described by partial differential or integral equations. It is well understood that the errors…

Numerical Analysis · Mathematics 2023-10-09 Albero Bocchinfuso , Daniela Calvetti , Erkki Somersalo

This paper considers the inversion of ill-posed linear operators. To regularise the problem the solution is enforced to lie in a non-convex subset. Theoretical properties for the stable inversion are derived and an iterative algorithm akin…

Numerical Analysis · Mathematics 2009-11-30 Thomas Blumensath

Famously, the quantum Fisher information -- the maximum Fisher information over all physical measurements -- is additive for independent copies of a system and the optimal measurement acts locally. We are left to wonder: does the same hold…

Quantum Physics · Physics 2025-12-24 Javier Navarro , Simon Morelli , Mikel Sanz , Mohammad Mehboudi

Diffusion models are extensively used for modeling image priors for inverse problems. We introduce \emph{Diff-Unfolding}, a principled framework for learning posterior score functions of \emph{conditional diffusion models} by explicitly…

Image and Video Processing · Electrical Eng. & Systems 2025-05-22 Yuanhao Wang , Shirin Shoushtari , Ulugbek S. Kamilov

For latent class models where the class weights depend on individual covariates, we derive a simple expression for computing the score vector and a convenient hybrid between the observed and the expected information matrices which is always…

Computation · Statistics 2015-11-13 Antonio Forcina

This paper presents a generalizable methodology for data-driven identification of nonlinear dynamics that bounds the model error in terms of the prediction horizon and the magnitude of the derivatives of the system states. Using…

Machine Learning · Statistics 2021-05-03 Giorgos Mamakoukas , Maria L. Castano , Xiaobo Tan , Todd D. Murphey