English
Related papers

Related papers: Information-theory-based solution of the inverse p…

200 papers

Entropy is a fundamental concept in quantum information theory that allows to quantify entanglement and investigate its properties, for example its monogamy over multipartite systems. Here, we derive variational formulas for relative…

Quantum Physics · Physics 2024-05-21 Mario Berta , Marco Tomamichel

In a recent paper, the authors proposed a general methodology for probabilistic learning on manifolds. The method was used to generate numerical samples that are statistically consistent with an existing dataset construed as a realization…

Probability · Mathematics 2018-03-30 C. Soizea , R. Ghanem , C. Safta , X. Huan , Z. P. Vane , J. Oefelein , G. Lacaz , H. N. Najm , Q. Tang , X. Chen

A unified formulation of the density functional theory is constructed on the foundations of entropic inference in both the classical and the quantum regimes. The theory is introduced as an application of entropic inference for inhomogeneous…

Statistical Mechanics · Physics 2021-12-20 Ahmad Yousefi

On a compact group the Haar probability measure plays the role of uniform distribution. The entropy and rate distortion theory for this uniform distribution is studied. New results and simplified proofs on convergence of convolutions on…

Information Theory · Computer Science 2010-05-27 Peter Harremoes

We present an overview of information theory approach (both in its extensive and nonextensive versions) applied to high energy multiparticle production processes. It will be illustrated by analysis of single particle distributions measured…

High Energy Physics - Phenomenology · Physics 2009-11-10 F. S. Navarra , O. V. Utyuzh , G. Wilk , Z. Wlodarczyk

In the recent years, information theory of quantum-mechanical systems have aroused the interest of many Theoretical Physicist. This due to the fact that it provides a deeper insight into the internal structure of the systems. Also, It is…

Quantum Physics · Physics 2014-08-18 B. J. Falaye , K. J. Oyewumi , S. M. Ikhdair , M. Hamzavi

We show that an arbitrary spatial distribution of complex refractive index inside an object can be exactly represented as a sum of two "monomorphous" complex distributions, i.e. the distributions with the ratios of the real part to the…

Medical Physics · Physics 2015-12-09 T. E. Gureyev , Ya. I. Nesterets

The inverse problem for a disordered system involves determining the interparticle interaction parameters consistent with a given set of experimental data. Recently, Rutledge has shown (Phys. Rev. E63, 021111 (2001)) that such problems can…

Statistical Mechanics · Physics 2009-11-10 N. B. Wilding

We propose a formal expansion of the transfer entropy to put in evidence irreducible sets of variables which provide information for the future state of each assigned target. Multiplets characterized by a large contribution to the expansion…

Quantitative Methods · Quantitative Biology 2015-06-04 S. Stramaglia , Guo-Rong Wu , M. Pellicoro , D. Marinazzo

We propose a unified theoretical framework for quantifying spatio-temporal interactions in a stochastic dynamical system based on information geometry. In the proposed framework, the degree of interactions is quantified by the divergence…

Neurons and Cognition · Quantitative Biology 2016-12-08 Masafumi Oizumi , Naotsugu Tsuchiya , Shun-ichi Amari

Maximum entropy principle identifies forces conjugated to observables and the thermodynamic relations between them, independent upon their underlying mechanistic details. For data about state distributions or transition statistics, the…

Statistical Mechanics · Physics 2023-12-08 Ying-Jen Yang , Hong Qian

What is information? Is it physical? We argue that in a Bayesian theory the notion of information must be defined in terms of its effects on the beliefs of rational agents. Information is whatever constrains rational beliefs and therefore…

Data Analysis, Statistics and Probability · Physics 2016-09-08 Ariel Caticha

Using the integral transformation, the field-theoretical Hamiltonian of the statistical field theory of fluids is obtained, along with the microscopic expressions for the coefficients of the Hamiltonian. Applying this approach to the…

Statistical Mechanics · Physics 2020-05-06 Nikolai V. Brilliantov , J. Miguel Rubi , Yury A. Budkov

We propose a new perspective on Turbulence using Information Theory. We compute the entropy rate of a turbulent velocity signal and we particularly focus on its dependence on the scale. We first report how the entropy rate is able to…

Statistical Mechanics · Physics 2016-11-03 Carlos Granero-Belinchon , Stephane G. Roux , Nicolas B. Garnier

We study the informational underpinnings of thermodynamics and statistical mechanics, using an abstract framework, general probabilistic theories, capable of describing arbitrary physical theories. This allows one to abstract the…

Quantum Physics · Physics 2019-01-25 Carlo Maria Scandolo

The inverse problem of statistical mechanics is an unsolved, century-old challenge to learn classical pair potentials directly from experimental scattering data. This problem was extensively investigated in the 20th century but was…

Statistical Mechanics · Physics 2024-12-18 Brennon L. Shanks , Harry W. Sullivan , Michael P. Hoepfner

Force matching is an established technique to generate effective potentials for molecular dynamics simulations from first-principles data. This method has been implemented in the open source code potfit. Here, we present a review of the…

Information theory, though originally developed for communications engineering, provides mathematical tools with broad applications across science. These tools characterize the fundamental limits of data compression and transmission in the…

Information Theory · Computer Science 2026-03-09 Henry Pinkard , Laura Waller

Maximization of the entropy rate is an important issue to design diffusion processes aiming at a well-mixed state. We demonstrate that it is possible to construct maximal-entropy random walks with only local information on the graph…

Statistical Mechanics · Physics 2011-03-14 Roberta Sinatra , Jesús Gómez-Gardeñes , Renaud Lambiotte , Vincenzo Nicosia , Vito Latora

Information field theory (IFT) is an emerging technique for posing infinite-dimensional inverse problems using the mathematics found in quantum field theory. Under IFT, the field inference task is formulated in a Bayesian setting where the…

Mathematical Physics · Physics 2025-05-27 Alex Alberts , Ilias Bilionis