Related papers: The Entropy Method in Large Deviation Theory
Large deviation functions are an essential tool in the statistics of rare events. Often they can be obtained by contraction from a so-called level 2 large deviation {\em functional} characterizing the empirical density of the underlying…
The theory of large deviations constitutes a mathematical cornerstone in the foundations of Boltzmann-Gibbs statistical mechanics, based on the additive entropy $S_{BG}=- k_B\sum_{i=1}^W p_i \ln p_i$. Its optimization under appropriate…
A unified formulation of the density functional theory is constructed on the foundations of entropic inference in both the classical and the quantum regimes. The theory is introduced as an application of entropic inference for inhomogeneous…
Since its origin in the thermodynamics of the 19th century, the concept of entropy has also permeated other fields of physics and mathematics, such as Classical and Quantum Statistical Mechanics, Information Theory, Probability Theory,…
By using the maximum entropy principle with Tsallis entropy we obtain a fragment size distribution function which undergoes a transition to scaling. This distribution function reduces to those obtained by other authors using Shannon…
In this Thesis, several results in quantum information theory are collected, most of which use entropy as the main mathematical tool. *While a direct generalization of the Shannon entropy to density matrices, the von Neumann entropy behaves…
Computations of entropy in thermodynamics rely on discreteness of the spectra of the subsystems. We argue that, for cases with continuous spectra (typically, radiation), there is a useful definition of entropy flow based on discretizing the…
To quantify the complexity of a system, entropy-based methods have received considerable critical attentions in real-world data analysis. Among numerous entropy algorithms, amplitude-based formulas, represented by Sample Entropy, suffer…
We show that, in 't Hooft's large N limit, matrix models can be formulated as a classical theory whose equations of motion are the factorized Schwinger--Dyson equations. We discover an action principle for this classical theory. This action…
Replacing positivity constraints by an entropy barrier is popular to approximate solutions of linear programs. In the special case of the optimal transport problem, this technique dates back to the early work of Schr\"odinger. This approach…
Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical…
The paper suggests the concepts of an upper entropy and a lower entropy. We propose a new axiomatic definition, namely, upper entropy axioms, inspired by axioms of metric spaces, and also formulate lower entropy axioms. We also develop weak…
We study a one-dimensional elliptic problem with highly oscillatory random diffusion coefficient. We derive a homogenized solution and a so-called Gaussian corrector. We also prove a "pointwise" large deviation principle (LDP) for the full…
We identify various universal contributions to the entanglement entropy for massive free fields. As well as the `area' terms found in [1], we find other geometric contributions of the form discussed in [2]. We also compute analogous…
We establish the global existence of $L^\infty$ solutions for a model of polytropic gas flow with diffusive entropy. The result is obtained by showing the convergence of a class of finite difference schemes, which includes the…
$\textbf{Motivation:}$ Small $p$-values are often required to be accurately estimated in large-scale genomic studies for the adjustment of multiple hypothesis tests and the ranking of genomic features based on their statistical…
Entropy is a famous and well established concept in physics and engineering that can be used for explanation of basic fundamentals as well it finds applications in several areas, from quantum physics to astronomy, from network communication…
In this paper, we derive entropy estimates for a class of schemes for the Euler equations which present the following features: they are based on the internal energy equation (eventually with a positive corrective term at the righ-hand-side…
Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide…
Using the transfer matrix technique, we estimate the entropy for a gas of rods of sizes equal to k (named k-mers), which cover completely a square lattice. Our calculations were made considering three different constructions, using…