Related papers: Kolmogorov--Nagumo Mean Frameworks for Conditional…
Neural processes are meta-learning models that map context sets to predictive distributions. While inspired by stochastic processes, NPs do not generally satisfy the Kolmogorov consistency conditions required to define a valid stochastic…
The new estimates of the conditional Shannon entropy are introduced in the framework of the model describing a discrete response variable depending on a vector of d factors having a density w.r.t. the Lebesgue measure in R^d. Namely, the…
We derive a general approximate solution to the problem of minimizing the conditional entropy of a qudit-qubit system resulting from a local projective measurement on the qubit, which is valid for general entropic forms and becomes exact in…
In this article, we generalize a proof technique by Alicki, Fannes and Winter and introduce a method to prove continuity bounds for entropic quantities derived from different quantum relative entropies. For the Umegaki relative entropy, we…
Uncertainties in successive measurements of general canonically conjugate variables are examined. Such operators are approached within a limiting procedure of the Pegg-Barnett type. Dealing with unbounded observables, we should take into…
Machine learning models must continuously self-adjust themselves for novel data distribution in the open world. As the predominant principle, entropy minimization (EM) has been proven to be a simple yet effective cornerstone in existing…
A generalized mass-to-horizon entropy has recently been proposed as an extension of the Bekenstein-Hawking area law, derived from a modified mass-horizon relation constructed to ensure consistency with the Clausius equation. Within the…
We present full generalisations of entropic security and entropic indistinguishability to the quantum world where no assumption but a limit on the knowledge of the adversary is made. This limit is quantified using the quantum conditional…
A principle of maximum entropy is proposed in the context of viscous incompressible flow in Eulerian coordinates. The relative entropy functional, defined over the space of $L^2$ divergence-free velocity fields, is maximized relative to…
The characterization of irreversibility in general quantum processes is an open problem of increasing techno- logical relevance. Yet, the tools currently available to this aim are mostly limited to the assessment of dynamics induced by…
Kolmogorov-Arnold Network (KAN) is a network structure recently proposed by Liu et al. (2024) that offers improved interpretability and a more parsimonious design in many science-oriented tasks compared to multi-layer perceptrons. This work…
We study a parametric estimation problem related to moment condition models. As an alternative to the generalized empirical likelihood (GEL) and the generalized method of moments (GMM), a Bayesian approach to the problem can be adopted,…
The existing upper and lower bounds between entropy and error probability are mostly derived from the inequality of the entropy relations, which could introduce approximations into the analysis. We derive analytical bounds based on the…
Ensemble of initial conditions for nonlinear maps can be described in terms of entropy. This ensemble entropy shows an asymptotic linear growth with rate K. The rate K matches the logarithm of the corresponding asymptotic sensitivity to…
The ellipsoidal BGK model (ES-BGK) is a generalized version of the BGK model of the Boltzmann equation designed to yield the correct Prandtl number in the Navier-Stokes limit. In this paper, we make two observations on the entropy…
Estimating the entropy of a discrete random variable is a fundamental problem in information theory and related fields. This problem has many applications in various domains, including machine learning, statistics and data compression. Over…
We establish the existence and compactness of global martingale entropy solutions with finite relative-energy for the stochastically forced system of isentropic Euler equations governed by a general pressure law. To achieve these, a…
The thermal-equilibrium canonical distribution is currently obtained by maximizing the Boltzmann-Gibbs-von Neumann-Shannon entropy $S_{BG}(p)=k\sum^{W}_{i=1}p_{i}\ln 1/p_{i}$ constrained to $\sum^{W}_{i=1}p_{i}=1$ and…
We investigate the generation of the baryon asymmetry within the cosmological framework based on a generalized mass-to-horizon entropy. This entropy, recently proposed as a power-law extension of the Bekenstein-Hawking area law, arises from…
A set of sufficient conditions for the generalized covariant entropy bound given by Strominger and Thompson is as follows: Suppose that the entropy of matter can be described by an entropy current $s^a$. Let $k^a$ be any null vector along…