English
Related papers

Related papers: On information gain, Kullback-Leibler divergence, …

200 papers

Knowledge distillation is widely used to improve generalization in practice, yet its theoretical understanding remains elusive. In the standard distillation setting, a teacher model provides soft predictions to guide the training of a…

Information Theory · Computer Science 2026-05-18 Bingying Li , Haiyun He

Open world Machine Learning (OWML) aims to develop intelligent systems capable of recognizing known categories, rejecting unknown samples, and continually learning from novel information. Despite significant progress in open set…

Machine Learning · Statistics 2025-10-20 Lin Wang

In this paper, we develop a framework for information theoretic learning based on infinitely divisible matrices. We formulate an entropy-like functional on positive definite matrices based on Renyi's axiomatic definition of entropy and…

Machine Learning · Computer Science 2013-06-05 Luis G. Sanchez Giraldo , Jose C. Principe

The sample complexity of estimating or maximising an unknown function in a reproducing kernel Hilbert space is known to be linked to both the effective dimension and the information gain associated with the kernel. While the information…

Machine Learning · Statistics 2026-01-16 Hamish Flynn

Information generating functions have been used for generating various entropy and divergence measures. In the present work, we introduce quantile based relative information generating function and study its properties. The proposed…

Statistics Theory · Mathematics 2024-12-04 Sankaran P. G. , Sunoj S. M. , Pavithra Hariharan

According to E.T. Jaynes and E.P. Wigner, entropy is an anthropomorphic concept in the sense that in a physical system correspond many thermodynamic systems. The physical system can be examined from many points of view each time examining…

Information Theory · Computer Science 2015-12-03 Panteleimon Rodis

Experimental designs are tools which can drastically reduce the number of simulations required by time-consuming computer codes. One strategy for selecting the values of the inputs, whose response is to be observed, is to choose these…

Statistics Theory · Mathematics 2009-04-17 Astrid Jourdan , Jessica Franco

R\'enyi divergence is related to R\'enyi entropy much like information divergence (also called Kullback-Leibler divergence or relative entropy) is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as…

Information Theory · Computer Science 2010-05-28 Tim van Erven , Peter Harremoës

Kernel methods form a theoretically-grounded, powerful and versatile framework to solve nonlinear problems in signal processing and machine learning. The standard approach relies on the \emph{kernel trick} to perform pairwise evaluations of…

Machine Learning · Computer Science 2020-01-03 Kan Li , Jose C. Principe

Bayesian networks (BNs) are a foundational model in machine learning and causal inference. Their graphical structure can handle high-dimensional problems, divide them into a sparse collection of smaller ones, underlies Judea Pearl's…

Artificial Intelligence · Computer Science 2024-01-17 Marco Scutari

Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizations of Shannon entropy, motivated by the study of…

Data Analysis, Statistics and Probability · Physics 2026-04-20 Andrea Somazzi , Diego Garlaschelli

A well-known technique in estimating probabilities of rare events in general and in information theory in particular (used, e.g., in the sphere-packing bound), is that of finding a reference probability measure under which the event of…

Information Theory · Computer Science 2014-12-23 Rami Atar , Neri Merhav

A measurement performed on a quantum system is an act of gaining information about its state, a view that is widespread in practical and foundational work in quantum theory. However, the concept of information in quantum theory…

Quantum Physics · Physics 2025-12-23 Yang Yu , Philip Goyal

Gathering the most information by picking the least amount of data is a common task in experimental design or when exploring an unknown environment in reinforcement learning and robotics. A widely used measure for quantifying the…

Machine Learning · Statistics 2015-09-17 Johannes Kulick , Robert Lieck , Marc Toussaint

The Kullback-Leibler (KL) divergence is a foundational measure for comparing probability distributions. Yet in multivariate settings, its single value often obscures the underlying reasons for divergence, conflating mismatches in individual…

Other Computer Science · Computer Science 2025-05-06 William Cook

We introduce hardness in relative entropy, a new notion of hardness for search problems which on the one hand is satisfied by all one-way functions and on the other hand implies both next-block pseudoentropy and inaccessible entropy, two…

Cryptography and Security · Computer Science 2024-11-15 Rohit Agrawal , Yi-Hsiu Chen , Thibaut Horel , Salil Vadhan

Convergence properties of Shannon Entropy are studied. In the differential setting, it is shown that weak convergence of probability measures, or convergence in distribution, is not enough for convergence of the associated differential…

Information Theory · Computer Science 2016-11-18 Francisco J. Piera , Patricio Parada

Information geometry provides differential geometric concepts like a Riemannian metric, connections and covariant derivatives on spaces of probability distributions. We discuss here how these concepts apply to quantum field theories in the…

High Energy Physics - Theory · Physics 2023-04-11 Stefan Floerchinger

Here, we investigate the uncertainty of dynamical observables in classical systems manipulated by repeated measurements and feedback control; the precision should be enhanced in the presence of an external controller but limited by the…

Statistical Mechanics · Physics 2020-01-23 Tan Van Vu , Yoshihiko Hasegawa

The Kullback-Leibler inequality is a way of comparing any two density matrices. A technique to set up the density matrix for a physical system is to use the maximum entropy principle, given the entropy as a functional of the density matrix,…

Statistical Mechanics · Physics 2009-11-07 A. K. Rajagopal , R. W. Rendell , Sumiyoshi Abe