English
Related papers

Related papers: Properties of Minimizing Entropy

200 papers

The cross entropy loss is widely used due to its effectiveness and solid theoretical grounding. However, as training progresses, the loss tends to focus on hard to classify samples, which may prevent the network from obtaining gains in…

Machine Learning · Computer Science 2021-09-14 Barak Battash , Lior Wolf , Tamir Hazan

This paper studies the notion of computational entropy. Using techniques from convex optimization, we investigate the following problems: (a) Can we derandomize the computational entropy? More precisely, for the computational entropy, what…

Information Theory · Computer Science 2013-05-17 Maciej Skórski

Minimization of the (regularized) entropy of classification probabilities is a versatile class of discriminative clustering methods. The classification probabilities are usually defined through the use of some classical losses from…

Statistics Theory · Mathematics 2021-12-17 Edouard Genetay , Adrien Saumard , Rémi Coulaud

This paper develops a new divergence that generalizes relative entropy and can be used to compare probability measures without a requirement of absolute continuity. We establish properties of the divergence, and in particular derive and…

Probability · Mathematics 2019-11-19 Paul Dupuis , Yixiang Mao

We study the problem of identifying the causal relationship between two discrete random variables from observational data. We recently proposed a novel framework called entropic causality that works in a very general functional model but…

Information Theory · Computer Science 2017-01-31 Murat Kocaoglu , Alexandros G. Dimakis , Sriram Vishwanath , Babak Hassibi

Many quantum information measures can be written as an optimization of the quantum relative entropy between sets of states. For example, the relative entropy of entanglement of a state is the minimum relative entropy to the set of separable…

Quantum Physics · Physics 2018-08-09 Hamza Fawzi , Omar Fawzi

We apply a common measure of randomness, the entropy, in the context of iterated functions on a finite set with n elements. For a permutation, it turns out that this entropy is asymptotically (for a growing number of iterations) close to…

Number Theory · Mathematics 2017-12-20 Joachim von zur Gathen

The relationship between three probability distributions and their maximizable entropy forms is discussed without postulating entropy property. For this purpose, the entropy I is defined as a measure of uncertainty of the probability…

Statistical Mechanics · Physics 2020-10-28 Qiuping A. Wang

The paper describes an approach to measuring convergence of an algorithm to its result in terms of an entropy-like function of partitions of its inputs of a given length. The goal is to look at the algorithmic data processing from the…

Computational Complexity · Computer Science 2016-05-06 Anatol Slissenko

This work is an enquiry into the circumstances under which entropy methods can give an answer to the questions of both quantum separability and classical correlations of a composite state. Several entropy functionals are employed to examine…

Quantum Physics · Physics 2009-11-07 A. K. Rajagopal , R. W. Rendell

Conformal Prediction (CP) is a powerful framework for constructing prediction sets with guaranteed coverage. However, recent studies have shown that integrating confidence calibration with CP can lead to a degradation in efficiency. In this…

Machine Learning · Computer Science 2024-07-25 Rui Luo , Nicolo Colombo

Comparison-based algorithms are algorithms for which the execution of each operation is solely based on the outcome of a series of comparisons between elements. Comparison-based computations can be naturally represented via the following…

Data Structures and Algorithms · Computer Science 2020-11-17 Michel Schellekens

Cardinality matching is a computational method for finding the largest possible number of matched pairs of exposed and unexposed individuals from an observational dataset, with specified patterns of baseline characteristics that represent a…

Methodology · Statistics 2022-02-17 Bijan A. Niknam , Jose R. Zubizarreta

Compact expressions for the average subentropy and coherence are obtained for random mixed states that are generated via various probability measures. Surprisingly, our results show that the average subentropy of random mixed states…

Quantum Physics · Physics 2017-02-08 Lin Zhang , Uttam Singh , Arun Kumar Pati

Within the task of collaborative filtering two challenges for computing conditional probabilities exist. First, the amount of training data available is typically sparse with respect to the size of the domain. Thus, support for higher-order…

Information Retrieval · Computer Science 2012-07-19 Lawrence Zitnick , Takeo Kanade

Entropy is the measure of uncertainty in any data and is adopted for maximisation of mutual information in many remote sensing operations. The availability of wide entropy variations motivated us for an investigation over the suitability…

Computer Vision and Pattern Recognition · Computer Science 2014-05-26 S. K. Katiyar , P. V. Arun

Entropy measures of probability distributions are widely used measures in ecology, biology, genetics, and in other fields, to quantify species diversity of a community. Unfortunately, entropy-based diversity indices, or diversity indices…

Populations and Evolution · Quantitative Biology 2014-08-14 Karim T. Abou-Moustafa

The metric complexity (sometimes called Leinster--Cobbold maximum diversity) of a compact metric space is a recently introduced isometry-invariant of compact metric spaces which generalizes the notion of cardinality, and can be thought of…

Metric Geometry · Mathematics 2026-03-24 Gautam Aishwarya , Dongbin Li , Mokshay Madiman , Mark Meckes

The profile of a sample is the multiset of its symbol frequencies. We show that for samples of discrete distributions, profile entropy is a fundamental measure unifying the concepts of estimation, inference, and compression. Specifically,…

Machine Learning · Statistics 2020-02-27 Yi Hao , Alon Orlitsky

We introduce a novel entropy-related function, \textit{non-repeatability}, designed to capture dynamical behaviors in complex systems. Its normalized form, \textit{mutability}, has been previously applied in statistical physics as a…

Statistical Mechanics · Physics 2025-04-04 Eugenio E. Vogel , Francisco J. Peña , G. Saravia , P. Vargas