English
Related papers

Related papers: Local Intrinsic Dimensional Entropy

200 papers

The sequence of entropy numbers quantifies the degree of compactness of a linear operator acting between quasi-Banach spaces. We determine the asymptotic behavior of entropy numbers in the case of natural embeddings between…

Functional Analysis · Mathematics 2025-08-25 Joscha Prochno , Mathias Sonnleitner , Jan Vybíral

Transfer entropy, an information-theoretic measure of time-directed information transfer between joint processes, has steadily gained popularity in the analysis of complex stochastic dynamics in diverse fields, including the neurosciences,…

Applications · Statistics 2015-06-05 Lionel Barnett , Terry Bossomaier

Within the context of representation learning for Earth observation, geographic Implicit Neural Representations (INRs) embed low-dimensional location inputs (longitude, latitude) into high-dimensional embeddings, through models trained on…

Machine Learning · Computer Science 2026-03-03 Arjun Rao , Marc Rußwurm , Konstantin Klemmer , Esther Rolf

Bayesian optimal experimental design provides a principled framework for selecting experimental settings that maximize obtained information. In this work, we focus on estimating the expected information gain in the setting where the…

Machine Learning · Statistics 2025-10-02 Chuntao Chen , Tapio Helin , Nuutti Hyvönen , Yuya Suzuki

An axiomatic foundation regarding the entropy for complex systems is established. Missing from decades of research was the requirement that entropy must measure the uncertainty at the informational scale of the maximizing distribution,…

Statistical Mechanics · Physics 2026-05-29 Kenric P. Nelson

Quantum many-body states that frequently appear in physics often obey an entropy scaling law, meaning that an entanglement entropy of a subsystem can be expressed as a sum of terms that scale linearly with its volume and area, plus a…

Quantum Physics · Physics 2021-05-26 Isaac H. Kim

We present a measure of local information transfer, derived from an existing averaged information-theoretical measure, namely transfer entropy. Local transfer entropy is used to produce profiles of the information transfer into each…

Cellular Automata and Lattice Gases · Physics 2008-09-22 Joseph T. Lizier , Mikhail Prokopenko , Albert Y. Zomaya

Imitation learning holds the promise of equipping robots with versatile skills by learning from expert demonstrations. However, policies trained on finite datasets often struggle to generalize beyond the training distribution. In this work,…

Machine Learning · Computer Science 2025-04-28 Yixiao Wang

Entropy and its various generalizations are important in many fields, including mathematical statistics, communication theory, physics and computer science, for characterizing the amount of information associated with a probability…

Statistics Theory · Mathematics 2021-06-02 Mehmet Siddik Cadirci , Dafydd Evans , Nikolai Leonenko , Oleg Seleznjev

The thermodynamic definition of entropy can be extended to nonequilibrium systems based on its relation to information. To apply this definition in practice requires access to the physical system's microstates, which may be prohibitively…

Statistical Mechanics · Physics 2020-08-21 Gil Ariel , Haim Diamant

We consider distributions of ordered random vectors with given one-dimensional marginal distributions. We give an elementary necessary and sufficient condition for the existence of such a distribution with finite entropy. In this case, we…

Statistics Theory · Mathematics 2015-09-08 Cristina Butucea , Jean-François Delmas , Anne Dutfoy , Richard Fischer

There are many open questions pertaining to the statistical analysis of random objects, which are increasingly encountered. A major challenge is the absence of linear operations in such spaces. A basic statistical task is to quantify…

Methodology · Statistics 2025-08-01 Wookyeong Song , Hans-Georg Müller

In this work we study the quality of low-dimensional embeddings from an explicitly information-theoretic perspective. We begin by noting that classical evaluation metrics such as stress, rank-based neighborhood criteria, or Local Procrustes…

Machine Learning · Computer Science 2026-01-05 Sebastián Gutiérrez-Bernal , Hector Medel Cobaxin , Abiel Galindo González

We study properties of popular near-uniform (Dirichlet) priors for learning undersampled probability distributions on discrete nonmetric spaces and show that they lead to disastrous results. However, an Occam-style phase space argument…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ilya Nemenman , Fariel Shafee , William Bialek

The ratio between the probability that two distributions $R$ and $P$ give to points $x$ are known as importance weights or propensity scores and play a fundamental role in many different fields, most notably, statistics and machine…

Machine Learning · Computer Science 2021-03-11 Parikshit Gopalan , Omer Reingold , Vatsal Sharan , Udi Wieder

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible while constrained to match empirically estimated feature expectations. However, in many real-world…

Machine Learning · Computer Science 2022-08-16 Kenneth Bogert , Yikang Gui , Prashant Doshi

The quality of image encryption is commonly measured by the Shannon entropy over the ciphertext image. However, this measurement does not consider to the randomness of local image blocks and is inappropriate for scrambling based image…

Cryptography and Security · Computer Science 2016-11-27 Yue Wu , Joseph P. Noonan , Sos Agaian

This paper reconsiders common benchmarking approaches to nearest neighbor search. It is shown that the concept of local intrinsic dimensionality (LID) allows to choose query sets of a wide range of difficulty for real-world datasets.…

Information Retrieval · Computer Science 2019-07-18 Martin Aumüller , Matteo Ceccarello

Shannon's entropy is one of the building blocks of information theory and an essential aspect of Machine Learning methods (e.g., Random Forests). Yet, it is only finitely defined for distributions with fast decaying tails on a countable…

Statistics Theory · Mathematics 2022-05-25 Jialin Zhang , Jingyi Shi

We study the entanglement entropy of random partitions in one- and two-dimensional critical fermionic systems. In an infinite system we consider a finite, connected (hypercubic) domain of linear extent $L$, the points of which with…

Disordered Systems and Neural Networks · Physics 2022-02-18 Gergö Roósz , István A. Kovács , Ferenc Iglói
‹ Prev 1 8 9 10 Next ›