English
Related papers

Related papers: Reduced Perplexity: A simplified perspective on as…

200 papers

We calculate and analyze various entropy measures and their properties for selected probability distributions. The entropies considered include Shannon, R\'enyi, generalized R\'enyi, Tsallis, Sharma-Mittal, and modified Shannon entropy,…

Information Theory · Computer Science 2024-11-26 Iryna Bodnarchuk , Yuliya Mishura , Kostiantyn Ralchenko

Estimating the Shannon entropy of a discrete distribution from which we have only observed a small sample is challenging. Estimating other information-theoretic metrics, such as the Kullback-Leibler divergence between two sparsely sampled…

Data Analysis, Statistics and Probability · Physics 2023-02-24 Angelo Piga , Lluc Font-Pomarol , Marta Sales-Pardo , Roger Guimerà

Probability theory is fundamental for modeling uncertainty, with traditional probabilities being real and non-negative. Complex probability extends this concept by allowing complex-valued probabilities, opening new avenues for analysis in…

Information Theory · Computer Science 2025-03-07 Chan Li , Hejun Xu , Zhu Cao

In this paper we shall consider some famous means such as arithmetic, harmonic, geometric, root square mean, etc. Considering the difference of these means, we can establish. some inequalities among them. Interestingly, the difference of…

Information Theory · Computer Science 2011-03-29 Inder Jeet Taneja

Exploiting the geometric nature of statistical divergences, we devise a way to define associated induced uncertainty measures for discrete and finite probability distributions. We also report new uncertainty measures and discuss their…

Quantum Physics · Physics 2021-06-29 Gautam Sharma , Sk Sazim

Random geometric graphs (RGGs) are commonly used to model networked systems that depend on the underlying spatial embedding. We concern ourselves with the probability distribution of an RGG, which is crucial for studying its random…

Information Theory · Computer Science 2018-01-16 Mihai-Alin Badiu , Justin P. Coon

Statistical evaluation aims to estimate the generalization performance of a model using held-out i.i.d.\ test data sampled from the ground-truth distribution. In supervised learning settings such as classification, performance metrics such…

Machine Learning · Computer Science 2026-04-08 Shashaank Aiyer , Yishay Mansour , Shay Moran , Han Shao

In this paper, I expand Shannon's definition of entropy into a new form of entropy that allows integration of information from different random events. Shannon's notion of entropy is a special case of my more general definition of entropy.…

Machine Learning · Computer Science 2008-11-04 Stefan Jaeger

There are numerous characterizations of Shannon entropy and Tsallis entropy as measures of information obeying certain properties. Using work by Faddeev and Furuichi, we derive a very simple characterization. Instead of focusing on the…

Information Theory · Computer Science 2017-08-22 John C. Baez , Tobias Fritz , Tom Leinster

Lifted probabilistic inference algorithms have been successfully applied to a large number of symmetric graphical models. Unfortunately, the majority of real-world graphical models is asymmetric. This is even the case for relational…

Artificial Intelligence · Computer Science 2014-12-02 Guy Van den Broeck , Mathias Niepert

Probability metrics have become an indispensable part of modern statistics and machine learning, and they play a quintessential role in various applications, including statistical hypothesis testing and generative modeling. However, in a…

Machine Learning · Statistics 2020-03-02 Soheil Kolouri , Kimia Nadjahi , Umut Simsekli , Shahin Shahrampour

Interpretability is central to trustworthy machine learning, yet existing metrics rarely quantify how effectively data support an interpretive representation. We propose Interpretive Efficiency, a normalized, task-aware functional that…

Machine Learning · Computer Science 2025-12-09 Ronald Katende

This paper explores generalised probabilistic modelling and uncertainty estimation in comparative LLM-as-a-judge frameworks. We show that existing Product-of-Experts methods are specific cases of a broader framework, enabling diverse…

Artificial Intelligence · Computer Science 2025-05-22 Yassir Fathullah , Mark J. F. Gales

The problem of searching for a model-based scene interpretation is analyzed within a probabilistic framework. Object models are formulated as generative models for range data of the scene. A new statistical criterion, the truncated object…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Ulrich Hillenbrand , Gerd Hirzinger

Techniques for understanding the functioning of complex machine learning models are becoming increasingly popular, not only to improve the validation process, but also to extract new insights about the data via exploratory analysis. Though…

Machine Learning · Statistics 2018-11-02 Jayaraman J. Thiagarajan , Irene Kim , Rushil Anirudh , Peer-Timo Bremer

Finite frames can be viewed as mass points distributed in $N$-dimensional Euclidean space. As such they form a subclass of a larger and rich class of probability measures that we call probabilistic frames. We derive the basic properties of…

Probability · Mathematics 2017-09-04 Martin Ehler , Kasso A. Okoudjou

We consider the task of forecasting an infinite sequence of future observations based on some number of past observations, where the probability measure generating the observations is "suspected" to satisfy one or more of a set of…

Machine Learning · Computer Science 2019-05-17 Vanessa Kosoy

This paper addresses a significant gap in explainable AI: the necessity of interpreting epistemic uncertainty in model explanations. Although current methods mainly focus on explaining predictions, with some including uncertainty, they fail…

Artificial Intelligence · Computer Science 2024-10-10 Helena Löfström , Tuwe Löfström , Johan Hallberg Szabadvary

A comprehensive convergence and stability analysis of some probabilistic numerical methods designed to solve Cauchy-type inverse problems is performed in this study. Such inverse problems aim at solving an elliptic partial differential…

Numerical Analysis · Mathematics 2025-08-12 Iulian Cîmpean , Andreea Grecu , Liviu Marin

We introduce a generalization of classic information-theoretic measures of predictive uncertainty in online language processing, based on the simulation of expected continuations of incremental linguistic contexts. Our framework provides a…

Computation and Language · Computer Science 2024-10-15 Mario Giulianelli , Andreas Opedal , Ryan Cotterell