English
Related papers

Related papers: Unnormalized Measures in Information Theory

200 papers

In quantum theory, it is known for a pair of noncommutative observables that there is no state on which they take simultaneously definite values, and that there is no joint measurement of them. They are called preparation uncertainty and…

Quantum Physics · Physics 2020-09-02 Ryo Takakura , Takayuki Miyadera

Randomness in scientific estimation is generally assumed to arise from unmeasured or uncontrolled factors. However, when combining subjective probability estimates, heterogeneity stemming from people's cognitive or information diversity is…

Methodology · Statistics 2015-09-14 Ville A. Satopää , Robin Pemantle , Lyle H. Ungar

The history based formalism known as Quantum Measure Theory (QMT) generalizes the concept of probability-measure so as to incorporate quantum interference. The resulting \textit{quantum measure} $\mu$ is defined for arbitrary events (sets…

Quantum Physics · Physics 2026-04-15 Sanchari Chakraborti , Rafael D. Sorkin , Urbasi Sinha

We introduce a new approach to modeling uncertainty based on plausibility measures. This approach is easily seen to generalize other approaches to modeling uncertainty, such as probability measures, belief functions, and possibility…

Artificial Intelligence · Computer Science 2016-08-31 Nir Friedman , Joseph Y. Halpern

A mathematical framework for information-theoretic analysis is established, with a new viewpoint of describing transmitted messages and communication channels by the nonlinear expectation theory, beyond the framework of classical…

Information Theory · Computer Science 2026-03-18 Wen-Xuan Lang , Shaoshi Yang , Jianhua Zhang , Zhiming Ma

The formalism of statistical mechanics can be generalized by starting from more general measures of information than the Shannon entropy and maximizing those subject to suitable constraints. We discuss some of the most important examples of…

Statistical Mechanics · Physics 2015-05-13 Christian Beck

The basic goal of quantization for probability distribution is to reduce the number of values, which is typically uncountable, describing a probability distribution to some finite set and thus approximation of a continuous probability…

Probability · Mathematics 2021-01-27 Mrinal Kanti Roychowdhury

Many quantum chemical similarity measures have been derived and substantiated by applying concepts and quantities from information theory to the electron density. To justify the use of information theory, the electron density is usually…

Chemical Physics · Physics 2024-10-14 Guillaume Acke , Daria Van Hende , Ruben Van der Stichelen , Patrick Bultinck

These lectures deal with the problem of inductive inference, that is, the problem of reasoning under conditions of incomplete information. Is there a general method for handling uncertainty? Or, at least, are there rules that could in…

Data Analysis, Statistics and Probability · Physics 2016-09-08 Ariel Caticha

In this paper, we introduce for the first time the notions of neutrosophic measure and neutrosophic integral, and we develop the 1995 notion of neutrosophic probability. We present many practical examples. It is possible to define the…

Artificial Intelligence · Computer Science 2013-12-02 Florentin Smarandache

Proper quantification of predictive uncertainty is essential for the use of machine learning in safety-critical applications. Various uncertainty measures have been proposed for this purpose, typically claiming superiority over other…

Machine Learning · Computer Science 2025-12-16 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

In physics we often use very simple models to describe systems with many degrees of freedom, but it is not clear why or how this success can be transferred to the more complex biological context. We consider models for the joint…

Neurons and Cognition · Quantitative Biology 2024-12-06 Luisa Ramirez , William Bialek , Stephanie E. Palmer , David J. Schwab

Statistical hypothesis testing is the central method to demarcate scientific theories in both exploratory and inferential analyses. However, whether this method befits such purpose remains a matter of debate. Established approaches to…

Data Analysis, Statistics and Probability · Physics 2024-10-29 Orestis Loukas , Ho-Ryun Chung

We introduce a class of information measures based on group entropies, allowing us to describe the information-theoretical properties of complex systems. These entropic measures are nonadditive, and are mathematically deduced from a series…

Statistical Mechanics · Physics 2019-10-21 Piergiulio Tempesta , Henrik Jeldtoft Jensen

Heisenberg's uncertainty principle is formulated for a set of generalized measurements within the framework of majorization theory, resulting in a partial uncertainty order on probability vectors that is stronger than those based on…

Quantum Physics · Physics 2012-10-26 M. Hossein Partovi

Normalisation in probability theory turns a subdistribution into a proper distribution. It is a partial operation, since it is undefined for the zero subdistribution. This partiality makes it hard to reason equationally about normalisation.…

Logic in Computer Science · Computer Science 2023-06-22 Bart Jacobs

A risk analyst assesses potential financial losses based on multiple sources of information. Often, the assessment does not only depend on the specification of the loss random variable but also various economic scenarios. Motivated by this…

Risk Management · Quantitative Finance 2023-10-02 Tolulope Fadina , Yang Liu , Ruodu Wang

The majorizing measure theorem of Fernique and Talagrand is a fundamental result in the theory of random processes. It relates the boundedness of random processes indexed by elements of a metric space to complexity measures arising from…

Information Theory · Computer Science 2023-05-09 Yifeng Chu , Maxim Raginsky

The concept of complexity appears in virtually all areas of knowledge. Its intuitive meaning shares similarities across fields, but disagreements between its details hinders a general definition, leading to a plethora of proposed…

Statistical Mechanics · Physics 2023-10-04 Roberto C. Alamino

We show that the natural scaling of measurement for a particular problem defines the most likely probability distribution of observations taken from that measurement scale. Our approach extends the method of maximum entropy to use…

Quantitative Methods · Quantitative Biology 2010-03-02 Steven A. Frank , D. Eric Smith