English
Related papers

Related papers: Information dynamics: Temporal behavior of uncerta…

200 papers

We study distributional similarity measures for the purpose of improving probability estimation for unseen cooccurrences. Our contributions are three-fold: an empirical comparison of a broad range of measures; a classification of similarity…

Computation and Language · Computer Science 2007-05-23 Lillian Lee

Information accounting provides a better foundation for hypothesis testing than does uncertainty quantification. A quantitative account of science is derived under this perspective that alleviates the need for epistemic bridge principles,…

Other Statistics · Statistics 2017-04-26 Grey Nearing , Hoshin Gupta

The study of intelligent systems explains behaviour in terms of economic rationality. This results in an optimization principle involving a function or utility, which states that the system will evolve until the configuration of maximum…

Information Theory · Computer Science 2024-06-18 Pedro Hack

In this paper we provide a flexible framework allowing for a unified study of time consistency of risk measures and performance measures (also known as acceptability indices). The proposed framework not only integrates existing forms of…

Probability · Mathematics 2017-09-08 Tomasz R. Bielecki , Igor Cialenco , Marcin Pitera

There is available an ever-increasing variety of procedures for managing uncertainty. These methods are discussed in the literature of artificial intelligence, as well as in the literature of philosophy of science. Heretofore these methods…

Artificial Intelligence · Computer Science 2013-01-30 Henry E. Kyburg , Choh Man Teng

Accurate comparisons between theoretical models and experimental data are critical for scientific progress. However, inferred physical model parameters can vary significantly with the chosen physics model, highlighting the importance of…

High Energy Physics - Phenomenology · Physics 2025-10-27 Sunil Jaiswal , Chun Shen , Richard J. Furnstahl , Ulrich Heinz , Matthew T. Pratola

Statistics is sometimes described as the science of reasoning under uncertainty. Statistical models provide one view of this uncertainty, but what is frequently neglected is the 'invisible' portion of uncertainty: that assumed not to exist…

Methodology · Statistics 2026-03-18 Oliver L. Pescott , Robin J. Boyd , Gary D. Powney , Gavin B. Stewart

Dynamical systems are frequently used to model biological systems. When these models are fit to data it is necessary to ascertain the uncertainty in the model fit. Here we present prediction deviation, a new metric of uncertainty that…

Applications · Statistics 2017-06-08 Benjamin Letham , Portia A. Letham , Cynthia Rudin , Edward P. Browne

Stochastic volatility models that treat the variance of a time series as a stochastic process have proven to be important tools for analyzing dynamic variability. Current methods for fitting and conducting inference on stochastic volatility…

Methodology · Statistics 2025-01-28 Gehui Zhang , Gong Tang , Lori Scott , Robert T Krafty

We introduce behavioral inequalities as a way to model dynamical systems defined by inequalities among their variables of interest. We claim that such a formulation enables the representation of safety-aware dynamical systems, systems with…

Systems and Control · Electrical Eng. & Systems 2025-04-03 Soutrik Bandyopadhyay , Debasattam Pal , Shubhendu Bhasin

In this paper we demonstrate the only available scalable information bounds for quantities of interest of high dimensional probabilistic models. Scalability of inequalities allows us to (a) obtain uncertainty quantification bounds for…

Information Theory · Computer Science 2017-04-05 Markos A. Katsoulakis , Luc Rey-Bellet , Jie Wang

In context-specific applications such as robotics, telecommunications, and healthcare, artificial intelligence systems often face the challenge of limited training data. This scarcity introduces epistemic uncertainty, i.e., reducible…

Information Theory · Computer Science 2026-03-17 Osvaldo Simeone , Yaniv Romano

A risk analyst assesses potential financial losses based on multiple sources of information. Often, the assessment does not only depend on the specification of the loss random variable but also various economic scenarios. Motivated by this…

Risk Management · Quantitative Finance 2023-10-02 Tolulope Fadina , Yang Liu , Ruodu Wang

Quantum information quantities, such as mutual information and entropies, are essential for characterizing quantum systems and protocols in quantum information science. In this contribution, we identify types of information measures based…

Quantum Physics · Physics 2025-10-21 Christopher Popp , Tobias C. Sutter , Beatrix C. Hiesmayr

In this work we give a comprehensive overview of the time consistency property of dynamic risk and performance measures, focusing on a the discrete time setup. The two key operational concepts used throughout are the notion of the…

Mathematical Finance · Quantitative Finance 2017-01-31 Tomasz R. Bielecki , Igor Cialenco , Marcin Pitera

Information decompositions quantify how the Shannon information about a given random variable is distributed among several other random variables. Various requirements have been proposed that such a decomposition should satisfy, leading to…

Information Theory · Computer Science 2023-07-11 Johannes Rauh , Pradeep Kr. Banerjee , Eckehard Olbrich , Guido Montúfar , Jürgen Jost

With improved measurement and modelling technology, variability has emerged as an essential feature in non-equilibrium processes. While traditionally, mean values and variance have been heavily used, they are not appropriate in describing…

Atmospheric and Oceanic Physics · Physics 2020-02-12 Eun-jin Kim , James Heseltine , Hanli Liu

These lectures deal with the problem of inductive inference, that is, the problem of reasoning under conditions of incomplete information. Is there a general method for handling uncertainty? Or, at least, are there rules that could in…

Data Analysis, Statistics and Probability · Physics 2016-09-08 Ariel Caticha

The ability to identify and resolve uncertainty is crucial for the robustness of a dialogue system. Indeed, this has been confirmed empirically on systems that utilise Bayesian approaches to dialogue belief tracking. However, such systems…

Computation and Language · Computer Science 2021-09-10 Carel van Niekerk , Andrey Malinin , Christian Geishauser , Michael Heck , Hsien-chin Lin , Nurul Lubis , Shutong Feng , Milica Gašić

In this work, the proofs concerning the continuity of the disequilibrium, Shannon information and statistical complexity in the space of distributions are presented. Also, some results on the existence of Shannon information for continuous…

Adaptation and Self-Organizing Systems · Physics 2010-02-22 Raquel G. Catalan , Jose Garay , Ricardo Lopez-Ruiz