English
Related papers

Related papers: Information Value: Measuring Utterance Predictabil…

200 papers

Value-of-information analyses provide a straightforward means for selecting the best next observation to make, and for determining whether it is better to gather additional information or to act immediately. Determining the next best test…

Artificial Intelligence · Computer Science 2015-05-19 David Heckerman , Eric J. Horvitz , Blackford Middleton

Conversational assistants are being progressively adopted by the general population. However, they are not capable of handling complicated information-seeking tasks that involve multiple turns of information exchange. Due to the limited…

Information Retrieval · Computer Science 2019-01-14 Chen Qu , Liu Yang , Bruce Croft , Yongfeng Zhang , Johanne R. Trippas , Minghui Qiu

Expressive reading, considered the defining attribute of oral reading fluency, comprises the prosodic realization of phrasing and prominence. In the context of evaluating oral reading, it helps to establish the speaker's comprehension of…

Computation and Language · Computer Science 2022-01-31 Kamini Sabu , Mithilesh Vaidya , Preeti Rao

We show that under mild assumptions, the total value of information to informed traders in the market can be measured by the covariance between price changes and order flow. This covariance captures noise trader losses, which equal informed…

General Finance · Quantitative Finance 2026-05-13 Ohad Kadan , Asaf Manela

Information theory provides a mathematical foundation to measure uncertainty in belief. Belief is represented by a probability distribution that captures our understanding of an outcome's plausibility. Information measures based on…

Information Theory · Computer Science 2020-01-17 Jed A. Duersch , Thomas A. Catanach

Capturing the interesting components of an image is a key aspect of image understanding. When a speaker annotates an image, selecting labels that are informative greatly depends on the prior knowledge of a prospective listener. Motivated by…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Lior Bracha , Gal Chechik

We present a propositional logic %which can be used to reason about the uncertainty of events, where the uncertainty is modeled by a set of probability measures assigning an interval of probability to each event. We give a sound and…

Artificial Intelligence · Computer Science 2007-05-23 Joseph Y. Halpern , Riccardo Pucella

In this paper we propose a framework characterizing information disorders as disputes of narratives. Such narratives present claims to readers, who must decide whether to accept the statements in the claims as facts. We point out that this…

Computers and Society · Computer Science 2021-08-31 Daniel Schwabe

We define {\em predictive information} $I_{\rm pred} (T)$ as the mutual information between the past and the future of a time series. Three qualitatively different behaviors are found in the limit of large observation times $T$: $I_{\rm…

Data Analysis, Statistics and Probability · Physics 2011-11-10 William Bialek , Ilya Nemenman , Naftali Tishby

Argumentation is a formalism allowing to reason with contradictory information by modeling arguments and their interactions. There are now an increasing number of gradual semantics and impact measures that have emerged to facilitate the…

Artificial Intelligence · Computer Science 2024-07-12 Caren Al Anaissy , Jérôme Delobelle , Srdjan Vesic , Bruno Yun

Little research has explored how information engagement (IE), the degree to which individuals interact with and use information in a manner that manifests cognitively, behaviorally, and affectively. This study explored the impact of…

Computation and Language · Computer Science 2023-05-18 Nimrod Dvir , Elaine Friedman , Suraj Commuri , Fan Yang , Jennifer Romano

It is part of our daily social-media experience that seemingly ordinary items (videos, news, publications, etc.) unexpectedly gain an enormous amount of attention. Here we investigate how unexpected these events are. We propose a method…

Physics and Society · Physics 2014-12-09 José M. Miotto , Eduardo G. Altmann

Interpretability is a pressing issue for machine learning. Common approaches to interpretable machine learning constrain interactions between features of the input, rendering the effects of those features on a model's output comprehensible…

Machine Learning · Computer Science 2023-05-11 Kieran A. Murphy , Dani S. Bassett

Information and uncertainty are closely related and extensively studied concepts in a number of scientific disciplines such as communication theory, probability theory, and statistics. Increasing the information arguably reduces the…

Probability · Mathematics 2011-08-09 Jiahua Chen

Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying…

Neurons and Cognition · Quantitative Biology 2015-01-09 Simon R. Schultz , Robin A. A. Ince , Stefano Panzeri

Markov decision processes are widely used for planning and verification in settings that combine controllable or adversarial choices with probabilistic behaviour. The standard analysis algorithm, value iteration, only provides a lower bound…

Logic in Computer Science · Computer Science 2019-10-21 Arnd Hartmanns , Benjamin Lucien Kaminski

Information theory is built on probability measures and by definition a probability measure has total mass 1. Probability measures are used to model uncertainty, and one may ask how important it is that the total mass is one. We claim that…

Information Theory · Computer Science 2022-02-08 Peter Harremoës

Automatic readability assessment plays a key role in ensuring effective and accessible written communication. Despite significant progress, the field is hindered by inconsistent definitions of readability and measurements that rely on…

Computation and Language · Computer Science 2025-10-20 Catarina G Belem , Parker Glenn , Alfy Samuel , Anoop Kumar , Daben Liu

We try to establish a unified information theoretic approach to learning and to explore some of its applications. First, we define {\em predictive information} as the mutual information between the past and the future of a time series,…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ilya Nemenman

A large body of work in psycholinguistics has focused on the idea that online language comprehension can be shallow or `good enough': given constraints on time or available computation, comprehenders may form interpretations of their input…

Computation and Language · Computer Science 2024-05-15 Jiaxuan Li , Richard Futrell