English
Related papers

Related papers: Foundations of Information Theory

200 papers

A formal model of the structure of information is presented in five axioms which define identity, containment, and joins of infons. Joins are shown to be commutative, associative, provide inverses of infons, and, potentially, have many…

Logic in Computer Science · Computer Science 2007-05-23 Bruce Long

This work is a discussion on the concept of information. We define here information as an abstraction that is able to be copied. We consider the connection between the process of copying information in quantum systems and the emergence of…

Quantum Physics · Physics 2012-02-10 Marcin Ostrowski

In the contemporary era, the importance of information is undisputed, but there has never been a common understanding of information, nor a unanimous conclusion to the researches on information metrics. Based on the previous studies, this…

Information Theory · Computer Science 2014-04-07 Xu Jianfeng , Tang Jun , Ma Xuefeng , Xu Bin , Shen Yanli , Qiao Yongjie

Quantum information theory represents a rich subject of discussion for those interested in the philosphical and foundational issues surrounding quantum mechanics for a simple reason: one can cast its central concerns in terms of a…

Quantum Physics · Physics 2007-05-23 Christopher G Timpson

Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying…

Neurons and Cognition · Quantitative Biology 2015-01-09 Robin A. A. Ince , Simon R. Schultz , Stefano Panzeri

Quantum theory can be derived from purely informational principles. Five elementary axioms-causality, perfect distinguishability, ideal compression, local distinguishability, and pure conditioning-define a broad class of theories of…

Quantum Physics · Physics 2015-03-17 G. Chiribella , G. M. D'Ariano , P. Perinotti

Despite the wide usage of information as a concept in science, we have yet to develop a clear & concise scientific definition. This paper is aimed at laying the foundations for a new theory concerning the mechanics of information alongside…

General Physics · Physics 2017-07-13 Kiyam Lin , SongLing Lin

Quantum information theory is the study of the achievable limits of information processing within quantum mechanics. Many different types of information can be accommodated within quantum mechanics, including classical information, coherent…

Quantum Physics · Physics 2007-05-23 M. A. Nielsen

To capture the uncertainty of information or knowledge in information systems, various information granulations, also known as knowledge granulations, have been proposed. Recently, several axiomatic definitions of information granulation…

Artificial Intelligence · Computer Science 2009-08-28 Ping Zhu

Information theory is concerned with the study of transmission, processing, extraction, and utilization of information. In its most abstract form, information is conceived as a means of resolving uncertainty. Shannon and Weaver (1949) were…

Computers and Society · Computer Science 2021-12-08 Birgitta Dresp-Langley

What is information, physically, and why does it so reliably emerge in living, cultural, and technological systems? Existing theories quantify uncertainty, cost, or compressibility, but do not identify which physical structures count as…

Neurons and Cognition · Quantitative Biology 2025-12-17 Wouter van der Wijngaart

The basic idea behind information algebras is that information comes in pieces, each referring to a certain question, that these pieces can be combined or aggregated and that the part relating to a given question can be extracted. This…

Information Theory · Computer Science 2025-04-21 Juerg Kohlas

Integrated Information Theory is one of the leading models of consciousness. It aims to describe both the quality and quantity of the conscious experience of a physical system, such as the brain, in a particular state. In this contribution,…

Neurons and Cognition · Quantitative Biology 2020-02-19 Johannes Kleiner , Sean Tull

The logical basis for information theory is the newly developed logic of partitions that is dual to the usual Boolean logic of subsets. The key concept is a "distinction" of a partition, an ordered pair of elements in distinct blocks of the…

Information Theory · Computer Science 2013-01-29 David Ellerman

Information Theory concepts and methodologies conform the background of how communication systems are studied and understood. They are mainly focused on the source-channel-receiver problem and on the asymptotic limits of accuracy and…

Adaptation and Self-Organizing Systems · Physics 2017-05-16 Nicolás Rubido , Celso Grebogi , Murilo S. Baptista

Information theory, though originally developed for communications engineering, provides mathematical tools with broad applications across science. These tools characterize the fundamental limits of data compression and transmission in the…

Information Theory · Computer Science 2026-03-09 Henry Pinkard , Laura Waller

This article is a brief guide to the field of algorithmic information theory (AIT), its underlying philosophy, and the most important concepts. AIT arises by mixing information theory and computation theory to obtain an objective and…

Information Theory · Computer Science 2009-09-29 Marcus Hutter

Resource theories play an important role in quantum information theory, as they identify resourceful states and channels that are potentially useful for the accomplishment of tasks that would be otherwise unreachable. The elementary…

Quantum Physics · Physics 2020-09-02 A. C. S. Costa , R. M. Angelo

To truly eliminate Cartesian ghosts from the science of consciousness, we must describe consciousness as an aspect of the physical. Integrated Information Theory states that consciousness arises from intrinsic information generated by…

Other Quantitative Biology · Quantitative Biology 2014-07-18 Adam B. Barrett

Information theory is a statistical theory concerned with the relative state of detectors and physical systems. As a consequence, the classical framework of Shannon needs to be extended to deal with quantum detectors, possibly moving at…

Quantum Physics · Physics 2007-05-23 Christoph Adami