Related papers: A brief tutorial on information theory
This review presents recent and older results on elementary quantitative and qualitative aspects of consciousness and cognition and tackles the question "What is consciousness?" conjointly from biological, neuroscience-cognitive, physical…
The authors discuss information-based complexity theory, which is a model of finite-precision computations with real numbers, and its applications to numerical analysis.
These lecture notes accompany a one-semester graduate course on information and learning in economic theory. Topics include common knowledge, Bayesian updating, monotone-likelihood ratio properties, affiliation, the Blackwell order, cost of…
The article considers the methodical aspects of informatization of physical education at a higher education institution. Besides, the article discloses the conception of the information educational environment and information technologies…
In the theoretical modelling of a physical system a crucial step consists in the identification of those degrees of freedom that enable a synthetic, yet informative representation of it. While in some cases this selection can be carried out…
Quantum Information Processing is usually taught as an elective in the master's degree in physics. We argue that a basic understanding of Quantum Information Processing can already be achieved by high school juniors and seniors. Moreover,…
Turbulence theory is usually concerned with the statistical moments of the velocity or its fluctuations. One could also analyze the implicit probability distributions. This is the purview of information theory. Here we use information…
Information retrieval has long focused on ranking documents by semantic relatedness. Yet many real-world information needs demand more: enforcement of logical constraints, multi-step inference, and synthesis of multiple pieces of evidence.…
The main goal of this paper is to give a pedagogical introduction to Quantum Information Theory-to do this in a new way, using network diagrams called Quantum Bayesian Nets. A lesser goal of the paper is to propose a few new ideas, such as…
These lecture notes concern information-theoretic notions of entropy. They are intended for, and have been successfully taught to, undergraduate students interested inresearch careers. Besides basic notions of analysis related to…
Theory and empirical science should be in constant dialogue, but often find it hard to understand one another. Here we describe a graduate-level university course we developed to improve matters. The course was designed to help…
This resource letter intends to provide physics instructors - particularly graduate student teaching assistants - at the introductory university level with a small but representative collection of resources to acquire a familiarity with…
This is a set of lectures that I presented at the Les Houches 2014 Summer School "Topological Aspects in Condensed Matter Physics". The lectures are an introduction to physics of proteins. To physicists, and by a physicist. My lectures at…
This article consists of a very short introduction to classical and quantum information theory. Basic properties of the classical Shannon entropy and the quantum von Neumann entropy are described, along with related concepts such as…
Even today, the concept of entropy is perceived by many as quite obscure. The main difficulty is analyzed as being fundamentally due to the subjectivity and anthropocentrism of the concept that prevent us to have a sufficient distance to…
These expanded lecture notes are based on a tutorial on categorical proof theory presented at the summer school associated with the conference "Topology, Algebra, and Categories in Logic 2021-2022." The chapter delves into various…
Integrated Information Theory is one of the leading models of consciousness. It aims to describe both the quality and quantity of the conscious experience of a physical system, such as the brain, in a particular state. In this contribution,…
Students in introductory calculus-based physics not only have difficulty understanding the fundamental physical concepts, they often have difficulty relating those concepts to the mathematics they have learned in math courses. This produces…
Is our world just information? We argue that our current notion of information has one serious shortcoming: It is quite literally meaningless. We suggest a meaningful extension of the notion of information that is dynamic, internal,…
This work outlines the novel application of the empirical analysis of causation, presented by Kutach, to the study of information theory and its role in physics. The central thesis of this paper is that causation and information are…