Related papers: A brief tutorial on information theory
This is an expanded and revised text for a fifteen minute talk given at the University of Queensland Physics Camp, September 2000. The focus is on the goals and motivations for studying quantum information theory, rather than on technical…
In this thesis I present a short review of ideas in quantum information theory. The first chapter contains introductory material, sketching the central ideas of probability and information theory. Quantum mechanics is presented at the level…
This document consists of lecture notes for a graduate course, which focuses on the relations between Information Theory and Statistical Physics. The course is aimed at EE graduate students in the area of Communications and Information…
We present a concise introduction of basic concepts in quantum information theory and quantum mechanics prepared as an introduction for a general audience. In our approach the rules of quantum mechanics are presented in a simple form of…
Information is the basic concept of information theory. However, there is no definition of this concept that can encompass all uses of the term information in information theories and beyond. Many question a possibility of such a…
These lecture notes provide an introduction to quantum information and quantum computation, which are strongly related disciplines and subject of intense research. The lecture notes contain only a small selection of topics in these…
Information theory, though originally developed for communications engineering, provides mathematical tools with broad applications across science. These tools characterize the fundamental limits of data compression and transmission in the…
Shannon's mathematical theory of communication defines fundamental limits on how much information can be transmitted between the different components of any man-made or biological system. This paper is an informal but rigorous introduction…
Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying…
This paper introduces several fundamental concepts in information theory from the perspective of their origins in engineering. Understanding such concepts is important in neuroscience for two reasons. Simply applying formulae from…
Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying…
We review the theory of information cascades and social learning. Our goal is to describe in a relatively integrated and accessible way the more important themes, insights and applications of the literature as it has developed over the last…
These notes are based on the lectures that one of us (HT) gave at the Summer School on the "Theory of Large Deviations and Applications", held in July 2024 at Les Houches in France. They present the basic definitions and mathematical…
These are lecture notes for a series of lectures given at the Les Houches Summer School on Integrability in Atomic and Condensed Matter Physics, 30 July to 24 August 2018. The same series of lectures has also been given at the Tokyo…
To what extent can we distinguish one probability distribution from another? Are there quantitative measures of distinguishability? The goal of this tutorial is to approach such questions by introducing the notion of the "distance" between…
These are notes for a set of 7 two-hour lectures given at the 2010 Summer School on Quantitative Evolutionary and Comparative Genomics at OIST, Okinawa, Japan. The emphasis is on understanding how biological systems process information. We…
The overarching goal of this thesis is to demonstrate that complementarity is at the heart of quantum information theory, that it allows us to make (some) sense of just what information "quantum information" refers to, and that it is useful…
This article is a short review on the concept of information. We show the strong relation between Information Theory and Physics, and the differences between classical and quantum information, with emphasis in their manipulation through…
Information theory is a mathematical theory of learning with deep connections with topics as diverse as artificial intelligence, statistical physics, and biological evolution. Many primers on information theory paint a broad picture with…
This paper introduces \texttt{infotheory}: a package written in C++ and usable from Python and C++, for multivariate information theoretic analyses of discrete and continuous data. This package allows the user to study the relationship…