Related papers: A brief tutorial on information theory
A general information-theoretic framework for deriving physical laws is presented and a principle of informational physics is enunciated within its context. Existing approaches intended to derive physical laws from information-theoretic…
In this chapter, concepts related to information and computation are reviewed in the context of human computation. A brief introduction to information theory and different types of computation is given. Two examples of human computation…
Information-theoretic derivations of the formalism of quantum theory have recently attracted much attention. We analyze the axioms underlying a few such derivations and propose a conceptual framework in which, by combining several…
Information theory plays a central role in establishing fundamental limits on what any learning or estimation algorithm can -- and cannot -- achieve, regardless of computational power. In this chapter, we provide an introduction to these…
Life depends as much on the flow of information as on the flow of energy. Here we review the many efforts to make this intuition precise. Starting with the building blocks of information theory, we explore examples where it has been…
In this paper we give a self contained introduction to the conceptional and mathematical foundations of quantum information theory. In the first part we introduce the basic notions like entanglement, channels, teleportation etc. and their…
This article summarises a Web-book on "Complexity" that was developed to introduce undergraduate students to interesting complex systems in the biological, physical and social sciences, and the common tools, principles and concepts used for…
In this survey, we describe the fundamental differential-geometric structures of information manifolds, state the fundamental theorem of information geometry, and illustrate some use cases of these information manifolds in information…
The physics learning is very important to techniques teaching and the engineers upbringing. However, there is evidence that science classes from elementary school through to university are generally failing to provide most students with an…
These lecture notes are an informal introduction to the theory of computational complexity and its links to quantum computing and statistical mechanics.
A popular scientific contribution should not contradict any established facts and ought to be understandable. I complied with both these requirements and am offering a sufficiently full introduction to probability theory. Furthermore, I…
We try to establish a unified information theoretic approach to learning and to explore some of its applications. First, we define {\em predictive information} as the mutual information between the past and the future of a time series,…
This is a short note for some basics of information geometry from thermodynamics and Callen's themostatistics.
Here, we present a simple, low-cost format for structured speaking and listening on historical, cultural, and equity-related topics within a physics institute. In this article, we describe how we run hour-long Learning Together sessions,…
These notes are based on lectures given at the Les Houches Summer School in 2011, which was centered on the general topic "Theoretical Physics to face the challenge of LHC". In these lectures I reviewed a number of topics in the field of…
In these notes I try to introduce the reader to the topic of axions: their theoretical motivation and expected phenomenology, their role in astrophysics and as dark matter candidate, and the experimental techniques to detect them. Special…
We criticize the article "Quantifying sustainability: Resilience, efficiency and the return of information theory" (Ulanowicz et al., Ecological Complexity, 2009) for its presentation of information theory to an audience of ecologists. We…
We give a non-technical introduction of the basic concepts of Quantum Information Theory along the distinction between possible and impossible machines. We then proceed to describe the mathematical framework of Quantum Information Theory.…
In our previous arXiv papers ("The Information and the Matter", v1, v5; more systematically the informational conception is presented in the paper "The Information as Absolute", 2010) it was rigorously shown that Matter in our Universe -…
Understanding a complex system entails capturing the non-trivial collective phenomena that arise from interactions between its different parts. Information theory is a flexible and robust framework to study such behaviours, with several…