Related papers: A brief tutorial on information theory

The discipline of `theoretical biology' has been developing from its inception several decades ago almost in parallel with the advances in biology, so much so that the latter is often considered to be almost exclusively an empirical…

Information flow framed in a computational and complexity context is relevant to the understanding of cognitive processes and awareness. In this paper, we begin with analyzing an information theory framework developed in recent years under…

Does information play a significant role in the foundations of physics? Information is the abstraction that allows us to refer to the states of systems when we choose to ignore the systems themselves. This is only possible in very…

These notes are an account of a series of lectures given at the Les Houches Summer School "Active Matter and Non-equilibrium Statistical Physics" during August and September 2018.

Information theory is a branch of probability and statistics involving the analysis of communications. Information theory enables us to analyze and quantify the information content of predictions made in the context of plant disease…

In our previous articles ("The Information and the Matter", v1, v5; more systematically the informational conception is presented in arXiv paper "The Information as Absolute", 2010) it was rigorously shown that the Matter is some…

We review hitherto attempts to look at the multiparticle production processes from the Information Theory point of view (both in its extensive and nonextensive versions).

This report summarizes some of the material that was presented by the author during the 2015 Les Houches Summerschool on "Random Matrices and Stochastic Processes". In these Lectures, various applications of Random Matrix Theory in modern…

Complex systems often exhibit multiple levels of organization covering a wide range of physical scales, so the study of the hierarchical decomposition of their structure and function is frequently convenient. To better understand this…

This paper introduces time into information theory, gives a more accurate definition of information, and unifies the information in cognition and Shannon information theory. Specially, we consider time as a measure of information, giving a…

The primary aim of this study in this paper aside from presenting student preference survey data and analytics data with relation to learning videos, is to address the attention span issues with our cohort of Information Technology students…

You may have seen the words "topological recursion" mentioned in papers on matrix models, Hurwitz theory, Gromov-Witten theory, topological string theory, knot theory, topological field theory, JT gravity, cohomological field theory, free…

Information theory is rapidly approaching its 70th birthday. What are promising future directions for research in information theory? Where will information theory be having the most impact in 10-20 years? What new and emerging areas are…

We review of the interface between (theoretical) physics and information for non-experts. The origin of information as related to the notion of entropy is described, first in the context of thermodynamics then in the context of statistical…

Information is a precise concept that can be defined mathematically, but its relationship to what we call "knowledge" is not always made clear. Furthermore, the concepts "entropy" and "information", while deeply related, are distinct and…

Lectures presented at the Les Houches 2016 Summer School "Integrability: from Statistical Systems to Gauge Theory".

What is information, physically, and why does it so reliably emerge in living, cultural, and technological systems? Existing theories quantify uncertainty, cost, or compressibility, but do not identify which physical structures count as…

Forecasting techniques for assessing the power of future experiments to discriminate between theories or discover new laws of nature are of great interest in many areas of science. In this paper, we introduce a Bayesian forecasting method…

This manuscript contains preprint of a chapter under consideration for inclusion in the forthcoming third edition of {\em Cover and Thomas's Elements of Information Theory}, posted with permission from Wiley. The table of contents EIT-3 ToC…

In our previous arXiv papers (more systematically the informational conception is presented in the paper "The Information as Absolute", 2010) it was rigorously shown that Matter in our Universe - and Universe as a whole - are some…