Related papers: Information Theory and Statistical Physics - Lectu…
We try to establish a unified information theoretic approach to learning and to explore some of its applications. First, we define {\em predictive information} as the mutual information between the past and the future of a time series,…
The use of statistical software in academia and enterprises has been evolving over the last years. More often than not, students, professors, workers, and users, in general, have all had, at some point, exposure to statistical software.…
We discuss several ways of illustrating fundamental concepts in statistical and thermal physics by considering various models and algorithms. We emphasize the importance of replacing students' incomplete mental images by models that are…
The field of partial differential equations (PDEs) is vast in size and diversity. The basic reason for this is that essentially all fundamental laws of physics are formulated in terms of PDEs. In addition, approximations to these…
This document introduces basics in data preparation, feature selection and learning basics for high energy physics tasks. The emphasis is on feature selection by principal component analysis, information gain and significance measures for…
The application of information theory approach (both in its extensive and nonextensive versions) to high energy multiparticle processes is discussed and confronted with experimental data on e+e- annihilation processes, pp and \bar{p}p…
Expanded lecture notes. Preliminary version, comments are welcome.
Many statistical issues arise in the analysis of Particle Physics experiments. We give a brief introduction to Particle Physics, before describing the techniques used by Particle Physicists for dealing with statistical problems, and also…
Combining quantum information theory with thermodynamics unites 21st-century technology with 19th-century principles. The union elucidates the spread of information, the flow of time, and the leveraging of energy. This thesis contributes to…
Fluctuations in biochemical networks, e.g., in a living cell, have a complex origin that precludes a description of such systems in terms of bipartite or multipartite processes, as is usually done in the framework of stochastic and/or…
This essay considers a simple model of observers that are influenced by the world around them. Consistent quantification of information about such influences results in a great deal of familiar physics. The end result is a new perspective…
Within the continuous endeavour of improving the efficiency and resilience of air transport, the trend of using concepts and metrics from statistical physics has recently gained momentum. This scientific discipline, which integrates…
We focus attention on some particular thermodynamic relations (PTR). Using information theory concepts we show that, for a reversible process, microscopic considerations related to these PTR make the concomitant informational contents of…
These are the lecture notes that accompanied the course of the same name that I taught at the Eindhoven University of Technology from 2021 to 2023. The course is intended as an introduction to neural networks for mathematics students at the…
Lecture notes from the course given by Professor Sara A. Solla at the Les Houches summer school on "Statistical physics of Machine Learning". The notes discuss neural information processing through the lens of Statistical Physics. Contents…
Infographics are a form of data visualization combining data, information, and statistics. Over the last ten years, infographics have become a popular method for displaying concise information, where infographics are a useful tool for…
Data science is an emerging interdisciplinary field that combines elements of mathematics, statistics, computer science, and knowledge in a particular application domain for the purpose of extracting meaningful information from the…
This article discusses how to make statistical graphics a more prominent element of the undergraduate statistics curricula. The focus is on several different types of assignments that exemplify how to incorporate graphics into a course in a…
The dynamics of phase transitions plays a crucial r\^ole in the so-called interface between high energy particle physics and cosmology. Many of the interesting results generated during the last fifteen years or so rely on simplified…
The information implicitly represented in the state of physical systems allows one to analyze them with analytical techniques from statistical mechanics and information theory. In the case of complex networks such techniques are inspired by…