Related papers: Thermodynamics of Information Retrieval
For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we…
In emotion recognition from speech, a key challenge lies in identifying speech signal segments that carry the most relevant acoustic variations for discerning specific emotions. Traditional approaches compute functionals for features such…
Genomes may be analyzed from an information viewpoint as very long strings, containing functional elements of variable length, which have been assembled by evolution. In this work an innovative information theory based algorithm is…
We propose a novel document generation process based on hierarchical latent tree models (HLTMs) learned from data. An HLTM has a layer of observed word variables at the bottom and multiple layers of latent variables on top. For each…
In addition to the frequency of terms in a document collection, the distribution of terms plays an important role in determining the relevance of documents. In this paper, a new approach for representing term positions in documents is…
In a previous paper, we introduced an axiomatic system for information thermodynamics, deriving an entropy function that includes both thermodynamic and information components. From this function we derived an entropic probability…
We propose a theoretical model called "information gravity" to describe the text generation process in large language models (LLMs). The model uses physical apparatus from field theory and spacetime geometry to formalize the interaction…
This paper analysed author-assigned and title keywords into constituent words collected from 769 articles published in the journal Low Temperature Physics since the year 2006 to 2010. The total number of distinct keywords over the said time…
We consider the thermodynamic approach to the description of economic systems and processes. The first and second laws of thermodynamics as applied to economic systems are derived and analyzed. It is shown that there is a deep analogy…
In this treatment a text is considered to be a series of word impulses which are read at a constant rate. The brain then assembles these units of information into higher units of meaning. A classical systems approach is used to model an…
We develop a thermodynamic framework for modeling innovation adoption and abandonment dynamics using statistical mechanics. Starting from a mathematical model for an adoption distribution that fits empirically obtained date, we construct a…
Formalism based on equilibrium statistical thermodynamics is applied to communication networks of decision making individuals. It is shown that in statistical ensembles for choice models, properly defined disutility can play the same role…
Motivated by the recent proposed models of the information engine [D. Mandal and C. Jarzynski, Proc. Natl. Acad. Sci. 109, 11641 (2012)] and the information refrigerator [D. Mandal, H. T. Quan, and C. Jarzynski, Phys. Rev. Lett. 111, 030602…
Fluctuations in biochemical networks, e.g., in a living cell, have a complex origin that precludes a description of such systems in terms of bipartite or multipartite processes, as is usually done in the framework of stochastic and/or…
In this study, internal energy (U), electric field (E) and particle number (N) which specify the system quantities i.e. thermodynamical quantities for the proteins. In the frame of thermodynamical formalism, the relation between the heat…
Numerical hydrodynamics simulations of gases dominated by ideal, nondegenerate matter pressure and thermal radiation pressure in equilibrium entail finding the temperature as part of the evolution. Since the temperature is not typically a…
Slow emerging topic detection is a task between event detection, where we aggregate behaviors of different words on short period of time, and language evolution, where we monitor their long term evolution. In this work, we tackle the…
Self-organizing systems consume energy to generate internal order. The concept of thermodynamic efficiency, drawing from statistical physics and information theory, has previously been proposed to characterise a change in control parameter…
We analyze the performance of classical and quantum search algorithms from a thermodynamic perspective, focusing on resources such as time, energy, and memory size. We consider two examples that are relevant to post-quantum cryptography:…
We describe a new method for visualizing topics, the distributions over terms that are automatically extracted from large text corpora using latent variable models. Our method finds significant $n$-grams related to a topic, which are then…