Related papers: Information Propagation and Encoding in Solids: A …
Communication signals often comprise an array of colors, lines, spots, notes or odors that are arranged in complex patterns, melodies or blends. Receiver perception is assumed to influence preference and thus the evolution of signal design,…
We characterize the information dynamics of strongly disordered systems using a combination of analytics, exact diagonalization, and matrix product operator simulations. More specifically, we study the spreading of quantum information in…
Positional encodings enable Transformers to incorporate sequential information, yet their theoretical understanding remains limited to two properties: distance attenuation and translation invariance. Because natural language lacks purely…
Gathering information about a system enables greater control over it. This principle lies at the core of information engines, which use measurement-based feedback to rectify thermal noise and convert information into work. Originating from…
In this paper, a network-based stochastic information propagation model is developed. The information flow is modeled by a probabilistic differential equation system. The numerical solution of these equations leads to the expected number of…
Interacting quantum many-body systems are usually expected to thermalise, in the sense that the evolution of local expectation values approach a stationary value resembling a thermal ensemble. This intuition is notably contradicted in…
A one-dimensional wave propagation through elastically asymmetric media is investigated. A class of metamaterials possessing an arbitrary elastic asymmetry is proposed. This asymmetry results in different wave speeds of tensile and…
Cells can be considered as systems that utilize changes in thermodynamic entropy as information. Therefore, they serve as useful models for investigating the relationships between entropy production and information transmission, i.e.,…
End-to-end multimodal learning on knowledge graphs has been left largely unaddressed. Instead, most end-to-end models such as message passing networks learn solely from the relational information encoded in graphs' structure: raw values, or…
Designing metamaterials that carry out advanced computations poses a significant challenge. A powerful design strategy splits the problem into two steps: First, encoding the desired functionality in a discrete or tight-binding model, and…
Analyses of transformer-based models have shown that they encode a variety of linguistic information from their textual input. While these analyses have shed a light on the relation between linguistic information on one side, and internal…
From healing wounds to maintaining homeostasis in cyclically loaded tissue, living systems have a phenomenal ability to sense, store, and respond to mechanical stimuli. Broadly speaking, there is significant interest in designing engineered…
The Integrated Information Theory provides a quantitative approach to consciousness and can be applied to neural networks. An embodied agent controlled by such a network influences and is being influenced by its environment. This involves,…
Unconventional computing devices are increasingly of interest as they can operate in environments hostile to silicon-based electronics, or compute in ways that traditional electronics cannot. Mechanical computers, wherein information…
Locally broken symmetries are used across fields to transport matter, particles and information in preferential directions. Beyond local mechanisms, spatially distributed nonlinearities in crystalline media have enabled non-reciprocal…
To maintain homeostasis, living cells process information with networks of interacting molecules. Traditional models for cellular information processing have focused on networks of chemical reactions between molecules. Here, we describe how…
We outline a possible theoretical framework for the quantitative modeling of networked embodied cognitive systems. We notice that: 1) information self structuring through sensory-motor coordination does not deterministically occur in Rn…
Information transfer is an essential factor in determining the robustness of collective behaviour in biological systems with distributed control. The most direct way to study the information transfer mechanisms is to experimentally detect…
In computer science, we can theoretically neatly separate transmission and processing of information, hardware and software, and programs and their inputs. This is much more intricate in biology, Nevertheless, I argue that Shannon's concept…
Cells use biochemical networks to translate environmental information into intracellular responses. These responses can be highly dynamic, but how the information is encoded in these dynamics remains poorly understood. Here we investigate…