Related papers: Information processing occurs via critical avalanc…
Large reasoning models (LRMs) have demonstrated impressive capabilities in complex problem-solving, yet their internal reasoning mechanisms remain poorly understood. In this paper, we investigate the reasoning trajectories of LRMs from an…
Interdependent networks are more fragile under random attacks than simplex networks, because interlayer dependencies lead to cascading failures and finally to a sudden collapse. This is a hybrid phase transition (HPT), meaning that at the…
We show that the entropy of the distribution of avalanche lifetimes in the Kinouchi-Copelli model always achieves a maximum jointly with the dynamic range. This is noteworthy and nontrivial because while the dynamic range is an equilibrium…
A model of sensory information processing is presented. The model assumes that learning of internal (hidden) generative models, which can predict the future and evaluate the precision of that prediction, is of central importance for…
Latent visual reasoning aims to mimic human's imagination process by meditating through hidden states of Multimodal Large Language Models. While recognized as a promising paradigm for visual reasoning, the underlying mechanisms driving its…
We study the correlations between avalanches in the depinning dynamics of elastic interfaces driven on a random substrate. In the mean field theory (the Brownian force model), it is known that the avalanches are uncorrelated. Here we obtain…
Deep neural networks set the state-of-the-art across many tasks in computer vision, but their generalization ability to image distortions is surprisingly fragile. In contrast, the mammalian visual system is robust to a wide range of…
This study examine the difference in the size of avalanches among industries triggered by demand shocks, which can be rephrased by control of the economy or fiscal policy, and by using the production-inventory model and observed data. We…
Slowly driven dissipative systems may evolve to a critical state where long periods of apparent equilibrium are punctuated by intermittent avalanches of activity. We present a self-organized critical model of punctuated equilibrium behavior…
We consider the information transmission problem in neurons and its possible implications for learning in neural networks. Our approach is based on recent developments in statistical physics and complexity science. Combining sensory…
We study avalanches along the hysteresis loop of long-range interacting spin-glasses with continuous XY-symmetry - which serves as a toy model of granular superconductors with long-range and frustrated Josephson couplings. We identify…
Humans can approach complex visual problems by mentally simulating intermediate visual steps, rather than reasoning through language alone. Inspired by this, several works on Vision-Language Models have recently explored chain-of-thought…
The structure of the axon-dendrite connections of neurons of the brain creates a rich spatial structure in which provided various combinations of signals surrounding neurons. Structure of dendritic trees and shape of dendritic spines allow…
The dynamics of complex systems in nature often occurs in terms of punctuations, or avalanches, rather than following a smooth, gradual path. A comprehensive theory of avalanche dynamics in models of growth, interface depinning, and…
Our knowledge of the sensory world is encoded by neurons in sequences of discrete, identical pulses termed action potentials or spikes. There is persistent controversy about the extent to which the precise timing of these spikes is relevant…
We consider a neuronal levels model that exhibits critical avalanches satisfying power-law distribution. The model has recently explained a change in the scaling exponent from 3/2 to 5/4, accounting for a change in the drive condition from…
Life depends as much on the flow of information as on the flow of energy. Here we review the many efforts to make this intuition precise. Starting with the building blocks of information theory, we explore examples where it has been…
Visual information is processed in hierarchically organized parallel pathways in the primate brain. In lower cortical areas, color information and shape information are processed in a parallel manner, while in higher cortical areas, various…
Using a simple cellular automaton with stochastic rules we show the possible emergence of thermally activated avalanches (power law distributed) in type-II superconductors. Scaling relations between the exponents characterizing these…
Using a mechanical cantilever submitted to electrostatic feedback control, we investigate the thermodynamic properties of an information engine that extracts work from thermal fluctuations. The cantilever position is rapidly sampled and the…