Related papers: Consciousness as a Jamming Phase
To maintain coherence in language, the brain must satisfy key competing temporal demands: the gradual accumulation of meaning across extended context (drift) and the rapid reconfiguration of representations at event boundaries (shift). How…
Mutual misunderstanding in contemporary society does not arise merely because people hold different opinions or values. Even under the same observations, different subjects may form different inferential targets, state representations,…
Finding and facilitating commonalities between the linguistic behaviors of large language models and humans could lead to major breakthroughs in our understanding of the acquisition, processing, and evolution of language. However, most…
We identify a new universality class of phase transitions that emerges in non-normal systems, extending the classical framework beyond eigenvalue instabilities. Unlike traditional critical phenomena, where transitions occur when eigenvalues…
The framework of Modern Theory of Critical State Transitions considers the relation between different levels of organization in complex systems in terms of Critical State Transitions. A State Transition between levels entails changes of…
Analytical investigations are made on BML two-dimensional traffic flow model with alternative movement and exclude-volume effect. Several exact results are obtained, including the upper critical density above which there are only jamming…
Neural systems process information in a dynamical regime between silence and chaotic dynamics. This has lead to the criticality hypothesis which suggests that neural systems reach such a state by self-organizing towards the critical point…
Increase in data, size, or compute can lead to sudden learning of specific capabilities by a neural network -- a phenomenon often called "emergence''. Beyond scientific understanding, establishing the causal factors underlying such emergent…
The critical brain hypothesis posits that neural systems operate near a phase transition, optimizing the processing of information. While scale invariance and non-Gaussian dynamics--hallmarks of criticality--have been observed in brain…
The phenomenon of distinct behaviors exhibited by neural networks under varying scales of initialization remains an enigma in deep learning research. In this paper, based on the earlier work by Luo et al.~\cite{luo2021phase}, we present a…
Stylized models of the neurodynamics that underpin sensory motor control in animals are proposed and studied. The voluntary motions of animals are typically initiated by high level intentions created in the primary cortex through a…
Large language models (LLMs) exhibit unprecedentedly rich scaling behaviors. In physics, scaling behavior is closely related to phase transitions, critical phenomena, and field theory. To investigate the phase transition phenomena in LLMs,…
Understanding how neural dynamics shape cognitive experiences remains a central challenge in neuroscience and psychiatry. Here, we present a novel framework leveraging state-to-output controllability from dynamical systems theory to model…
The organization of higher-order interactions plays a central role in shaping collective dynamics, yet a general structural principle governing contagion on hypergraphs remains lacking. Here we introduce a nesting coefficient that…
This paper presents a formal proof and empirical validation of functional consciousness in large language models (LLMs) using the Recursive Convergence Under Epistemic Tension (RCUET) Theorem. RCUET defines consciousness as the…
Cascading large-amplitude bursts in neural activity, termed avalanches, are thought to provide insight into the complex spatially distributed interactions in neural systems. In human neuroimaging, for example, avalanches occurring during…
A major challenge in neuroscience is posed by the need for relating the emerging dynamical features of brain activity with the underlying modular structure of neural connections, hierarchically organized throughout several scales. The…
A language model (LM) is a mapping from a linguistic context to an output token. However, much remains to be known about this mapping, including how its geometric properties relate to its function. We take a high-level geometric approach to…
As a promising computational paradigm, occurrence of critical states in artificial and biological neural networks has attracted wide-spread attention. An often-made explicit or implicit assumption is that one single critical state is…
The underlying physiological mechanisms of generating conscious states are still unknown. To make progress on the problem of consciousness, we will need to experimentally design a system that evolves in a similar way our brains do. Recent…