English
Related papers

Related papers: Entropy Collapse: A Universal Failure Mode of Inte…

200 papers

Large language models are often described as capable of reflective reasoning, yet recursive self-evaluation without external feedback frequently yields reformulation rather than progress. We test this prediction in a cross-provider study of…

Machine Learning · Computer Science 2025-11-06 Bentley DeVilling

We examine the behavior of entanglement entropy of a subsystem $A$ in a fully backreacted holographic model of a $1+1$ dimensional $p$ wave superconductor across the phase transition. For a given temperature, the system goes to a…

High Energy Physics - Theory · Physics 2017-09-12 Sumit R. Das , Mitsutoshi Fujita , Bom Soo Kim

We consider a set of fully connected spins models that display first- or second-order transitions and for which we compute the ground-state entanglement in the thermodynamical limit. We analyze several entanglement measures (concurrence,…

Statistical Mechanics · Physics 2011-03-01 M. Filippone , S. Dusuel , J. Vidal

Two examples of Microcanonical Potts models, 2-dimensional nearest neighbor and mean field, are considered via exact enumeration of states and analytical asymptotic methods. In the interval of energies corresponding to a first order phase…

Statistical Mechanics · Physics 2009-11-07 I. Ispolatov , E. G. D. Cohen

We present a numerical study of a quantum phase transition from a spin-polarized to a topologically ordered phase in a system of spin-1/2 particles on a torus. We demonstrate that this non-symmetry-breaking topological quantum phase…

Quantum Physics · Physics 2008-06-07 A. Hamma , W. Zhang , S. Haas , D. A. Lidar

The pattern of isentropes in the vicinity of a first-order phase transition is proposed as a key for a sub-classification. While the confinement--deconfinement transition, conjectured to set in beyond a critical end point in the QCD phase…

High Energy Physics - Phenomenology · Physics 2016-05-25 Falk Wunderlich , Roman Yaresko , Burkhard Kampfer

This paper aims to overcome a major obstacle in scaling RL for reasoning with LLMs, namely the collapse of policy entropy. Such phenomenon is consistently observed across vast RL runs without entropy intervention, where the policy entropy…

Inspired by the swarming or flocking of animal systems we study groups of agents moving in unbounded 2D space. Individual trajectories derive from a ``bottom-up'' principle: individuals reorient to maximise their future path entropy over…

Statistical Mechanics · Physics 2023-04-21 Harvey L. Devereux , Matthew S. Turner

In this paper we apply the formalism of translation invariant (continuous) matrix product states in the thermodynamic limit to $(1+1)$ dimensional critical models. Finite bond dimension bounds the entanglement entropy and introduces an…

Quantum Physics · Physics 2015-06-18 Vid Stojevic , Jutho Haegeman , I. P. McCulloch , L. Tagliacozzo , Frank Verstraete

We examine a model in which a nonequilibrium phase transition from an active to an extinct state is observed. The order of this phase transition has been shown to be either continuous or first-order, depending on the parameter values and…

Statistical Mechanics · Physics 2009-11-13 Alastair Windus , Henrik Jeldtoft Jensen

Onset and loss of synchronization in coupled oscillators are of fundamental importance in understanding emergent behavior in natural and man-made systems, which range from neural networks to power grids. We report on experiments with…

Adaptation and Self-Organizing Systems · Physics 2020-10-14 Dumitru Călugăru , Jan Frederik Totz , Erik A. Martens , Harald Engel

We discuss the Renyi entanglement entropies of descendant states in critical one-dimensional systems with boundaries, that map to boundary conformal field theories in the scaling limit. We unify the previous conformal-field-theory…

Statistical Mechanics · Physics 2016-09-27 Luca Taddia , Fabio Ortolani , Tamás Pálmai

Feedback alignment and related weight-transport-free algorithms are often proposed as biologically plausible alternatives to backpropagation, yet they are typically formulated in discrete phases with implicitly synchronized forward and…

Machine Learning · Computer Science 2026-03-03 Marc Gong Bacvanski , Liu Ziyin , Tomaso Poggio

The scaling behavior of the entanglement entropy in the two-dimensional random transverse field Ising model is studied numerically through the strong disordered renormalization group method. We find that the leading term of the entanglement…

Disordered Systems and Neural Networks · Physics 2009-11-13 Rong Yu , Hubert Saleur , Stephan Haas

We study the entanglement entropy of general holographic dual models both in AdS soliton and AdS black hole backgrounds with full backreaction. We find that the entanglement entropy is a good probe to explore the properties of the…

High Energy Physics - Theory · Physics 2015-06-19 Yan Peng , Qiyuan Pan

Do reasoning models have "Aha!" moments? Prior work suggests that models like DeepSeek-R1-Zero undergo sudden mid-trace realizations that lead to accurate outputs, implying an intrinsic capacity for self-correction. Yet, it remains unclear…

Artificial Intelligence · Computer Science 2026-04-21 Liv G. d'Aliberti , Manoel Horta Ribeiro

We investigate the collective dynamics of a population of XY model-type oscillators, globally coupled via non-separable interactions that are randomly chosen from a positive or negative value, and subject to thermal noise controlled by…

Adaptation and Self-Organizing Systems · Physics 2022-06-29 Hyunsuk Hong , Erik Andreas Martens

Many-body unitary dynamics interspersed with repeated measurements display a rich phenomenology hallmarked by measurement-induced phase transitions. Employing feedback-control operations that steer the dynamics toward an absorbing state, we…

Statistical Mechanics · Physics 2023-03-30 Piotr Sierant , Xhek Turkeshi

We study the one-dimensional (1D) quantum compass model with two independent parameters by means of an exact mapping to the quantum Ising model. This allows us to uncover hidden features of the quantum phase transition in the ordinary…

Strongly Correlated Electrons · Physics 2009-06-29 Erik Eriksson , Henrik Johannesson

Reasoning models are evaluated on single-turn benchmarks but deployed in multi-turn dialogue, where users push back on correct answers. Under sustained adversarial pressure we find a previously undocumented failure mode: the…

Artificial Intelligence · Computer Science 2026-05-29 Yubo Li , Ramayya Krishnan , Rema Padman