Related papers: Berezinskii--Kosterlitz--Thouless transition in a …
Transformer language models can generate strikingly natural text by modeling language as a sequence of tokens, but by relying primarily on surface-level co-occurrence statistics they fail to form globally consistent latent representations…
Recent results concerning the topological properties of random geometrical sets have been successfully applied to the study of the morphology of clusters in percolation theory. This approach provides an alternative way of inspecting the…
The associationist account for early word-learning is based on the co-occurrence between objects and words. Here we examine the performance of a simple associative learning algorithm for acquiring the referents of words in a…
The nonequilibrium dynamics of two dimensional Su-Schrieffer-Heeger model, in the presence of staggered chemical potential, is investigated using the notion of dynamical quantum phase transition. We contribute to expanding the systematic…
Modern language models represent probability distributions over character strings as distributions over (shorter) token strings derived via a deterministic tokenizer, such as byte-pair encoding. While this approach is highly effective at…
We investigate the Berezinskii-Kosterlitz-Thouless (BKT) transition in a semiconductor-superconductor two-dimensional Josephson junction array. Tuned by an electrostatic top gate, the system exhibits separate superconducting (S), anomalous…
A two-dimensional quantum system of dipoles, with a polarization angle not perpendicular to the plane, shows a transition from a gas to a stripe phase. We have studied the thermal properties of these two phases using the path integral Monte…
Using extensive Monte Carlo simulations, we test the hypothesis that the density of corresponding topological defects has an universal value at the temperature of a continuous phase transition. We consider several simple two-dimensional…
We explore possible synchronization in two-dimensional (2D) locally coupled discrete-state oscillators under thermal fluctuations, using the self-rotating $q$-state clock model as a prototype. Large-scale Monte Carlo simulations reveal that…
A new approach to the Berezinskii-Kosterlitz-Thouless transition in the two-dimensional Coulomb gas model is explored by MC simulation and finite size scaling. The usual mapping of a neutral two-dimensional superconductor in zero magnetic…
Stochastic embedding transitions introduce a probabilistic mechanism for adjusting token representations dynamically during inference, mitigating the constraints imposed through static or deterministic embeddings. A transition framework was…
Syntactic structures used to play a vital role in natural language processing (NLP), but since the deep learning revolution, NLP has been gradually dominated by neural models that do not consider syntactic structures in their design. One…
The Berezinskii-Kosterlitz-Thouless (BKT) transitions of the six-state clock model on the square lattice are investigated by means of the corner-transfer matrix renormalization group method. A classical analog of the entanglement entropy…
It is known that there is no phase transition down to zero temperature in the antiferromagnetic Ising model on spatially anisotropic triangular lattices, in which the exchange coupling of one direction is stronger than those of other two…
We study the chiral phase transition in (2+1)d strongly coupled U(N) lattice gauge theories with staggered fermions. We show with high precision simulations performed directly in the chiral limit that these models undergo a…
In tensor network representation, the partition function of a generalized two-dimensional XY spin model with topological integer and half-integer vortex excitations is mapped to a tensor product of one-dimensional quantum transfer operator,…
By using worldline and diagrammatic quantum Monte Carlo techniques, matrix product state and a variational approach \`a la Feynman, we investigate the equilibrium properties and relaxation features of a quantum system of $N$ spins…
When pre-trained on large unsupervised textual corpora, language models are able to store and retrieve factual knowledge to some extent, making it possible to use them directly for zero-shot cloze-style question answering. However, storing…
We investigate the 2d XY model by using the constraint angle action, which belongs to the class of topological lattice actions. These actions violate important features usually demanded for a lattice action, such as the correct classical…
Fundamental properties of the Kosterlitz-Thouless-Berezinskii (KTB) transition which occurs in systems in the universality class of the two-dimensional X-Y model are reviewed here with an emphasis on the real-space renormalization group…