Related papers: Syntactic Structures and Code Parameters
Multidimensional hydrodynamical simulations have transformed the study of stellar interiors over the past few decades. Most codes developed during that time use the anelastic approximation, which fixes the thermal structure of simulations…
We consider spatially coupled code ensembles over a multiple access channel. Convolutional LDPC ensembles are one instance of spatially coupled codes. It was shown recently that, for transmission over the binary erasure channel, this…
Advances in natural language processing, such as transfer learning from pre-trained language models, have impacted how models are trained for programming language tasks too. Previous research primarily explored code pre-training and…
We develop further a recent dynamical replica theory to describe the dynamics of the Sherrington-Kirkpatrick spin-glass in terms of closed evolution equations for macroscopic order parameters. We show how microscopic memory effects can be…
State-of-the-art language generation models can degenerate when applied to open-ended generation problems such as text completion, story generation, or dialog modeling. This degeneration usually shows up in the form of incoherence, lack of…
We study theoretically and numerically a family of multi-point dynamic susceptibilities that quantify the strength and characteristic lengthscales of dynamic heterogeneities in glass-forming materials. We use general theoretical arguments…
In an effort to understand the glass transition, the dynamics of a non-randomly frustrated spin model has been analyzed. The phenomenology of the spin model is similar to that of a supercooled liquid undergoing the glass transition. The…
The syntactic behaviour of texts can highly vary depending on their contexts (e.g. author, genre, etc.). From the standpoint of stylometry, it can be helpful to objectively measure this behaviour. In this paper, we discuss how coalgebras…
Spin-glasses are natural Gibbs distributions that have been studied in Theoretical CS for many decades. Recently, they have been gaining attention from the community as they emerge naturally in neural computation and learning, network…
It is generally believed that, when a linguistic item acquires a new meaning, its overall frequency of use in the language rises with time with an S-shaped growth curve. Yet, this claim has only been supported by a limited number of case…
We reveal a topological burning glass effect, where the local response of a system exhibits a topological quantization that is enhanced by an integer due to its environmental coupling. As a paradigmatic platform for this intriguing…
Large language models are increasingly trained on corpora containing both natural language and non-linguistic data like source code. Aside from aiding programming-related tasks, anecdotal evidence suggests that including code in pretraining…
A powerful method for analyzing quantum error-correcting codes is to map them onto classical statistical mechanics models. Such mappings have thus far mostly focused on static codes, possibly subject to repeated syndrome measurements.…
We study the influence of composition changes on the glass transition of binary hard disc and hard sphere mixtures in the framework of mode coupling theory. We derive a general expression for the slope of a glass transition line. Applied to…
We examine the dynamics of resonance locking in detached, tidally interacting binary systems. In a resonance lock, a given stellar or planetary mode is trapped in a highly resonant state for an extended period of time, during which the spin…
Complex free-energy landscapes with many local minima separated by large barriers are believed to underlie glassy behavior across diverse physical systems. This is the heuristic picture associated with replica symmetry breaking (RSB) in…
We examine the classical joint source--channel coding problem from the viewpoint of statistical physics and demonstrate that in the random coding regime, the posterior probability distribution of the source given the channel output is…
By molecular dynamics (MD) simulation of the one-component Dzugutov liquid in a metastable equilibrium supercooled state approaching the glass transition, we investigate the structural properties of highly mobile particles moving in strings…
We present new constructions of codes for asymmetric channels for both binary and nonbinary alphabets, based on methods of generalized code concatenation. For the binary asymmetric channel, our methods construct nonlinear…
Data generation and analysis is a fundamental aspect of many industries and disciplines, from strategic decision making in business to research in the physical and social sciences. However, data generated using software and algorithms can…