Related papers: Aperiodic String Transducers
Transformers often struggle with length generalization, meaning they fail to generalize to sequences longer than those encountered during training. While arithmetic tasks are commonly used to study length generalization, certain tasks are…
Recurrent neural network transducers (RNN-T) have been successfully applied in end-to-end speech recognition. However, the recurrent structure makes it difficult for parallelization . In this paper, we propose a self-attention transducer…
The one-dimensional (1D) fractional Fourier transform (FRFT) generalizes the Fourier transform, offering significant advantages in the time-frequency analysis of non-stationary signals. While various 2D extensions exist, such as the 2D…
Rapid technological advances are inherently linked to the increased amount of data, a substantial portion of which can be interpreted as data stream, capable of exhibiting the phenomenon of concept drift and having a high imbalance ratio.…
We consider polyregular functions, which are certain string-to-string functions that have polynomial output size. We prove that a polyregular function has output size $\mathcal O(n^k)$ if and only if it can be defined by an MSO…
We offer a consistent dynamical formulation of stationary scattering in two and three dimensions that is based on a suitable multidimensional generalization of the transfer matrix. This is a linear operator acting in an infinite-dimensional…
For an effective AdS theory, we present a simple prescription to compute the renormalization of its dual boundary field theory. In particular, we define anomalous dimension holographically as the dependence of the wave-function…
The spectrum of two-point functions in a holographic renormalization group flow from an ultraviolet (UV) to an infrared (IR) conformal fixed point is necessarily continuous. For a toy model, the spectral function does not only show the…
This paper presents a gradient-based method for on-the-fly optimization for both per-frame and per-frequency window length of the short-time Fourier transform (STFT), related to previous work in which we developed a differentiable version…
This work is about diagrammatic languages, how they can be represented, and what they in turn can be used to represent. More specifically, it focuses on representations and applications of string diagrams. String diagrams are used to…
We investigate the proposed holographic duality between the TsT transformation of IIB string theory on AdS$_3\times {\cal N}$ with NS-NS flux and a single-trace $T\bar{T}$ deformation of the symmetric orbifold CFT. We present a…
An iterated uniform finite-state transducer (IUFST) runs the same length-preserving transduction, starting with a sweep on the input string and then iteratively sweeping on the output of the previous sweep. The IUFST accepts the input…
We study very smooth functions on the real line, namely Schwartz functions, that satisfy a finite identity relating their translates and a single modulation. Concretely, we assume there is a nontrivial linear combination of translates of…
We present evidence for a new deconstruction of Little String Theory (LST). The starting point is a four-dimensional conformal field theory on its Higgs branch which provides a lattice regularization of six-dimensional gauge theory. We…
Learning multiscale Transformer models has been evidenced as a viable approach to augmenting machine translation systems. Prior research has primarily focused on treating subwords as basic units in developing such systems. However, the…
In the past decade, several multi-resolution representation theories for graph signals have been proposed. Bipartite filter-banks stand out as the most natural extension of time domain filter-banks, in part because perfect reconstruction,…
We prove that for a given deterministic top-down transducer with look-ahead it is decidable whether or not its translation is definable (1)~by a linear top-down tree transducer or (2)~by a tree homomorphism. We present algorithms that…
This contribution is a follow-up of a recent paper by the authors on adaptive, non-linear time-frequency transforms, focusing on the STFT based transforms. The adaptivity is provided by a focus function, that depends on the analyzed…
Simulating the long-term dynamics of multi-scale and multi-physics systems poses a significant challenge in understanding complex phenomena across science and engineering. The complexity arises from the intricate interactions between scales…
We give a new proof of the well-known fact that all functions $(\mathbb{N} \to \mathbb{N}) \to \mathbb{N}$ which are definable in G\"odel's System T are continuous via a syntactic approach. Differing from the usual syntactic method, we…