相关论文: Clifford Algebraic Rotor Embeddings : Maybe embedd…

This paper is to serve as a key to the projective (homogeneous) model developed by Charles Gunn (arXiv:1101.4542 [math.MG]). The goal is to explain the underlying concepts in a simple language and give plenty of examples. It is targeted to…

Vision-language models learn powerful multimodal embeddings, yet their internal semantics remain opaque. While sparse autoencoders (SAEs) can extract interpretable features, they rely on expanding the representation dimension, which…

Quaternions have an (over a century-old) extensive and quite complicated interaction with special relativity. Since quaternions are intrinsically 4-dimensional, and do such a good job of handling 3-dimensional rotations, the hope has always…

Relative positional encodings determine which functions of query-key lag can enter the primitive attention logit. RoPE supplies a rotary phase, while ALiBi supplies an additive distance bias. Motivated by group-theoretic views of linear…

Positional encoding (PE) underpins how permutation-invariant Transformers represent sequence order, yet how positional information is processed and stored remains poorly understood. Modern PE methods such as RoPE still struggle on tasks…

We study the problem of learning representations of entities and relations in knowledge graphs for predicting missing links. The success of such a task heavily relies on the ability of modeling and inferring the patterns of (or between) the…

The Dirac belt trick is often employed in physics classrooms to show that a $2\pi$ rotation is not topologically equivalent to the absence of rotation whereas a $4\pi$ rotation is, mirroring a key property of quaternions and their…

We propose a novel quaternion product unit (QPU) to represent data on 3D rotation groups. The QPU leverages quaternion algebra and the law of 3D rotation group, representing 3D rotation data as quaternions and merging them via a weighted…

Many classes of images exhibit rotational symmetry. Convolutional neural networks are sometimes trained using data augmentation to exploit this, but they are still required to learn the rotation equivariance properties from the data.…

Collaborative representation-based classification (CRC) has demonstrated remarkable progress in the past few years because of its closed-form analytical solutions. However, the existing CRC methods are incapable of processing the nonlinear…

Transformers rely on both content-based and position-based addressing mechanisms to make predictions, but existing positional encoding techniques often diminish the effectiveness of position-based addressing. Many current methods enforce…

Multimodal Large Language Models (MLLMs) have emerged as a promising foundation for universal multimodal embeddings. Recent studies have shown that reasoning-driven generative multimodal embeddings can outperform discriminative embeddings…

It is well noted that coordinate based MLPs benefit -- in terms of preserving high-frequency information -- through the encoding of coordinate positions as an array of Fourier features. Hitherto, the rationale for the effectiveness of these…

In this paper a quaternion approach of enhancement method is proposed in which color in the image is considered as a single entity. This new method is referred as the alpha-rooting method of color image enhancement by the two-dimensional…

The objective of ordinal embedding is to find a Euclidean representation of a set of abstract items, using only answers to triplet comparisons of the form "Is item $i$ closer to the item $j$ or item $k$?". In recent years, numerous…

I apply the algebraic framework introduced in arXiv:1101.4542v3[math.MG] to Minkowski (pseudo-Euclidean) spaces in 2, 3, and 4 dimensions. The exposition follows the template established in arXiv:1307.2917[math.MG] for Euclidean spaces. The…

Vehicle Routing Problems (VRPs) with diverse real-world attributes have driven recent interest in cross-problem learning approaches that efficiently generalize across problem variants. We propose ARC (Attribute Representation via…

Given two parallelisms of a projective space we describe a construction, called blending, that yields a (possibly new) parallelism of this space. For a projective double space $(\mathbb{P},\parallel_\ell,\parallel_r)$ over a quaternion skew…

This article provides, over any field, infinitely many algebraic embeddings of the affine spaces $\mathbb{A}^1$ and $\mathbb{A}^2$ into smooth quadrics of dimension two and three respectively, which are pairwise non-equivalent under…

Quadrilateral layouts on surfaces are valuable in texture mapping, and essential in generation of quadrilateral meshes and in fitting splines. Previous work has characterized such layouts as a special metric on a surface or as a meromorphic…