English

Circle-RoPE: Cone-like Decoupled Rotary Positional Embedding for Large Vision-Language Models

Computer Vision and Pattern Recognition 2026-05-22 v3 Artificial Intelligence

Abstract

Rotary Position Embedding (RoPE) is widely adopted in large language models, but when applied to vision-language models (VLMs) it couples text and image position indices and can introduce spurious cross-modal relative-position bias. We propose Per-Token Distance (PTD) to quantify cross-modal positional disentanglement, and prove that PTD = 0 is a sufficient condition to eliminate the geometric attention bias induced by RoPE. Guided by this criterion, we introduce Circle-RoPE, which remaps 2D image-token coordinates onto an annulus orthogonal to the text position axis, yielding a cone-like geometry where each text token is equidistant to all image tokens while preserving intra-image spatial structure. We further propose Alternating Geometry Encoding (AGE) to combine complementary geometric priors by alternating the decoupled geometry of Circle-RoPE and the grid-based prior of standard RoPE across layers. This design enables cross-modal positional disentanglement while preserving fine-grained intra-image spatial structure. Experiments on diverse VLM backbones and multimodal benchmarks show consistent gains in spatial grounding and visual reasoning. The code is available at https://github.com/lose4578/CircleRoPE.

Keywords

Cite

@article{arxiv.2505.16416,
  title  = {Circle-RoPE: Cone-like Decoupled Rotary Positional Embedding for Large Vision-Language Models},
  author = {Chengcheng Wang and Jianyuan Guo and Hongguang Li and Yuchuan Tian and Ying Nie and Chang Xu and Kai Han},
  journal= {arXiv preprint arXiv:2505.16416},
  year   = {2026}
}

Comments

Accepted at ICML 2026

R2 v1 2026-07-01T02:30:54.521Z