English

A$^{2}$V-SLP: Alignment-Aware Variational Modeling for Disentangled Sign Language Production

Machine Learning 2026-02-13 v1 Computation and Language

Abstract

Building upon recent structural disentanglement frameworks for sign language production, we propose A2^{2}V-SLP, an alignment-aware variational framework that learns articulator-wise disentangled latent distributions rather than deterministic embeddings. A disentangled Variational Autoencoder (VAE) encodes ground-truth sign pose sequences and extracts articulator-specific mean and variance vectors, which are used as distributional supervision for training a non-autoregressive Transformer. Given text embeddings, the Transformer predicts both latent means and log-variances, while the VAE decoder reconstructs the final sign pose sequences through stochastic sampling at the decoding stage. This formulation maintains articulator-level representations by avoiding deterministic latent collapse through distributional latent modeling. In addition, we integrate a gloss attention mechanism to strengthen alignment between linguistic input and articulated motion. Experimental results show consistent gains over deterministic latent regression, achieving state-of-the-art back-translation performance and improved motion realism in a fully gloss-free setting.

Keywords

Cite

@article{arxiv.2602.11861,
  title  = {A$^{2}$V-SLP: Alignment-Aware Variational Modeling for Disentangled Sign Language Production},
  author = {Sümeyye Meryem Taşyürek and Enis Mücahid İskender and Hacer Yalim Keles},
  journal= {arXiv preprint arXiv:2602.11861},
  year   = {2026}
}

Comments

9 pages, 2 figures, 8 tables

R2 v1 2026-07-01T10:33:31.791Z