English

Considerations for meaningful sign language machine translation based on glosses

Computation and Language 2022-11-29 v1 Artificial Intelligence

Abstract

Automatic sign language processing is gaining popularity in Natural Language Processing (NLP) research (Yin et al., 2021). In machine translation (MT) in particular, sign language translation based on glosses is a prominent approach. In this paper, we review recent works on neural gloss translation. We find that limitations of glosses in general and limitations of specific datasets are not discussed in a transparent manner and that there is no common standard for evaluation. To address these issues, we put forward concrete recommendations for future research on gloss translation. Our suggestions advocate awareness of the inherent limitations of gloss-based approaches, realistic datasets, stronger baselines and convincing evaluation.

Keywords

Cite

@article{arxiv.2211.15464,
  title  = {Considerations for meaningful sign language machine translation based on glosses},
  author = {Mathias Müller and Zifan Jiang and Amit Moryossef and Annette Rios and Sarah Ebling},
  journal= {arXiv preprint arXiv:2211.15464},
  year   = {2022}
}
R2 v1 2026-06-28T07:15:10.028Z