English
Related papers

Related papers: signwriting-evaluation: Effective Sign Language Ev…

200 papers

Sign spotting, the task of identifying and localizing individual signs within continuous sign language video, plays a pivotal role in scaling dataset annotations and addressing the severe data scarcity issue in sign language translation.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 JianHe Low , Ozge Mercanoglu Sincan , Richard Bowden

Automatic metrics are fundamental for the development and evaluation of machine translation systems. Judging whether, and to what extent, automatic metrics concur with the gold standard of human evaluation is not a straightforward problem.…

Computation and Language · Computer Science 2020-06-15 Nitika Mathur , Timothy Baldwin , Trevor Cohn

Despite notable advances in large language models (LLMs), reliable evaluation of text generation tasks such as text style transfer (TST) remains an open challenge. Existing research has shown that automatic metrics often correlate poorly…

Computation and Language · Computer Science 2026-03-05 Vitaly Protasov , Nikolay Babakov , Daryna Dementieva , Alexander Panchenko

Evaluation metrics play a vital role in the growth of an area as it defines the standard of distinguishing between good and bad models. In the area of code synthesis, the commonly used evaluation metric is BLEU or perfect accuracy, but they…

Software Engineering · Computer Science 2020-09-29 Shuo Ren , Daya Guo , Shuai Lu , Long Zhou , Shujie Liu , Duyu Tang , Neel Sundaresan , Ming Zhou , Ambrosio Blanco , Shuai Ma

Sign Language Translation (SLT) is a task that has not been studied relatively much compared to the study of Sign Language Recognition (SLR). However, the SLR is a study that recognizes the unique grammar of sign language, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Youngmin Kim , Minji Kwak , Dain Lee , Yeongeun Kim , Hyeongboo Baek

Automatic sign language processing is gaining popularity in Natural Language Processing (NLP) research (Yin et al., 2021). In machine translation (MT) in particular, sign language translation based on glosses is a prominent approach. In…

Computation and Language · Computer Science 2022-11-29 Mathias Müller , Zifan Jiang , Amit Moryossef , Annette Rios , Sarah Ebling

Measuring the performance of text recognition and text line detection engines is an important step to objectively compare systems and their configuration. There exist well-established measures for both tasks separately. However, there is no…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Gundram Leifert , Roger Labahn , Tobias Grüning , Svenja Leifert

Beyond conventional paradigms of translating speech and text, recently, there has been interest in automated transcreation of images to facilitate localization of visual content across different cultures. Attempts to define this as a formal…

Computation and Language · Computer Science 2025-03-24 Simran Khanuja , Vivek Iyer , Claire He , Graham Neubig

Significant advances have been made in our ability to understand and generate emotionally expressive content such as text and speech, yet comparable progress in sign language technologies remain limited. While computational approaches to…

Human-Computer Interaction · Computer Science 2025-05-14 Phoebe Chua , Cathy Mengying Fang , Yasith Samaradivakara , Pattie Maes , Suranga Nanayakkara

While the field of style transfer (ST) has been growing rapidly, it has been hampered by a lack of standardized practices for automatic evaluation. In this paper, we evaluate leading ST automatic metrics on the oft-researched task of…

Computation and Language · Computer Science 2021-10-22 Eleftheria Briakou , Sweta Agrawal , Joel Tetreault , Marine Carpuat

Sign Language Production (SLP) is the task of generating sign language video from spoken language inputs. The field has seen a range of innovations over the last few years, with the introduction of deep learning-based approaches providing…

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova

Sign language recognition is a challenging and often underestimated problem comprising multi-modal articulators (handshape, orientation, movement, upper body and face) that integrate asynchronously on multiple streams. Learning powerful…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hamid Reza Vaezi Joze , Oscar Koller

Several code summarization techniques have been proposed in the literature to automatically document a code snippet or a function. Ideally, software developers should be involved in assessing the quality of the generated summaries. However,…

Software Engineering · Computer Science 2023-12-27 Antonio Mastropaolo , Matteo Ciniselli , Massimiliano Di Penta , Gabriele Bavota

Evaluating statement autoformalization, translating natural language mathematics into formal languages like Lean 4, remains a significant challenge, with few metrics, datasets, and standards to robustly measure progress. In this work, we…

Computation and Language · Computer Science 2025-10-30 Auguste Poiroux , Gail Weiss , Viktor Kunčak , Antoine Bosselut

The era of Large Language Models (LLMs) raises new demands for automatic evaluation metrics, which should be adaptable to various application scenarios while maintaining low cost and effectiveness. Traditional metrics for automatic text…

Computation and Language · Computer Science 2024-10-29 Shuqian Sheng , Yi Xu , Tianhang Zhang , Zanwei Shen , Luoyi Fu , Jiaxin Ding , Lei Zhou , Xiaoying Gan , Xinbing Wang , Chenghu Zhou

Like spoken languages, a single sign language expression could correspond to multiple valid textual interpretations. Hence, learning a rigid one-to-one mapping for sign language translation (SLT) models might be inadequate, particularly in…

Multimedia · Computer Science 2024-10-28 Xin Shen , Lei Shen , Shaozu Yuan , Heming Du , Haiyang Sun , Xin Yu

A machine can understand human activities, and the meaning of signs can help overcome the communication barriers between the inaudible and ordinary people. Sign Language Recognition (SLR) is a fascinating research area and a crucial task…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 M. Madhiarasan , Partha Pratim Roy

We study the problem of recognition of fingerspelled letter sequences in American Sign Language in a signer-independent setting. Fingerspelled sequences are both challenging and important to recognize, as they are used for many content…

Computation and Language · Computer Science 2016-02-16 Taehwan Kim , Weiran Wang , Hao Tang , Karen Livescu

Indian Sign Language has limited resources for developing machine learning and data-driven approaches for automated language processing. Though text/audio-based language processing techniques have shown colossal research interest and…

Computation and Language · Computer Science 2024-07-09 Abhinav Joshi , Romit Mohanty , Mounika Kanakanti , Andesha Mangla , Sudeep Choudhary , Monali Barbate , Ashutosh Modi