English
Related papers

Related papers: Machine Translation from Signed to Spoken Language…

200 papers

Recently, speech-to-text translation has attracted more and more attention and many studies have emerged rapidly. In this paper, we present a comprehensive survey on direct speech translation aiming to summarize the current state-of-the-art…

Computation and Language · Computer Science 2023-06-21 Chen Xu , Rong Ye , Qianqian Dong , Chengqi Zhao , Tom Ko , Mingxuan Wang , Tong Xiao , Jingbo Zhu

Automatic Sign Language Translation requires the integration of both computer vision and natural language processing to effectively bridge the communication gap between sign and spoken languages. However, the deficiency in large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Ryan Wong , Necati Cihan Camgoz , Richard Bowden

Communication barriers pose significant challenges for individuals with hearing and speech impairments, often limiting their ability to effectively interact in everyday environments. This project introduces a real-time assistive technology…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Brandone Fonya , Clarence Worrell

Converging societal and technical factors have transformed language technologies into user-facing applications used by the general public across languages. Machine Translation (MT) has become a global tool, with cross-lingual services now…

Computation and Language · Computer Science 2025-09-23 Beatrice Savoldi , Alan Ramponi , Matteo Negri , Luisa Bentivogli

The number of Language Models (LMs) dedicated to processing scientific text is on the rise. Keeping pace with the rapid growth of scientific LMs (SciLMs) has become a daunting task for researchers. To date, no comprehensive surveys on…

Computation and Language · Computer Science 2024-02-01 Xanh Ho , Anh Khoa Duong Nguyen , An Tuan Dao , Junfeng Jiang , Yuki Chida , Kaito Sugimoto , Huy Quoc To , Florian Boudin , Akiko Aizawa

Machine translation (MT) is an important task in natural language processing (NLP) as it automates the translation process and reduces the reliance on human translators. With the resurgence of neural networks, the translation quality…

Computation and Language · Computer Science 2021-01-14 Sameen Maruf , Fahimeh Saleh , Gholamreza Haffari

Sign Language Translation has attained considerable success recently, raising hopes for improved communication with the Deaf. A pre-processing step called tokenization improves the success of translations. Tokens can be learned from sign…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Alptekin Orbay , Lale Akarun

Recent development in Artificial Intelligence (AI) models has propelled their application in scientific discovery, but the validation and exploration of these discoveries require subsequent empirical experimentation. The concept of…

Robotics · Computer Science 2024-11-04 Yu-Zhe Shi , Fanxu Meng , Haofei Hou , Zhangqian Bi , Qiao Xu , Lecheng Ruan , Qining Wang

While Artificial Intelligence applied to the legal domain is a topic with origins in the last century, recent advances in Artificial Intelligence are posed to revolutionize it. This work presents an overview and contextualizes the main…

Computation and Language · Computer Science 2022-04-15 João Dias , Pedro A. Santos , Nuno Cordeiro , Ana Antunes , Bruno Martins , Jorge Baptista , Carlos Gonçalves

We aim to solve the highly challenging task of generating continuous sign language videos solely from speech segments for the first time. Recent efforts in this space have focused on generating such videos from human-annotated text…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Parul Kapoor , Rudrabha Mukhopadhyay , Sindhu B Hegde , Vinay Namboodiri , C V Jawahar

Sign language recognition is a challenging and often underestimated problem comprising multi-modal articulators (handshape, orientation, movement, upper body and face) that integrate asynchronously on multiple streams. Learning powerful…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hamid Reza Vaezi Joze , Oscar Koller

Semantic parsing is the task of translating natural language utterances into machine-readable meaning representations. Currently, most semantic parsing methods are not able to utilize contextual information (e.g. dialogue and comments…

Computation and Language · Computer Science 2020-11-03 Zhuang Li , Lizhen Qu , Gholamreza Haffari

Sign languages are multi-channel languages that communicate information through not just the hands (manual signals) but also facial expressions and upper body movements (non-manual signals). However, since automatic sign language…

Computation and Language · Computer Science 2024-06-12 Jung-Ho Kim , Mathew Huerta-Enochian , Changyong Ko , Du Hui Lee

Inspired by recent and revolutionary developments in AI, particularly in language understanding and generation, we set about designing AI systems that are able to address complex scientific tasks that challenge human capabilities to make…

Computation and Language · Computer Science 2022-11-01 José Manuel Gómez-Pérez

For the past 60 years, Research in machine translation is going on. For the development in this field, a lot of new techniques are being developed each day. As a result, we have witnessed development of many automatic machine translators. A…

Computation and Language · Computer Science 2013-07-25 Nisheeth Joshi , Hemant Darbari , Iti Mathur

Interest in Artificial Intelligence (AI) and its applications has seen unprecedented growth in the last few years. This success can be partly attributed to the advancements made in the sub-fields of AI such as machine learning, computer…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Aditya Mogadala , Marimuthu Kalimuthu , Dietrich Klakow

Translating from languages without productive grammatical gender like English into gender-marked languages is a well-known difficulty for machines. This difficulty is also due to the fact that the training data on which models are built…

Computation and Language · Computer Science 2020-06-11 Luisa Bentivogli , Beatrice Savoldi , Matteo Negri , Mattia Antonino Di Gangi , Roldano Cattoni , Marco Turchi

Computer-assisted language learning -- CALL -- is an established research field. We review how artificial intelligence can be applied to support language learning and teaching. The need for intelligent agents that assist language learners…

Computation and Language · Computer Science 2025-05-06 Anisia Katinskaia

Significant progress has been made recently on challenging tasks in automatic sign language understanding, such as sign language recognition, translation and production. However, these works have focused on datasets with relatively few…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Alvaro Budria , Laia Tarres , Gerard I. Gallego , Francesc Moreno-Noguer , Jordi Torres , Xavier Giro-i-Nieto

Prior work on Sign Language Translation has shown that having a mid-level sign gloss representation (effectively recognizing the individual signs) improves the translation performance drastically. In fact, the current state-of-the-art in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Necati Cihan Camgoz , Oscar Koller , Simon Hadfield , Richard Bowden