English
Related papers

Related papers: Machine Translation from Signed to Spoken Language…

200 papers

LLMs are increasingly being deployed for multilingual applications and have demonstrated impressive translation capabilities between several low and high-resource languages. An aspect of translation that often gets overlooked is that of…

Computation and Language · Computer Science 2024-12-03 Pushpdeep Singh , Mayur Patidar , Lovekesh Vig

This paper proposes a simple transfer learning baseline for sign language translation. Existing sign language datasets (e.g. PHOENIX-2014T, CSL-Daily) contain only about 10K-20K pairs of sign videos, gloss annotations and texts, which are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yutong Chen , Fangyun Wei , Xiao Sun , Zhirong Wu , Stephen Lin

Automatic speech recognition and spoken dialogue systems have made great advances through the use of deep machine learning methods. This is partly due to greater computing power but also through the large amount of data available in common…

Computation and Language · Computer Science 2020-06-04 Boris Mocialov , Graham Turner , Helen Hastie

With the evolution of generative linguistic steganography techniques, conventional steganalysis falls short in robustly quantifying the alterations induced by steganography, thereby complicating detection. Consequently, the research…

Computation and Language · Computer Science 2025-02-11 Yihao Wang , Ru Zhang , Yifan Tang , Jianyi Liu

In the artificial intelligence area, one of the ultimate goals is to make computers understand human language and offer assistance. In order to achieve this ideal, researchers of computer science have put forward a lot of models and…

Computation and Language · Computer Science 2015-12-07 Mengyun Cao , Jiao Tian , Dezhi Cheng , Jin Liu , Xiaoping Sun

The field of emergent language represents a novel area of research within the domain of artificial intelligence, particularly within the context of multi-agent reinforcement learning. Although the concept of studying language emergence is…

Spoken language understanding system is traditionally designed as a pipeline of a number of components. First, the audio signal is processed by an automatic speech recognizer for transcription or n-best hypotheses. With the recognition…

Computation and Language · Computer Science 2018-02-26 Dmitriy Serdyuk , Yongqiang Wang , Christian Fuegen , Anuj Kumar , Baiyang Liu , Yoshua Bengio

Translating natural languages into sign languages is a highly complex and underexplored task. Despite growing interest in accessibility and inclusivity, the development of robust translation systems remains hindered by the limited…

Computation and Language · Computer Science 2025-09-09 Luana Bulla , Gabriele Tuccio , Misael Mongiovì , Aldo Gangemi

Modern large-scale automation systems integrate thousands to hundreds of thousands of physical sensors and actuators. Demands for more flexible reconfiguration of production systems and optimization across different information models,…

Machine Learning · Computer Science 2019-03-27 Jacob Nilsson , Fredrik Sandin , Jerker Delsing

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved…

Computation and Language · Computer Science 2024-01-29 Yasmin Moslem

Powerful artificial intelligence (AI) tools that have emerged in recent years -- including large language models, automated coding assistants, and advanced image and speech generation technologies -- are the result of monumental human…

Signal Processing · Electrical Eng. & Systems 2025-09-12 Jarvis Haupt , Qin Lu , Yanning Shen , Jia Chen , Yue Dong , Dan McCreary , Mehmet Akçakaya , Georgios B. Giannakis

Sign language translation (SLT) addresses the problem of translating information from a sign language in video to a spoken language in text. Existing studies, while showing progress, are often limited to narrow domains and/or few sign…

Computation and Language · Computer Science 2024-07-17 Biao Zhang , Garrett Tanzer , Orhan Firat

The field of machine translation has progressed tremendously in recent years. Even though the translation quality has improved significantly, current systems are still unable to produce uniformly acceptable machine translations for the…

Computation and Language · Computer Science 2020-05-11 Meng Zhang , Xin Jiang , Yang Liu , Qun Liu

Code translation aims to convert code from one programming language to another automatically. It is motivated by the need for multi-language software development and legacy system migration. In recent years, neural code translation has…

Software Engineering · Computer Science 2025-05-13 Xiang Chen , Jiacheng Xue , Xiaofei Xie , Caokai Liang , Xiaolin Ju

With the resurgence of chat-based dialog systems in consumer and enterprise applications, there has been much success in developing data-driven and rule-based natural language models to understand human intent. Since these models require…

Computation and Language · Computer Science 2018-05-14 Nicholas Ruiz , Srinivas Bangalore , John Chen

Building socially-intelligent AI agents (Social-AI) is a multidisciplinary, multimodal research goal that involves creating agents that can sense, perceive, reason about, learn from, and respond to affect, behavior, and cognition of other…

Human-Computer Interaction · Computer Science 2024-10-10 Leena Mathur , Paul Pu Liang , Louis-Philippe Morency

The absence of standardized spelling conventions and the organic evolution of human language present an inherent linguistic challenge within historical documents, a longstanding concern for scholars in the humanities. Addressing this issue,…

Computation and Language · Computer Science 2025-07-01 Miguel Domingo , Francisco Casacuberta

Idioms pose problems to almost all Machine Translation systems. This type of language is very frequent in day-to-day language use and cannot be simply ignored. The recent interest in memory augmented models in the field of Language…

Computation and Language · Computer Science 2018-10-17 Giancarlo D. Salton , Robert J. Ross , John D. Kelleher

Sign language is a natural and visual form of language that uses movements and expressions to convey meaning, serving as a crucial means of communication for individuals who are deaf or hard-of-hearing (DHH). However, the number of people…

Robotics · Computer Science 2026-02-27 Guanren Qiao , Sixu Lin , Ronglai Zuo , Zhizheng Wu , Kui Jia , Guiliang Liu

Our aim is to develop a unified model for sign language understanding, that performs sign language translation (SLT) and sign-subtitle alignment (SSA). Together, these two tasks enable the conversion of continuous signing videos into spoken…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Youngjoon Jang , Liliane Momeni , Zifan Jiang , Joon Son Chung , Gül Varol , Andrew Zisserman