中文
相关论文

相关论文: Towards Continuous Sign Language Conversation from…

200 篇论文

Sign languages are visual languages which convey information by signers' handshape, facial expression, body movement, and so forth. Due to the inherent restriction of combinations of these visual ingredients, there exist a significant…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Ronglai Zuo , Fangyun Wei , Brian Mak

Research on continuous sign language recognition (CSLR) is essential to bridge the communication gap between deaf and hearing individuals. Numerous previous studies have trained their models using the connectionist temporal classification…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Ronglai Zuo , Fangyun Wei , Brian Mak

Sign language recognition (SLR) refers to interpreting sign language glosses from given videos automatically. This research area presents a complex challenge in computer vision because of the rapid and intricate movements inherent in sign…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Muxin Pu , Mei Kuan Lim , Chun Yong Chong

Sign Language is the dominant yet non-primary form of communication language used in the deaf and hearing-impaired community. To make an easy and mutual communication between the hearing-impaired and the hearing communities, building a…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera , Mohammad Sabokrou

Automatic speech processing systems are employed more and more often in real environments. Although the underlying speech technology is mostly language independent, differences between languages with respect to their structure and grammar…

计算与语言 · 计算机科学 2012-03-20 A. M. Riad , Hamdy K. Elmonier , Samaa. M. Shohieb , A. S. Asem

The primary concern of this research is to take American Sign Language (ASL) data through real time camera footage and be able to convert the data and information into text. Adding to that, we are also putting focus on creating a framework…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Hasnat Jamil Bhuiyan , Mubtasim Fuad Mozumder , Md. Rabiul Islam Khan , Md. Sabbir Ahmed , Nabuat Zaman Nahim

Sign languages are visual languages, with vocabularies as rich as their spoken language counterparts. However, current deep-learning based Sign Language Production (SLP) models produce under-articulated skeleton pose sequences from…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Ben Saunders , Necati Cihan Camgoz , Richard Bowden

Sign language to text is a crucial technology that can break down communication barriers for individuals with hearing difficulties. We replicate and try to improve on a recently published study. We evaluate models using BLEU and rBLEU…

计算与语言 · 计算机科学 2024-02-13 Parsheeta Roy , Ji-Eun Han , Srishti Chouhan , Bhaavanaa Thumu

People with speech and hearing impairments often rely on sign language to communicate with others but most of the general population cannot understand sign language and sign language itself is a difficult language to learn, so there is a…

人机交互 · 计算机科学 2020-09-10 Sai Charan Bodda , Palki Gupta , Gaurav Joshi , Ayush Chaturvedi

Sign spotting, the task of identifying and localizing individual signs within continuous sign language video, plays a pivotal role in scaling dataset annotations and addressing the severe data scarcity issue in sign language translation.…

计算机视觉与模式识别 · 计算机科学 2025-08-08 JianHe Low , Ozge Mercanoglu Sincan , Richard Bowden

Emotion Recognition in Conversation is a core component of affective computing, while current resources of sign language emotion datasets primarily focus on isolated sentences and lack conversational context. Models trained exclusively on…

计算与语言 · 计算机科学 2026-05-25 Yusong Wang , Keyu Mao , Takao Obi , Minghao Shao , Kotaro Funakoshi

The count of people suffering from various levels of hearing loss reached 1.57 billion in 2019. This huge number tends to suffer on many personal and professional levels and strictly needs to be included with the rest of society healthily.…

信号处理 · 电气工程与系统科学 2023-12-20 Basma Kalandar , Ziemowit Dworakowski

The lack of automatic evaluation metrics tailored for SignWriting presents a significant obstacle in developing effective transcription and translation models for signed languages. This paper introduces a comprehensive suite of evaluation…

计算与语言 · 计算机科学 2024-10-18 Amit Moryossef , Rotem Zilberman , Ohad Langer

Sign language is the preferred method of communication of deaf or mute people, but similar to any language, it is difficult to learn and represents a significant barrier for those who are hard of hearing or unable to speak. A person's…

计算机视觉与模式识别 · 计算机科学 2022-12-26 Neil Song , Yu Xiang

To be truly understandable and accepted by Deaf communities, an automatic Sign Language Production (SLP) system must generate a photo-realistic signer. Prior approaches based on graphical avatars have proven unpopular, whereas recent neural…

计算机视觉与模式识别 · 计算机科学 2020-11-30 Ben Saunders , Necati Cihan Camgoz , Richard Bowden

Current benchmarks for sign language recognition (SLR) focus mainly on isolated SLR, while there are limited datasets for continuous SLR (CSLR), which recognizes sequences of signs in a video. Additionally, existing CSLR datasets are…

计算机视觉与模式识别 · 计算机科学 2025-06-05 Sarah Alyami , Hamzah Luqman , Sadam Al-Azani , Maad Alowaifeer , Yazeed Alharbi , Yaser Alonaizan

Deaf individuals confront significant communication obstacles on a daily basis. Their inability to hear makes it difficult for them to communicate with those who do not understand sign language. Moreover, it presents difficulties in…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Velmathi G , Kaushal Goyal

This research explores the positive application of deepfake technology for upper body generation, specifically sign language for the Deaf and Hard of Hearing (DHoH) community. Given the complexity of sign language and the scarcity of…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Shahzeb Naeem , Muhammad Riyyan Khan , Usman Tariq , Abhinav Dhall , Carlos Ivan Colon , Hasan Al-Nashash

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

计算机视觉与模式识别 · 计算机科学 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova

Large language models, with their strong reasoning ability and rich knowledge, have brought revolution to many tasks of AI, but their impact on sign language generation remains limited due to its complexity and unique rules. In this paper,…

计算与语言 · 计算机科学 2025-07-16 Zhaoyi An , Rei Kawakami