English
Related papers

Related papers: SignBart -- New approach with the skeleton sequenc…

200 papers

Sign Language Recognition (SLR) is a fast-growing field that aims to fill the communication gaps between the hearing-impaired and people without hearing loss. Existing solutions for Persian Sign Language (PSL) are limited to word-level…

Human-Computer Interaction · Computer Science 2024-06-25 Amirparsa Salmankhah , Amirreza Rajabi , Negin Kheirmand , Ali Fadaeimanesh , Amirreza Tarabkhah , Amirreza Kazemzadeh , Hamed Farbeh

Dysarthric speech recognition (DSR) presents a formidable challenge due to inherent inter-speaker variability, leading to severe performance degradation when applying DSR models to new dysarthric speakers. Traditional speaker adaptation…

Sound · Computer Science 2024-09-25 Shiyao Wang , Shiwan Zhao , Jiaming Zhou , Aobo Kong , Yong Qin

Despite progress in gloss-free Sign Language Translation (SLT), traditional single modality end-to-end approaches consistently fail on two critical components of natural signing: the precise recognition of high-speed fingerspelling and the…

Computation and Language · Computer Science 2025-12-05 Marshall Thomas , Edward Fish , Richard Bowden

Mass spectrometry (MS) plays a critical role in molecular identification, significantly advancing scientific discovery. However, structure elucidation from MS data remains challenging due to the scarcity of annotated spectra. While…

Machine Learning · Computer Science 2025-10-24 Yang Han , Pengyu Wang , Kai Yu , Xin Chen , Lu Chen

One essential problem in skeleton-based action recognition is how to extract discriminative features over all skeleton joints. However, the complexity of the State-Of-The-Art (SOTA) models of this task tends to be exceedingly sophisticated…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Yi-Fan Song , Zhang Zhang , Caifeng Shan , Liang Wang

Isolated Sign Language Recognition (ISLR) approaches primarily rely on RGB data or signer pose information. However, combining these modalities often results in the loss of crucial details, such as hand shape and orientation, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Sven Schreiber , Noha Sarhan , Simone Frintrop , Christian Wilms

This paper presents an Arabic Alphabet Sign Language recognition approach, using deep learning methods in conjunction with transfer learning and transformer-based models. We study the performance of the different variants on two publicly…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Mazen Balat , Rewaa Awaad , Hend Adel , Ahmed B. Zaky , Salah A. Aly

Gloss-free sign language translation (SLT) is hindered by two key challenges: **inadequate sign representation** that fails to capture nuanced visual cues, and **sentence-level semantic misalignment** in current LLM-based methods, which…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Zhi Rao , Yucheng Zhou , Benjia Zhou , Yiqing Huang , Sergio Escalera , Jun Wan

Deriving governing equations from observational data, known as Symbolic Regression (SR), is a cornerstone of scientific discovery. Large Language Models, (LLMs) have shown promise in this task by leveraging their vast cross-disciplinary…

Computational Engineering, Finance, and Science · Computer Science 2025-10-01 Yingfan Hua , Ruikun Li , Jun Yao , Guohang Zhuang , Shixiang Tang , Bin Liu , Wanli Ouyang , Yan Lu

High-dimensional, heterogeneous data with complex feature interactions pose significant challenges for traditional predictive modeling approaches. While Projection to Latent Structures (PLS) remains a popular technique, it struggles to…

Machine Learning · Computer Science 2025-10-21 Farwa Abbas , Hussain Ahmad , Claudia Szabo

The anatomical structure segmentation of the spine and adjacent structures from computed tomography (CT) images is a key step for spinal disease diagnosis and treatment. However, the segmentation of CT images is impeded by low contrast and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jiaming Liu , Dingwei Fan , Junyong Zhao , Chunlin Li , Haipeng Si , Liang Sun

The performance of automatic speech recognition (ASR) systems severely degrades when multi-talker speech overlap occurs. In meeting environments, speech separation is typically performed to improve the robustness of ASR systems. Recently,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-18 Hassan Taherian , DeLiang Wang

Sign language translation (SLT) is a challenging task that involves translating sign language images into spoken language. For SLT models to perform this task successfully, they must bridge the modality gap and identify subtle variations in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jungeun Kim , Hyeongwoo Jeon , Jongseong Bae , Ha Young Kim

Skeleton-based action recognition has garnered significant attention due to the utilization of concise and resilient skeletons. Nevertheless, the absence of detailed body information in skeletons restricts performance, while other…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Jinfu Liu , Chen Chen , Mengyuan Liu

In this work, we propose a new parameter-efficient learning framework based on neural model reprogramming for cross-lingual speech recognition, which can \textbf{re-purpose} well-trained English automatic speech recognition (ASR) models to…

ChatGPT is a language model based on Generative AI. Existing research work on ChatGPT focused on its use in various domains. However, its potential for Sign Language Translation (SLT) is yet to be explored. This paper addresses this void.…

Computation and Language · Computer Science 2024-01-17 Nada Shahin , Leila Ismail

One of the main challenges in neural sign language production (SLP) lies in the high intra-class variability of signs, arising from signer morphology and stylistic variety in the training data. To improve robustness to such variations, we…

Computation and Language · Computer Science 2025-08-21 Guilhem Fauré , Mostafa Sadeghi , Sam Bigeard , Slim Ouni

Visual speech recognition (VSR) systems decode spoken words from an input sequence using only the video data. Practical applications of such systems include medical assistance as well as human-machine interactions. A VSR system is typically…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Iason Ioannis Panagos , Giorgos Sfikas , Christophoros Nikou

In this paper, we address the intricate issue of RF signal separation by presenting a novel adaptation of the WaveNet architecture that introduces learnable dilation parameters, significantly enhancing signal separation in dense RF…

Signal Processing · Electrical Eng. & Systems 2024-02-16 Yu Tian , Ahmed Alhammadi , Abdullah Quran , Abubakar Sani Ali

Audio is the primary modality for human communication and has driven the success of Automatic Speech Recognition (ASR) technologies. However, such audio-centric systems inherently exclude individuals who are deaf or hard of hearing. Visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jeong Hun Yeo , Hyeongseop Rha , Sungjune Park , Junil Won , Yong Man Ro