English
Related papers

Related papers: SignSpeak: Open-Source Time Series Classification …

200 papers

People with speech and hearing impairments often rely on sign language to communicate with others but most of the general population cannot understand sign language and sign language itself is a difficult language to learn, so there is a…

Human-Computer Interaction · Computer Science 2020-09-10 Sai Charan Bodda , Palki Gupta , Gaurav Joshi , Ayush Chaturvedi

We are releasing a dataset containing videos of both fluent and non-fluent signers using American Sign Language (ASL), which were collected using a Kinect v2 sensor. This dataset was collected as a part of a project to develop and evaluate…

Computation and Language · Computer Science 2022-07-11 Saad Hassan , Matthew Seita , Larwan Berke , Yingli Tian , Elaine Gale , Sooyeon Lee , Matt Huenerfauth

The target of this research is to experiment, iterate and recommend a system that is successful in recognition of American Sign Language (ASL). It is a challenging as well as an interesting problem that if solved will bring a leap in social…

Computer Vision and Pattern Recognition · Computer Science 2018-05-18 Dhruv Rathi

Models of sign language have historically lagged behind those for spoken language (text and speech). Recent work has greatly improved their performance on tasks like sign language translation and isolated sign recognition. However, it…

Computation and Language · Computer Science 2026-05-01 Serpil Karabüklü , Kanishka Misra , Shester Gueuwou , Diane Brentari , Greg Shakhnarovich , Karen Livescu

The people in the world who are hearing impaired face many obstacles in communication and require an interpreter to comprehend what a person is saying. There has been constant scientific research and the existing models lack the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Shubham Thakar , Samveg Shah , Bhavya Shah , Anant V. Nimkar

Automatic Sign Language Translation requires the integration of both computer vision and natural language processing to effectively bridge the communication gap between sign and spoken languages. However, the deficiency in large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Ryan Wong , Necati Cihan Camgoz , Richard Bowden

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova

Sign language recognition and translation technologies have the potential to increase access and inclusion of deaf signing communities, but research progress is bottlenecked by a lack of representative data. We introduce a new resource for…

Computation and Language · Computer Science 2023-10-03 Lee Kezar , Elana Pontecorvo , Adele Daniels , Connor Baer , Ruth Ferster , Lauren Berger , Jesse Thomason , Zed Sevcikova Sehyr , Naomi Caselli

The count of people suffering from various levels of hearing loss reached 1.57 billion in 2019. This huge number tends to suffer on many personal and professional levels and strictly needs to be included with the rest of society healthily.…

Signal Processing · Electrical Eng. & Systems 2023-12-20 Basma Kalandar , Ziemowit Dworakowski

AI-driven sign language interpretation is limited by a lack of high-quality annotated data. New datasets including ASL STEM Wiki and FLEURS-ASL contain professional interpreters and 100s of hours of data but remain only partially annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Colin Lea , Vasileios Baltatzis , Connor Gillis , Raja Kushalnagar , Lorna Quandt , Leah Findlater

Sign Language Translation (SLT) aims to convert sign language (SL) videos into spoken language text, thereby bridging the communication gap between the sign and the spoken community. While most existing works focus on translating a single…

Computation and Language · Computer Science 2025-06-02 Sihan Tan , Taro Miyazaki , Kazuhiro Nakadai

Sign languages are the primary means of communication for many hard-of-hearing people worldwide. Recently, to bridge the communication gap between the hard-of-hearing community and the rest of the population, several sign language…

Computation and Language · Computer Science 2023-07-12 Abhinav Joshi , Susmit Agrawal , Ashutosh Modi

Sign language recognition is a challenging and often underestimated problem comprising multi-modal articulators (handshape, orientation, movement, upper body and face) that integrate asynchronously on multiple streams. Learning powerful…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hamid Reza Vaezi Joze , Oscar Koller

We introduce the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign class examples to recognize the instances of unseen signs. To this end, we propose to utilize the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-25 Yunus Can Bilge , Nazli Ikizler-Cinbis , Ramazan Gokberk Cinbis

Computational sign language research lacks the large-scale datasets that enables the creation of useful reallife applications. To date, most research has been limited to prototype systems on small domains of discourse, e.g. weather…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Necati Cihan Camgoz , Ben Saunders , Guillaume Rochette , Marco Giovanelli , Giacomo Inches , Robin Nachtrab-Ribback , Richard Bowden

Existing work on sign language translation - that is, translation from sign language videos into sentences in a written language - has focused mainly on (1) data collected in a controlled environment or (2) data in a specific domain, which…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Bowen Shi , Diane Brentari , Greg Shakhnarovich , Karen Livescu

Sign languages are natural, visual-gestural languages used by Deaf communities worldwide. Over 300 distinct sign languages remain severely low-resource due to limited documentation, sparse datasets, and insufficient computational tools.…

Computation and Language · Computer Science 2026-05-13 Nigar Alishzade , Gulchin Abdullayeva

Helping deaf and hard-of-hearing people communicate more easily is the main goal of Automatic Sign Language Translation. Although most past research has focused on turning sign language into text, doing the reverse, turning spoken English…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Kazi Mahathir Rahman , Naveed Imtiaz Nafis , Md. Farhan Sadik , Mohammad Al Rafi , Mehedi Hasan Shahed

Sign language, which conveys meaning through gestures, is the chief means of communication among deaf people. Recognizing sign language in natural settings presents significant challenges due to factors such as lighting, background clutter,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Bowen Shi

Language models for American Sign Language (ASL) could make language technologies substantially more accessible to those who sign. To train models on tasks such as isolated sign recognition (ISR) and ASL-to-English translation, datasets…

Computation and Language · Computer Science 2024-11-07 Lee Kezar , Nidhi Munikote , Zian Zeng , Zed Sehyr , Naomi Caselli , Jesse Thomason
‹ Prev 1 2 3 10 Next ›