English
Related papers

Related papers: Social App Accessibility for Deaf Signers

200 papers

This paper presents a sign language conversation system based on the See-Through Face Display to address the challenge of maintaining eye contact in remote sign language interactions. A camera positioned behind a transparent display allows…

Human-Computer Interaction · Computer Science 2025-04-07 Kazuya Izumi , Akihisa Shitara , Yoichi Ochiai

Smart Home Assistants (SHAs) have become ubiquitous in modern households, offering convenience and efficiency through its voice interface. However, for Deaf and Hard-of-Hearing (DHH) individuals, the reliance on auditory and textual…

Human-Computer Interaction · Computer Science 2024-12-03 Tyrone Justin Sta. Maria , Jordan Aiko Deja

Sign Language is the dominant yet non-primary form of communication language used in the deaf and hearing-impaired community. To make an easy and mutual communication between the hearing-impaired and the hearing communities, building a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera , Mohammad Sabokrou

Sign language is the primary language for many Deaf and Hard-of-Hearing (DHH) signers, yet most conversational AI systems still mediate interaction through spoken or written language. This spoken-language-centered interface can limit access…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Youngmin Kim , Kyobin Choo , Jiwoo Park , Minseo Kim , Chanyoung Kim , Junhyeok Kim , Seong Jae Hwang

The proliferation of mobile applications (apps) has made it crucial to ensure their accessibility for users with disabilities. However, there is a lack of research on the real-world challenges developers face in implementing mobile…

Software Engineering · Computer Science 2024-09-17 Amila Indika , Christopher Lee , Haochen Wang , Justin Lisoway , Anthony Peruma , Rick Kazman

Blind people face significant challenges when using smartphones. The focus on improving non-visual mobile accessibility has been at the level of touchscreen access. Our research investigates the challenges faced by blind people in their…

Human-Computer Interaction · Computer Science 2019-10-31 André Rodrigues , Hugo Nicolau , Kyle Montague , João Guerreiro , Tiago Guerreiro

Sign language is a natural and visual form of language that uses movements and expressions to convey meaning, serving as a crucial means of communication for individuals who are deaf or hard-of-hearing (DHH). However, the number of people…

Robotics · Computer Science 2026-02-27 Guanren Qiao , Sixu Lin , Ronglai Zuo , Zhizheng Wu , Kui Jia , Guiliang Liu

Communication is defined as the act of sharing or exchanging information, ideas or feelings. To establish communication between two people, both of them are required to have knowledge and understanding of a common language. But in the case…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Sharvani Srivastava , Amisha Gangwar , Richa Mishra , Sudhakar Singh

According to the World Federation of the Deaf, more than two hundred sign languages exist. Therefore, it is challenging to understand deaf individuals, even proficient sign language users, resulting in a barrier between the deaf community…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Tuan-Luc Huynh , Khoi-Nguyen Nguyen-Ngoc , Chi-Bien Chu , Minh-Triet Tran , Trung-Nghia Le

d/Deaf and hearing song-signers have become prevalent across video-sharing platforms, but translating songs into sign language remains cumbersome and inaccessible. Our formative study revealed the challenges song-signers face, including…

Human-Computer Interaction · Computer Science 2025-05-09 Suhyeon Yoo , Khai N. Truong , Young-Ho Kim

Real-time captioning is a useful technique for deaf and hard-of-hearing (DHH) people to talk to hearing people. With the improvement in device performance and the accuracy of automatic speech recognition (ASR), real-time captioning is…

Human-Computer Interaction · Computer Science 2021-01-28 Kenta Yamamoto , Ippei Suzuki , Akihisa Shitara , Yoichi Ochiai

These days mobile devices like phones or tablets are very common among people of all age. They are connected with network and provide seamless communications through internet or cellular services. These devices can be a big help for the…

Human-Computer Interaction · Computer Science 2015-03-13 Jagdish L. Raheja , A. Singhal , A. Chaudhary

Deaf individuals confront significant communication obstacles on a daily basis. Their inability to hear makes it difficult for them to communicate with those who do not understand sign language. Moreover, it presents difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Velmathi G , Kaushal Goyal

This study investigates innovative interaction designs for communication and collaborative learning between learners of mixed hearing and signing abilities, leveraging advancements in mixed reality technologies like Apple Vision Pro and…

Human-Computer Interaction · Computer Science 2025-03-11 Si Chen , Haocong Cheng , Suzy Su , Stephanie Patterson , Raja Kushalnagar , Qi Wang , Yun Huang

People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Mallikharjuna Rao K , Harleen Kaur , Sanjam Kaur Bedi , M A Lekhana

With the advent of the pandemic, the use of video conferencing platforms as a means of communication has greatly increased and with it, so have the remote opportunities. The deaf and dumb have traditionally faced several issues in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Kshitij Deshpande , Varad Mashalkar , Kaustubh Mhaisekar , Amaan Naikwadi , Archana Ghotkar

The present work reports the development of an application called Signa App, which was designed following the philosophy of User-Centered De-sign. Signa App aims to provide a mobile platform for editing and creating texts in SignWriting…

Human-Computer Interaction · Computer Science 2025-10-28 J. R. Rojano-Cáceres , A. Rivera-Hernández

Sign language visual recognition from continuous multi-modal streams is still one of the most challenging fields. Recent advances in human actions recognition are exploiting the ascension of GPU-based learning from massive data, and are…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Bassem Seddik , Najoua Essoukri Ben Amara

A primary challenge for the deaf and hearing-impaired community stems from the communication gap with the hearing society, which can greatly impact their daily lives and result in social exclusion. To foster inclusivity in society, our…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Elisa Cabana

Many personal devices have transitioned from visual-controlled interfaces to speech-controlled interfaces to reduce costs and interactive friction, supported by the rapid growth in capabilities of speech-controlled interfaces, e.g., Amazon…

Human-Computer Interaction · Computer Science 2019-09-04 Abraham Glasser , Kesavan Kushalnagar , Raja Kushalnagar