English
Related papers

Related papers: Perspectives on Capturing Emotional Expressiveness…

200 papers

Gesturing is one of the natural modes of human communication. Signs produced by gestures can have a basic meaning coupled with additional information that is layered over the basic meaning of the sign. Sign language is an important example…

Computer Vision and Pattern Recognition · Computer Science 2014-10-16 Subhadip Basu , S. Dey , K. Mukherjee , T. S. Jana

People with speech and hearing impairments often rely on sign language to communicate with others but most of the general population cannot understand sign language and sign language itself is a difficult language to learn, so there is a…

Human-Computer Interaction · Computer Science 2020-09-10 Sai Charan Bodda , Palki Gupta , Gaurav Joshi , Ayush Chaturvedi

The lack of automatic evaluation metrics tailored for SignWriting presents a significant obstacle in developing effective transcription and translation models for signed languages. This paper introduces a comprehensive suite of evaluation…

Computation and Language · Computer Science 2024-10-18 Amit Moryossef , Rotem Zilberman , Ohad Langer

Sign language, which is a medium of communication for deaf people, uses manual communication and body language to convey meaning, as opposed to using sound. This paper presents a prototype Malayalam text to sign language translation system.…

Computation and Language · Computer Science 2015-09-29 Jestin Joy , Kannan Balakrishnan

The development of agents with emotional intelligence is becoming increasingly vital due to their significant role in human-computer interaction and the growing integration of computer systems across various sectors of society. Affective…

Human-Computer Interaction · Computer Science 2026-05-05 Raziyeh Zall , Alireza Kheyrkhah , Erik Cambria , Zahra Naseri , M. Reza Kangavari

This paper explores the critical but often overlooked role of non-verbal cues, including co-speech gestures and facial expressions, in human communication and their implications for Natural Language Processing (NLP). We argue that…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-14 Amit Moryossef

Textual sentiment analysis and emotion detection consists in retrieving the sentiment or emotion carried by a text or document. This task can be useful in many domains: opinion mining, prediction, feedbacks, etc. However, building a general…

Computation and Language · Computer Science 2013-09-12 Alexandre Denis , Samuel Cruz-Lara , Nadia Bellalem

With the growing Deaf and Hard of Hearing population worldwide and the persistent shortage of certified sign language interpreters, there is a pressing need for an efficient, signs-driven, integrated end-to-end translation system, from sign…

Artificial Intelligence · Computer Science 2025-02-17 Nada Shahin , Leila Ismail

Empathy indicates an individual's ability to understand others. Over the past few years, empathy has drawn attention from various disciplines, including but not limited to Affective Computing, Cognitive Science, and Psychology. Detecting…

Human-Computer Interaction · Computer Science 2025-08-12 Md Rakibul Hasan , Md Zakir Hossain , Shreya Ghosh , Aneesh Krishna , Tom Gedeon

In recent years, sign language processing (SLP) has gained importance in the general field of Natural Language Processing. However, compared to research on spoken languages, SLP research is hindered by complex ad-hoc code, inadvertently…

Computation and Language · Computer Science 2025-09-15 Gerard Sant , Zifan Jiang , Carlos Escolano , Amit Moryossef , Mathias Müller , Rico Sennrich , Sarah Ebling

Sign languages are natural, visual-gestural languages used by Deaf communities worldwide. Over 300 distinct sign languages remain severely low-resource due to limited documentation, sparse datasets, and insufficient computational tools.…

Computation and Language · Computer Science 2026-05-13 Nigar Alishzade , Gulchin Abdullayeva

Sign language is the primary language for many Deaf and Hard-of-Hearing (DHH) signers, yet most conversational AI systems still mediate interaction through spoken or written language. This spoken-language-centered interface can limit access…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Youngmin Kim , Kyobin Choo , Jiwoo Park , Minseo Kim , Chanyoung Kim , Junhyeok Kim , Seong Jae Hwang

A machine can understand human activities, and the meaning of signs can help overcome the communication barriers between the inaudible and ordinary people. Sign Language Recognition (SLR) is a fascinating research area and a crucial task…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 M. Madhiarasan , Partha Pratim Roy

In this paper, we illustrate our work on improving the accessibility of Cyber-Physical Systems (CPS), presenting a study on human-robot interaction where the end-users are either deaf or hearing-impaired people. Current trends in robotic…

Robotics · Computer Science 2019-01-18 Jennifer J. Gago , Juan G. Victores , Carlos Balaguer

This paper presents work on novel machine translation (MT) systems between spoken and signed languages, where signed languages are represented in SignWriting, a sign language writing system. Our work seeks to address the lack of…

Computation and Language · Computer Science 2023-02-24 Zifan Jiang , Amit Moryossef , Mathias Müller , Sarah Ebling

Sign(ed) languages use gestures, such as hand or head movements, for communication. Sign language recognition is an assistive technology for individuals with hearing disability and its goal is to improve such individuals' life quality by…

Human-Computer Interaction · Computer Science 2019-11-04 Mohammad Eslami , Mahdi Karami , Sedigheh Eslami , Solale Tabarestani , Farah Torkamani-Azar , Christoph Meinel

Learning another language can be a highly emotional process, typically characterized by numerous frustrations and triumphs, big and small. For most learners, language learning does not follow a linear, predictable path, its zigzag course…

Computers and Society · Computer Science 2026-05-26 Robert Godwin-Jones

Modern computational linguistic software cannot produce important aspects of sign language translation. Using some researches we deduce that the majority of automatic sign language translation systems ignore many aspects when they generate…

Computation and Language · Computer Science 2012-03-15 Mehrez Boulares , Mohamed Jemni

Sign language is an essential resource enabling access to communication and proper socioemotional development for individuals suffering from disabling hearing loss. As this population is expected to reach 700 million by 2050, the importance…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Cleison Correia de Amorim , Cleber Zanchettin

Textless speech-to-speech translation systems are rapidly advancing, thanks to the integration of self-supervised learning techniques. However, existing state-of-the-art systems fall short when it comes to capturing and transferring…

Sound · Computer Science 2023-10-12 Jarod Duret , Benjamin O'Brien , Yannick Estève , Titouan Parcollet