English
Related papers

Related papers: Evaluation of a Sign Language Avatar on Comprehens…

200 papers

Generative AI powers a growing wave of companion chatbots, yet principles for fostering genuine connection remain unsettled. We test two routes: visible user authorship versus covert language-style mimicry. In a preregistered 3x2 experiment…

Human-Computer Interaction · Computer Science 2025-09-17 T. James Brandt , Cecilia Xi Wang

In large part due to their implicit semantic modeling, self-supervised learning (SSL) methods have significantly increased the performance of valence recognition in speech emotion recognition (SER) systems. Yet, their large size may often…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-20 Danilo de Oliveira , Navin Raj Prabhu , Timo Gerkmann

This study is the first to explore whether multi-modal large language models (LLMs) can align their behaviors with visual personas, addressing a significant gap in the literature that predominantly focuses on text-based personas. We…

Computation and Language · Computer Science 2024-10-07 Seungjong Sun , Eungu Lee , Seo Yeon Baek , Seunghyun Hwang , Wonbyung Lee , Dongyan Nan , Bernard J. Jansen , Jang Hyun Kim

Sign Languages (SL) serve as the primary mode of communication for the Deaf and Hard of Hearing communities. Deep learning methods for SL recognition and translation have achieved promising results. However, Sign Language Production (SLP)…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Vasileios Baltatzis , Rolandos Alexandros Potamias , Evangelos Ververas , Guanxiong Sun , Jiankang Deng , Stefanos Zafeiriou

Understanding different human attributes and how they affect model behavior may become a standard need for all model creation and usage, from traditional computer vision tasks to the newest multimodal generative AI systems. In computer…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Candice Schumann , Gbolahan O. Olanubi , Auriel Wright , Ellis Monk , Courtney Heldreth , Susanna Ricco

Providing an equitable and inclusive user experience (UX) for people with disabilities (PWD) is a central goal of accessible design. In the specific case of Deaf users, whose hearing impairments impact language development and…

Human-Computer Interaction · Computer Science 2025-08-12 Andrés Eduardo Fuentes-Cortázar , Alejandra Rivera-Hernández , José Rafael Rojano-Cáceres

AI-assisted usability analysis can potentially reduce the time and effort of finding usability problems, yet little is known about how AI's perceived expertise influences evaluators' analytic strategies and perceptions over time. We ran a…

Human-Computer Interaction · Computer Science 2026-03-17 Emily Kuang , Ehsan Jahangirzadeh Soure , Luyao Shen , Nitesh Goyal , Mingming Fan , Kristen Shinohara

As machine learning approaches are increasingly used to augment human decision-making, eXplainable Artificial Intelligence (XAI) research has explored methods for communicating system behavior to humans. However, these approaches often fail…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Luke Guerdan , Alex Raymond , Hatice Gunes

State-of-the-art sign language generation frameworks lack expressivity and naturalness which is the result of only focusing manual signs, neglecting the affective, grammatical and semantic functions of facial expressions. The purpose of…

Computation and Language · Computer Science 2024-10-21 Carla Viegas , Mert İnan , Lorna Quandt , Malihe Alikhani

Sign language is the primary language for people with a hearing loss. Sign language recognition (SLR) is the automatic recognition of sign language, which represents a challenging problem for computers, though some progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Roman Töngi

Sexual harassment has been recognized as a significant social issue. In recent years, the emergence of harassment in social virtual reality (VR) has become an important and urgent research topic. We employed a mixed-methods approach by…

Human-Computer Interaction · Computer Science 2024-10-16 Xuetong Wang , Ziyan Wang , Mingmin Zhang , Kangyou Yu , Pan Hui , Mingming Fan

Despite recent advances in the field of explainable artificial intelligence systems, a concrete quantitative measure for evaluating the usability of such systems is nonexistent. Ensuring the success of an explanatory interface in…

Human-Computer Interaction · Computer Science 2020-10-26 Byung Hyung Kim , Seunghun Koh , Sejoon Huh , Sungho Jo , Sunghee Choi

With the ongoing penetration of conversational user interfaces, a better understanding of social and emotional characteristic inherent to dialogue is required. Chatbots in particular face the challenge of conveying human-like behaviour…

Human-Computer Interaction · Computer Science 2021-04-29 Natascha Mariacher , Stephan Schlögl , Alexander Monz

Effective emotional support hinges on understanding users' emotions and needs to provide meaningful comfort during multi-turn interactions. Large Language Models (LLMs) show great potential for expressing empathy; however, they often…

Computation and Language · Computer Science 2025-05-23 Jing Ye , Lu Xiang , Yaping Zhang , Chengqing Zong

Most deep-learning-based continuous sign language recognition (CSLR) models share a similar backbone consisting of a visual module, a sequential module, and an alignment module. However, due to limited training samples, a connectionist…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Ronglai Zuo , Brian Mak

People with speech and hearing impairments often rely on sign language to communicate with others but most of the general population cannot understand sign language and sign language itself is a difficult language to learn, so there is a…

Human-Computer Interaction · Computer Science 2020-09-10 Sai Charan Bodda , Palki Gupta , Gaurav Joshi , Ayush Chaturvedi

The sense of realism in avatar animation is a widely pursued goal in social VR applications. A common approach to enhancing realism is improving the match between avatar motion and real-world human movement. However, experience with…

Human-Computer Interaction · Computer Science 2025-09-22 Yudong Huang , Avneet Singh , Mark Roman Miller

Automatic Speech Recognition (ASR) robustness toward slot entities are critical in e-commerce voice assistants that involve monetary transactions and purchases. Along with effective domain adaptation, it is intuitive that cross utterance…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-09 Ashish Shenoy , Sravan Bodapati , Katrin Kirchhoff

Due to technological development, Augmented Reality (AR) can be applied in different domains. However, innovative technologies refer to new interaction paradigms, thus creating a new experience for the user. This so-called User Experience…

Human-Computer Interaction · Computer Science 2025-06-05 Stefan Graser , Felix Kirschenlohr , Stephan Böhm