English
Related papers

Related papers: Using the Pepper Robot to Support Sign Language Co…

200 papers

In this study, we assess the usability of interactive personal assistants (IPAs), such as Amazon Alexa, in a simulated kitchen smart home environment, with deaf and hard of hearing users. Participants engage in activities in a way that…

Human-Computer Interaction · Computer Science 2026-01-23 Paige DeVries , Nina Tran , Keith Delk , Melanie Miga , Richard Taulbee , Pranav Pidathala , Abraham Glasser , Raja Kushalnagar , Christian Vogler

Sign language serves as the primary meaning of communication for the deaf-mute community. Different from spoken language, it commonly conveys information by the collaboration of manual features, i.e., hand gestures and body movements, and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Wengang Zhou , Weichao Zhao , Hezhen Hu , Zecheng Li , Houqiang Li

As social service robots become commonplace, it is essential for them to effectively interpret human signals, such as verbal, gesture, and eye gaze, when people need to focus on their primary tasks to minimize interruptions and…

Human-Computer Interaction · Computer Science 2025-04-09 Hanfang Lyu , Xiaoyu Wang , Nandi Zhang , Shuai Ma , Qian Zhu , Yuhan Luo , Fugee Tsung , Xiaojuan Ma

Gender/ing guides how we view ourselves, the world around us, and each other--including non-humans. Critical voices have raised the alarm about stereotyped gendering in the design of socially embodied artificial agents like voice…

Robotics · Computer Science 2022-12-09 Katie Seaborn , Alexa Frank

The aim of the present study involves designing a humanoid robot guide as a walking trainer for elderly and rehabilitation patients. The system is based on the humanoid robot Pepper with a compliance approach that allows to match the motion…

Robotics · Computer Science 2019-09-11 Fernando Garcia , Amit Kumar Pandey , Charles Fattal

Humans can learn the use of language through physical interaction with their environment and semiotic communication with other people. It is very important to obtain a computational understanding of how humans can form a symbol system and…

Artificial Intelligence · Computer Science 2023-01-18 Tadahiro Taniguchi , Takayuki Nagai , Tomoaki Nakamura , Naoto Iwahashi , Tetsuya Ogata , Hideki Asoh

The integration of vision-language models into robotic systems constitutes a significant advancement in enabling machines to interact with their surroundings in a more intuitive manner. While VLMs offer rich multimodal reasoning, existing…

Artificial Intelligence · Computer Science 2025-03-03 Hamed Rahimi , Adil Bahaj , Mouad Abrini , Mahdi Khoramshahi , Mounir Ghogho , Mohamed Chetouani

Sign language is an essential means of communication for millions of people around the world and serves as their primary language. However, most communication tools are developed for spoken and written languages which can cause problems and…

Computation and Language · Computer Science 2024-07-16 Ali Ghadami , Alireza Taheri , Ali Meghdari

This study investigates the interaction between humanoid robots NAO and Pepper, emphasizing their potential applications in educational settings. NAO, widely used in education, and Pepper, designed for social interactions, of er new…

We have a vision of a day when autonomous robots can collaborate with humans as assistants in performing complex tasks in the physical world. This vision includes that the robots will have the ability to communicate with their human…

Robotics · Computer Science 2025-09-22 Peter Lindes , Kaoutar Skiker

This paper presents an anthropomorphic robotic bear for the exploration of human-robot interaction including verbal and non-verbal communications. This robot is implemented with a hybrid face composed of a mechanical faceplate with 10 DOFs…

Integrating real-time, complex social signal processing into robotic systems -- especially in real-world, multi-party interaction situations -- is a challenge faced by many in the Human-Robot Interaction (HRI) community. The difficulty is…

Robotics · Computer Science 2020-12-29 Youssef Mohamed , Séverin Lemaignan

Large-language models (LLMs) hold significant promise in improving human-robot interaction, offering advanced conversational skills and versatility in managing diverse, open-ended user requests in various tasks and domains. Despite the…

Robotics · Computer Science 2024-01-09 Callie Y. Kim , Christine P. Lee , Bilge Mutlu

We investigate intelligent personal assistants (IPAs) accessibility for deaf and hard of hearing (DHH) people who can use their voice in everyday communication. The inability of IPAs to understand diverse accents including deaf speech…

Human-Computer Interaction · Computer Science 2026-01-23 Paige S. DeVries , Michaela Okosi , Ming Li , Nora Dunphy , Gidey Gezae , Dante Conway , Abraham Glasser , Raja Kushalnagar , Christian Vogler

Deaf people are using sign language for communication, and it is a combination of gestures, movements, postures, and facial expressions that correspond to alphabets and words in spoken languages. The proposed Arabic sign language…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Muhammad Al-Barham , Ahmad Jamal , Musa Al-Yaman

Socially assistive robotics (SAR) research has shown great potential for supplementing and augmenting therapy for children with autism spectrum disorders (ASD). However, the vast majority of SAR research has been limited to short-term…

Robotics · Computer Science 2020-01-28 Roxanna Pakkar , Caitlyn Clabaugh , Rhianna Lee , Eric Deng , Maja J Mataric

Linguistic ambiguity is ubiquitous in our daily lives. Previous works adopted interaction between robots and humans for language disambiguation. Nevertheless, when interactive robots are deployed in daily environments, there are significant…

Robotics · Computer Science 2024-02-21 Jie Xu , Hanbo Zhang , Xinghang Li , Huaping Liu , Xuguang Lan , Tao Kong

Lip reading is vital for robots in social settings, improving their ability to understand human communication. This skill allows them to communicate more easily in crowded environments, especially in caregiving and customer service roles.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Ali Farshian Abbasi , Aghil Yousefi-Koma , Soheil Dehghani Firouzabadi , Parisa Rashidi , Alireza Naeini

Establishing common ground between an intelligent robot and a human requires communication of the robot's intention, behavior, and knowledge to the human to build trust and assure safety in a shared environment. This paper introduces SENSAR…

Robotics · Computer Science 2020-11-10 Andre Cleaver , Faizan Muhammad , Amel Hassan , Elaine Short , Jivko Sinapov

The integration of large language models (LLMs) with social robots has emerged as a promising avenue for enhancing human-robot interactions at a time when news reports generated by artificial intelligence (AI) are gaining in credibility.…

Robotics · Computer Science 2023-11-14 Abdelhadi Hireche , Abdelkader Nasreddine Belkacem , Sadia Jamil , Chao Chen