English
Related papers

Related papers: Facial emotion expressions in human-robot interact…

200 papers

The proposed framework in this paper has the primary objective of classifying the facial expression shown by a person. These classifiable expressions can be any one of the six universal emotions along with the neutral emotion. After the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Fuzail Khan

Emotions can provide a natural communication modality to complement the existing multi-modal capabilities of social robots, such as text and speech, in many domains. We conducted three online studies with 112, 223, and 151 participants to…

Robotics · Computer Science 2022-08-23 Sami Alperen Akgun , Moojan Ghafurian , Mark Crowley , Kerstin Dautenhahn

Body movements carry important information about a person's emotions or mental state and are essential in daily communication. Enhancing the ability of machines to understand emotions expressed through body language can improve the…

Artificial Intelligence · Computer Science 2023-04-06 Chenyan Wu , Dolzodmaa Davaasuren , Tal Shafir , Rachelle Tsachor , James Z. Wang

Facial expression recognition (FER) has emerged as a promising approach to the development of emotion-aware intelligent systems. The performance of FER in multiple domains is continuously being improved, especially through advancements in…

Human-Computer Interaction · Computer Science 2024-10-15 Sanjeev Nahulanthran , Mor Vered , Leimin Tian , Dana Kulić

As robots and artificial agents become increasingly integrated into daily life, enhancing their ability to interact with humans is essential. Emotions, which play a crucial role in human interactions, can improve the naturalness and…

Robotics · Computer Science 2025-04-17 Francesca Corrao , Alice Nardelli , Jennifer Renoux , Carmine Tommaso Recchiuto

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

With the advancement of conversational AI, research on bodily expressions, including gestures and facial expressions, has also progressed. However, many existing studies focus on photorealistic avatars, making them unsuitable for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Taisei Omine , Naoyuki Kawabata , Fuminori Homma

Speech-driven 3D facial animation technology has been developed for years, but its practical application still lacks expectations. The main challenges lie in data limitations, lip alignment, and the naturalness of facial expressions.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Xiangyu Liang , Wenlin Zhuang , Tianyong Wang , Guangxing Geng , Guangyue Geng , Haifeng Xia , Siyu Xia

There are many examples of cases where access to improved models of human behavior and cognition has allowed creation of robots which can better interact with humans, and not least in road vehicle automation this is a rapidly growing area…

Robotics · Computer Science 2022-08-25 Gustav Markkula , Mehmet Dogar

Emotional concepts play a huge role in our daily life since they take part into many cognitive processes: from the perception of the environment around us to different learning processes and natural communication. Social robots need to…

Neural and Evolutionary Computing · Computer Science 2018-08-02 Pablo Barros , Emilia Barakova , Stefan Wermter

The ability to modulate vocal sounds and generate speech is one of the features which set humans apart from other living beings. The human voice can be characterized by several attributes such as pitch, timbre, loudness, and vocal tone. It…

Computer Vision and Pattern Recognition · Computer Science 2017-10-30 Poorna Banerjee Dasgupta

Generative AI systems are increasingly capable of expressing emotions via text and imagery. Effective emotional expression will likely play a major role in the efficacy of AI systems -- particularly those designed to support human mental…

Affective computing stands at the forefront of artificial intelligence (AI), seeking to imbue machines with the ability to comprehend and respond to human emotions. Central to this field is emotion recognition, which endeavors to identify…

Machine Learning · Computer Science 2024-07-08 Fei Ma , Yucheng Yuan , Yifan Xie , Hongwei Ren , Ivan Liu , Ying He , Fuji Ren , Fei Richard Yu , Shiguang Ni

In order to create effective storytelling agents three fundamental questions must be answered: first, is a physically embodied agent preferable to a virtual agent or a voice-only narration? Second, does a human voice have an advantage over…

Robotics · Computer Science 2016-07-20 Sandra Costa , Alberto Brunete , Byung-Chull Bae , Nikolaos Mavridis

Body and face motion play an integral role in communication. They convey crucial information on the participants. Advances in generative modeling and multi-modal learning have enabled motion generation from signals such as speech,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Lownish Rai Sookha , Nikhil Pakhale , Mudasir Ganaie , Abhinav Dhall

Training facial emotion recognition models requires large sets of data and costly annotation processes. To alleviate this problem, we developed a gamified method of acquiring annotated facial emotion data without an explicit labeling effort…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Krist Shingjergji , Deniz Iren , Felix Bottger , Corrie Urlings , Roland Klemke

We present a robotic system capable of navigating autonomously by following a line and taking good quality pictures of people. When a group of people are detected, the robot rotates towards them and then back to line while continuously…

Robotics · Computer Science 2019-04-12 Rhys Newbury , Akansel Cosgun , Mehmet Koseoglu , Tom Drummond

The purpose of the present study is to learn emotion expression representations for artificial agents using reward shaping mechanisms. The approach takes inspiration from the TAMER framework for training a Multilayer Perceptron (MLP) to…

Robotics · Computer Science 2020-03-31 Nikhil Churamani , Francisco Cruz , Sascha Griffiths , Pablo Barros

Facial expression manipulation aims at editing facial expression with a given condition. Previous methods edit an input image under the guidance of a discrete emotion label or absolute condition (e.g., facial action units) to possess the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Jun Ling , Han Xue , Li Song , Shuhui Yang , Rong Xie , Xiao Gu

Emotion recognition in social situations is a complex task that requires integrating information from both facial expressions and the situational context. While traditional approaches to automatic emotion recognition have focused on…

Human-Computer Interaction · Computer Science 2024-08-05 Bin Han , Cleo Yau , Su Lei , Jonathan Gratch