English
Related papers

Related papers: A Two-Stage Dual-Modality Model for Facial Emotion…

200 papers

This paper reports the analysis of audio and visual features in predicting the continuous emotion dimensions under the seventh Audio/Visual Emotion Challenge (AVEC 2017), which was done as part of a B.Tech. 2nd year internship project. For…

Computer Vision and Pattern Recognition · Computer Science 2017-10-25 Narotam Singh , Nittin Singh , Abhinav Dhall

Due to the complex nature of human emotions and the diversity of emotion representation methods in humans, emotion recognition is a challenging field. In this research, three input modalities, namely text, audio (speech), and video, are…

Artificial Intelligence · Computer Science 2024-02-13 Minoo Shayaninasab , Bagher Babaali

This paper describes the 6th Affective Behavior Analysis in-the-wild (ABAW) Competition, which is part of the respective Workshop held in conjunction with IEEE CVPR 2024. The 6th ABAW Competition addresses contemporary challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Dimitrios Kollias , Panagiotis Tzirakis , Alan Cowen , Stefanos Zafeiriou , Irene Kotsia , Alice Baird , Chris Gagne , Chunchang Shao , Guanyu Hu

Developing machine learning algorithms to understand person-to-person engagement can result in natural user experiences for communal devices such as Amazon Alexa. Among other cues such as voice activity and gaze, a person's audio-visual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-02 Srinivas Parthasarathy , Shiva Sundaram

Facial affective behavior analysis is important for human-computer interaction. 5th ABAW competition includes three challenges from Aff-Wild2 database. Three common facial affective analysis tasks are involved, i.e. valence-arousal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Shangfei Wang , Yanan Chang , Yi Wu , Xiangyu Miao , Jiaqiang Wu , Zhouan Zhu , Jiahe Wang , Yufei Xiao

Continuous affect prediction in the wild is a very interesting problem and is challenging as continuous prediction involves heavy computation. This paper presents the methodologies and techniques used in our contribution to predict…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-02 Sowmya Rasipuram , Junaid Hamid Bhat , Anutosh Maitra

The contemporary state-of-the-art of Dynamic Facial Expression Recognition (DFER) technology facilitates remarkable progress by deriving emotional mappings of facial expressions from video content, underpinned by training on voluminous…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Haoran Wang , Xinji Mai , Zeng Tao , Xuan Tong , Junxiong Lin , Yan Wang , Jiawen Yu , Boyang Wang , Shaoqi Yan , Qing Zhao , Ziheng Zhou , Shuyong Gao , Wenqiang Zhang

Facial valence/arousal, expression and action unit are related tasks in facial affective analysis. However, the tasks only have limited performance in the wild due to the various collected conditions. The 4th competition on affective…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yanan Chang , Yi Wu , Xiangyu Miao , Jiahe Wang , Shangfei Wang

In human-to-computer interaction, facial animation in synchrony with affective speech can deliver more naturalistic conversational agents. In this paper, we present a two-stage deep learning approach for affective speech driven facial shape…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-13 Rizwan Sadiq , Sasan AsadiAbadi , Engin Erzin

In this study, we present our methodology for two tasks: the Emotional Mimicry Intensity (EMI) Estimation Challenge and the Behavioural Ambivalence/Hesitancy (BAH) Recognition Challenge, both conducted as part of the 8th Workshop and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Tobias Hallmen , Robin-Nico Kampa , Fabian Deuser , Norbert Oswald , Elisabeth André

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

Human-Computer Interaction · Computer Science 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

Recently, facial expression recognition (FER) in the wild has gained a lot of researchers' attention because it is a valuable topic to enable the FER techniques to move from the laboratory to the real applications. In this paper, we focus…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Xingxun Jiang , Yuan Zong , Wenming Zheng , Chuangao Tang , Wanchuang Xia , Cheng Lu , Jiateng Liu

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

Reliable stress recognition is critical in applications such as medical monitoring and safety-critical systems, including real-world driving. While stress is commonly detected using physiological signals such as perinasal perspiration and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Paraskevi Valergaki , Vassilis C. Nicodemou , Iason Oikonomidis , Antonis Argyros , Anastasios Roussos

Current benchmarks for facial expression recognition (FER) mainly focus on static images, while there are limited datasets for FER in videos. It is still ambiguous to evaluate whether performances of existing methods remain satisfactory in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yan Wang , Yixuan Sun , Yiwen Huang , Zhongying Liu , Shuyong Gao , Wei Zhang , Weifeng Ge , Wenqiang Zhang

Human emotions recognization contributes to the development of human-computer interaction. The machines understanding human emotions in the real world will significantly contribute to life in the future. This paper will introduce the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Hong-Hai Nguyen , Van-Thong Huynh , Soo-Hyung Kim

Facial expression detection involves two interrelated tasks: spotting, which identifies the onset and offset of expressions, and recognition, which classifies them into emotional categories. Most existing methods treat these tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Yini Fang , Alec Diallo , Yiqi Shi , Frederic Jumelle , Bertram Shi

Vision is often used as a complementary modality for audio speech recognition (ASR), especially in the noisy environment where performance of solo audio modality significantly deteriorates. After combining visual modality, ASR is upgraded…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Bo Xu , Cheng Lu , Yandong Guo , Jacob Wang

This paper addresses the problem of automatic emotion recognition in the scope of the One-Minute Gradual-Emotional Behavior challenge (OMG-Emotion challenge). The underlying objective of the challenge is the automatic estimation of emotion…

Artificial Intelligence · Computer Science 2018-05-04 Pedro M. Ferreira , Diogo Pernes , Kelwin Fernandes , Ana Rebelo , Jaime S. Cardoso

Dynamic facial expression recognition has many useful applications in social networks, multimedia content analysis, security systems and others. This challenging process must be done under recurrent problems of image illumination and low…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Ali Raza Shahid , Sheheryar Khan , Hong Yan