English
Related papers

Related papers: Group-Level Emotion Recognition Using a Unimodal P…

200 papers

Despite remarkable advances in emotion recognition, they are severely restrained from either the essentially limited property of the employed single modality, or the synchronous presence of all involved multiple modalities. Motivated by…

Machine Learning · Computer Science 2019-07-25 Jing Han , Zixing Zhang , Zhao Ren , Björn Schuller

In this article, the results of our team for the fifth Affective Behavior Analysis in-the-wild (ABAW) competition are presented. The usage of the pre-trained convolutional networks from the EmotiEffNet family for frame-level feature…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Andrey V. Savchenko

Affective computing plays a key role in human-computer interactions, entertainment, teaching, safe driving, and multimedia integration. Major breakthroughs have been made recently in the areas of affective computing (i.e., emotion…

Multimedia · Computer Science 2022-03-22 Yan Wang , Wei Song , Wei Tao , Antonio Liotta , Dawei Yang , Xinlei Li , Shuyong Gao , Yixuan Sun , Weifeng Ge , Wei Zhang , Wenqiang Zhang

In this paper we describe a solution to our entry for the emotion recognition challenge EmotiW 2017. We propose an ensemble of several models, which capture spatial and audio features from videos. Spatial features are captured by…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Boris Knyazev , Roman Shvetsov , Natalia Efremova , Artem Kuharenko

This paper presents an audiovisual-based emotion recognition hybrid network. While most of the previous work focuses either on using deep models or hand-engineered features extracted from images, we explore multiple deep models built on…

Computer Vision and Pattern Recognition · Computer Science 2020-02-24 Xin Guo , Luisa F. Polanía , Kenneth E. Barner

We present AMIGOS-- A dataset for Multimodal research of affect, personality traits and mood on Individuals and GrOupS. Different to other databases, we elicited affect using both short and long videos in two social contexts, one with…

Neurons and Cognition · Quantitative Biology 2017-04-14 Juan Abdon Miranda-Correa , Mojtaba Khomami Abadi , Nicu Sebe , Ioannis Patras

A novel procedure is presented in this paper, for training a deep convolutional and recurrent neural network, taking into account both the available training data set and some information extracted from similar networks trained with other…

Machine Learning · Computer Science 2018-09-13 Dimitrios Kollias , Stefanos Zafeiriou

Emotion detection in older adults is crucial for understanding their cognitive and emotional well-being, especially in hospital and assisted living environments. In this work, we investigate an edge-based, non-obtrusive approach to emotion…

Human-Computer Interaction · Computer Science 2025-07-14 Md. Saif Hassan Onim , Andrew M. Kiselica , Himanshu Thapliyal

In order to create an "in-the-wild" dataset of facial emotions with large number of balanced samples, this paper proposes a game-based data collection framework. The framework mainly include three components: a game engine, a game…

Computer Vision and Pattern Recognition · Computer Science 2016-07-12 Wei Li , Farnaz Abtahi , Christina Tsangouri , Zhigang Zhu

In the computer research area, facial expression recognition is a hot research problem. Recent years, the research has moved from the lab environment to in-the-wild circumstances. It is challenging, especially under extreme poses. But…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Fei Yang , Qian Zhang , Chi Zheng , Guoping Qiu

Multimodal emotion recognition (MMER) systems typically outperform unimodal systems by leveraging the inter- and intra-modal relationships between, e.g., visual, textual, physiological, and auditory modalities. This paper proposes an MMER…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Paul Waligora , Haseeb Aslam , Osama Zeeshan , Soufiane Belharbi , Alessandro Lameiras Koerich , Marco Pedersoli , Simon Bacon , Eric Granger

In the context of education technology, empathic interaction with the user and feedback by the learning system using multiple inputs such as video, voice and text inputs is an important area of research. In this paper, a nonintrusive,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 S L Happy , A. Dasgupta , P. Patnaik , A. Routray

Automatic prediction of emotion promises to revolutionise human-computer interaction. Recent trends involve fusion of multiple data modalities - audio, visual, and physiological - to classify emotional state. However, in practice,…

Machine Learning · Computer Science 2020-04-21 Ross Harper , Joshua Southern

Depression can significantly impact many aspects of an individual's life, including their personal and social functioning, academic and work performance, and overall quality of life. Many researchers within the field of affective computing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Lang He , Kai Chen , Junnan Zhao , Yimeng Wang , Ercheng Pei , Haifeng Chen , Jiewei Jiang , Shiqing Zhang , Jie Zhang , Zhongmin Wang , Tao He , Prayag Tiwari

Dynamic facial expression recognition (FER) databases provide important data support for affective computing and applications. However, most FER databases are annotated with several basic mutually exclusive emotional categories and contain…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yuanyuan Liu , Wei Dai , Chuanxu Feng , Wenbin Wang , Guanghao Yin , Jiabei Zeng , Shiguang Shan

The fifth Affective Behavior Analysis in-the-wild (ABAW) competition has multiple challenges such as Valence-Arousal Estimation Challenge, Expression Classification Challenge, Action Unit Detection Challenge, Emotional Reaction Intensity…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Darshan Gera , Badveeti Naveen Siva Kumar , Bobbili Veerendra Raj Kumar , S Balasubramanian

Facial Expression Recognition (FER) plays a crucial role in human affective analysis and has been widely applied in computer vision tasks such as human-computer interaction and psychological assessment. The 8th Affective Behavior Analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 JunGyu Lee , Kunyoung Lee , Haesol Park , Ig-Jae Kim , Gi Pyo Nam

Multimodal Sentiment Analysis in Real-life Media (MuSe) 2020 is a Challenge-based Workshop focusing on the tasks of sentiment recognition, as well as emotion-target engagement and trustworthiness detection by means of more comprehensively…

In this paper, we present a novel deep multimodal framework to predict human emotions based on sentence-level spoken language. Our architecture has two distinctive characteristics. First, it extracts the high-level features from both text…

Computation and Language · Computer Science 2018-02-26 Yue Gu , Shuhong Chen , Ivan Marsic

In this paper, we describe an entry to the third Emotion Recognition in the Wild Challenge, EmotiW2015. We detail the associated experiments and show that, through more accurately locating the facial landmarks, and considering only the…

Computer Vision and Pattern Recognition · Computer Science 2016-03-31 Matthew Day